Add Docker Compose setup for Ollama and Open-WebUI services

- Replaced single Docker command for Ollama with a `docker-compose` setup.
- Updated `start_inference_server.sh` to use `ollama-compose.yml`.
- Updated README with new usage instructions for Ollama web UI access.
This commit is contained in:
geoffsee
2025-06-04 14:56:17 -04:00
committed by Geoff Seemueller
parent d5393ff964
commit 2884baf000
3 changed files with 44 additions and 4 deletions

View File

@@ -93,8 +93,7 @@ bun run server:dev # Restart server
~~~bash
# See https://ollama.com/library for available models
MODEL_TO_ADD=gemma3
docker exec -it ollama ollama run ${MODEL_TO_ADD}
use the ollama web ui @ http://localhost:8080
~~~
@@ -141,3 +140,5 @@ OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
SOFTWARE.
~~~