geoffsee/predict-otron-9001
1
0
Fork 0
mirror of https://github.com/geoffsee/predict-otron-9001.git synced 2025-09-08 22:46:44 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
inference-overhaul
predict-otron-9001/crates
History
geoffsee 315ef17605 supports small llama and gemma models 
Refactor inference

dedicated crates for llama and gemma inferencing, not integrated
2025-08-29 20:00:41 -04:00
..
embeddings-engine
remove confusing comments
2025-08-28 16:09:29 -04:00
gemma-runner
supports small llama and gemma models
2025-08-29 20:00:41 -04:00
helm-chart-tool
supports small llama and gemma models
2025-08-29 20:00:41 -04:00
inference-engine
supports small llama and gemma models
2025-08-29 20:00:41 -04:00
leptos-app
predict-otron-9000 serves a leptos SSR frontend
2025-08-28 12:06:22 -04:00
llama-runner
supports small llama and gemma models
2025-08-29 20:00:41 -04:00
predict-otron-9000
supports small llama and gemma models
2025-08-29 20:00:41 -04:00