geoffsee 315ef17605 supports small llama and gemma models ...

Refactor inference

dedicated crates for llama and gemma inferencing, not integrated

2025-08-29 20:00:41 -04:00

..

cli.ts

update docs

2025-08-28 12:54:09 -04:00

curl_chat_stream.sh

Refactor apply_cached_repeat_penalty for optimized caching and reuse, add extensive unit tests, and integrate special handling for gemma-specific models.

2025-08-27 16:15:01 -04:00

curl_chat.sh

Refactor apply_cached_repeat_penalty for optimized caching and reuse, add extensive unit tests, and integrate special handling for gemma-specific models.

2025-08-27 16:15:01 -04:00

performance_test_embeddings.sh

Refactor apply_cached_repeat_penalty for optimized caching and reuse, add extensive unit tests, and integrate special handling for gemma-specific models.

2025-08-27 16:15:01 -04:00

performance_test_inference.sh

Refactor apply_cached_repeat_penalty for optimized caching and reuse, add extensive unit tests, and integrate special handling for gemma-specific models.

2025-08-27 16:15:01 -04:00

run_llama.sh

supports small llama and gemma models

2025-08-29 20:00:41 -04:00

run_server.sh

update docs

2025-08-28 12:54:09 -04:00

test.sh

update docs

2025-08-28 12:54:09 -04:00