fox
A local LLM server built for concurrent work. Drop-in replacement for Ollama and/or OpenAI and Ollama APIs on one port. Requests that share a prompt reuse each other's KV cache instead of each prefilling it. Rust, wrapping llama.cpp.
ferrumox/fox
View on GitHub ↗A local LLM server built for concurrent work. Drop-in replacement for Ollama and/or OpenAI and Ollama APIs on one port. Requests that share a prompt reuse each other's KV cache instead of each prefilling it. Rust, wrapping llama.cpp.
fox grew +0.5% in the last 30 days, ranks 345th of 494 in Local Runtime / Inference Engine, last commit 63 days ago.
Star trajectory
62 days tracked+0.5% in 30d, below the Local Runtime / Inference Engine median of +1.7%.
Last commit 63 days ago, staler than the median of 5d.
How it compares in Local Runtime / Inference Engine
Ranked 345th of 494 by stars.
- Language
- Rust
- License
- Other
- Contributors
- 1
- Forks
- 28
- Watchers
- 5
- Open issues
- 4
- Releases
- 16
- Created
- 2026-03-08
- Stars this week
- -1
You've seen where fox stands today.
Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.