candle-vllm
Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
EricLBuehler/candle-vllm
View on GitHub ↗Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
candle-vllm grew +1.1% in the last 30 days, ranks 183rd of 494 in Local Runtime / Inference Engine, actively maintained, last commit 6 days ago.
Star trajectory
125 days tracked2026-06-21737 stars today2026-10-25
Momentum
+1.1% in 30d, below the Local Runtime / Inference Engine median of +1.7%.
Maintenance
Last commit 6 days ago, staler than the median of 5d.
How it compares in Local Runtime / Inference Engine
candle-vllm
737
stars
+1.1% 30d
commit 6 days ago
Local Runtime / Inference Engine median
414
stars
+1.7% 30d
commit ~5d ago
Leader · ollama
184.7k
stars
+1.7% 30d
commit today
Ranked 183rd of 494 by stars.
- Language
- Rust
- License
- MIT License
- Contributors
- 8
- Forks
- 92
- Watchers
- 13
- Open issues
- 24
- Releases
- 9
- Created
- 2023-10-29
- Stars this week
- +2
You've seen where candle-vllm stands today.
Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.