vllm.cpp
a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features (GGUF, RadixAttention, Cache-aware scheduling, ...)
localai-org/vllm.cpp
View on GitHub ↗a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features (GGUF, RadixAttention, Cache-aware scheduling, ...)
vllm.cpp ranks 236th of 494 in Local Runtime / Inference Engine, actively maintained, last commit today.
Star trajectory
16 days tracked2026-10-10457 stars today2026-10-25
Momentum
- in 30d, below the Local Runtime / Inference Engine median of +1.7%.
Maintenance
Last commit today, fresher than the median of 5d.
How it compares in Local Runtime / Inference Engine
vllm.cpp
457
stars
- 30d
commit today
Local Runtime / Inference Engine median
414
stars
+1.7% 30d
commit ~5d ago
Leader · ollama
184.7k
stars
+1.7% 30d
commit today
Ranked 236th of 494 by stars.
prabanta-dev/janas467-10mudler/vllm.cpp457+0
localai-org/vllm.cpp457
instavm/open-skills452+5getkern/kern451+6- Language
- C++
- License
- Apache License 2.0
- Contributors
- 23
- Forks
- 56
- Watchers
- 4
- Open issues
- 356
- Releases
- 4
- Created
- 2026-07-02
- Stars this week
- +6
Local Runtime / Inference EngineInference OptimizationProduction Serving & DeploymentLanguage Bindings
You've seen where vllm.cpp stands today.
Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.