tiny-vllm
Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM
jmaczan/tiny-vllm
View on GitHub ↗Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM
tiny-vllm grew +3.0% in the last 30 days, ranks 128th of 496 in Local Runtime / Inference Engine, actively maintained, last commit 3 days ago.
Star trajectory
126 days tracked2026-06-211.2k stars today2026-10-26
Momentum
+3.0% in 30d, above the Local Runtime / Inference Engine median of +1.7%.
Maintenance
Last commit 3 days ago, fresher than the median of 6d.
How it compares in Local Runtime / Inference Engine
tiny-vllm
1.2k
stars
+3.0% 30d
commit 3 days ago
Local Runtime / Inference Engine median
409.5
stars
+1.7% 30d
commit ~6d ago
Leader · ollama
184.8k
stars
+1.7% 30d
commit today
Ranked 128th of 496 by stars.
- Language
- C++
- License
- Apache License 2.0
- Contributors
- 5
- Forks
- 101
- Watchers
- 6
- Open issues
- 0
- Releases
- 0
- Created
- 2026-02-09
- Stars this week
- +11
You've seen where tiny-vllm stands today.
Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.