optillm
Optimizing inference proxy for LLMs
algorithmicsuperintelligence/optillm
View on GitHub ↗Optimizing inference proxy for LLMs
optillm grew +0.6% in the last 30 days, ranks 54th of 490 in Local Runtime / Inference Engine, actively maintained, last commit 11 days ago.
Star trajectory
123 days tracked2026-06-214.3k stars today2026-10-23
Momentum
+0.6% in 30d, below the Local Runtime / Inference Engine median of +1.7%.
Maintenance
Last commit 11 days ago, staler than the median of 5.5d.
How it compares in Local Runtime / Inference Engine
optillm
4.3k
stars
+0.6% 30d
commit 11 days ago
Local Runtime / Inference Engine median
414.5
stars
+1.7% 30d
commit ~5.5d ago
Leader · ollama
184.4k
stars
+1.6% 30d
commit today
Ranked 54th of 490 by stars.
turboderp/exllamav24.6k-313ruvnet/RuVector4.6k-285
algorithmicsuperintelligence/optillm4.3k
raullenchai/Rapid-MLX4k+310edison7009/EchoBird3.4k+906- Language
- Python
- License
- Apache License 2.0
- Contributors
- 22
- Forks
- 394
- Watchers
- 40
- Open issues
- 16
- Releases
- 101
- Created
- 2024-08-22
- Stars this week
- +11
You've seen where optillm stands today.
Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.