PowerInfer
High-speed Large Language Model Serving for Local Deployment
Tiiny-AI/PowerInfer
View on GitHub ↗High-speed Large Language Model Serving for Local Deployment
PowerInfer grew +0.4% in the last 30 days, ranks 29th of 490 in Local Runtime / Inference Engine, last commit 164 days ago.
Star trajectory
122 days tracked2026-06-219.8k stars today2026-10-23
Momentum
+0.4% in 30d, below the Local Runtime / Inference Engine median of +1.7%.
Maintenance
Last commit 164 days ago, staler than the median of 5.5d.
How it compares in Local Runtime / Inference Engine
PowerInfer
9.8k
stars
+0.4% 30d
commit 164 days ago
Local Runtime / Inference Engine median
414.5
stars
+1.7% 30d
commit ~5.5d ago
Leader · ollama
184.4k
stars
+1.6% 30d
commit today
Ranked 29th of 490 by stars.
- Language
- C++
- License
- MIT License
- Contributors
- 399
- Forks
- 611
- Watchers
- 108
- Open issues
- 126
- Releases
- 0
- Created
- 2023-12-15
- Stars this week
- +15
You've seen where PowerInfer stands today.
Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.