exllamav2
A fast inference library for running LLMs locally on modern consumer-class GPUs
turboderp/exllamav2
View on GitHub ↗A fast inference library for running LLMs locally on modern consumer-class GPUs
exllamav2 grew +0.3% in the last 30 days, ranks 52nd of 490 in Local Runtime / Inference Engine, last commit 232 days ago.
Star trajectory
120 days tracked2026-06-254.6k stars today2026-10-23
Momentum
+0.3% in 30d, below the Local Runtime / Inference Engine median of +1.7%.
Maintenance
Last commit 232 days ago, staler than the median of 5.5d.
How it compares in Local Runtime / Inference Engine
exllamav2
4.6k
stars
+0.3% 30d
commit 232 days ago
Local Runtime / Inference Engine median
414.5
stars
+1.7% 30d
commit ~5.5d ago
Leader · ollama
184.4k
stars
+1.6% 30d
commit today
Ranked 52nd of 490 by stars.
- Language
- Python
- License
- MIT License
- Contributors
- 57
- Forks
- 348
- Watchers
- 35
- Open issues
- 140
- Releases
- 43
- Created
- 2023-08-30
- Stars this week
- +7
You've seen where exllamav2 stands today.
Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.