Awesome-LLM-Inference
๐A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.๐
xlite-dev/Awesome-LLM-Inference
View on GitHub โ๐A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.๐
Awesome-LLM-Inference grew +0.5% in the last 30 days, ranks 50th of 497 in Local Runtime / Inference Engine, actively maintained, last commit 6 days ago.
Star trajectory
126 days tracked2026-06-215.5k stars today2026-10-26
Momentum
+0.5% in 30d, below the Local Runtime / Inference Engine median of +1.7%.
Maintenance
Last commit 6 days ago, staler than the median of 6d.
How it compares in Local Runtime / Inference Engine
Awesome-LLM-Inference
5.5k
stars
+0.5% 30d
commit 6 days ago
Local Runtime / Inference Engine median
407
stars
+1.7% 30d
commit ~6d ago
Leader ยท ollama
184.8k
stars
+1.7% 30d
commit today
Ranked 50th of 497 by stars.
gpustack/gpustack5.9k-354memovai/mimiclaw5.8k-265
xlite-dev/Awesome-LLM-Inference5.5k
fallow-rs/fallow5.3k+291turboderp/exllamav24.6k+894- Language
- Python
- License
- GNU General Public License v3.0
- Contributors
- 45
- Forks
- 441
- Watchers
- 133
- Open issues
- 1
- Releases
- 45
- Created
- 2023-08-27
- Stars this week
- +9
You've seen where Awesome-LLM-Inference stands today.
Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.