Awesome-LLM-Inference

๐Ÿ“šA curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.๐ŸŽ‰

xlite-dev/Awesome-LLM-Inference

View on GitHub โ†—

๐Ÿ“šA curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.๐ŸŽ‰

Awesome-LLM-Inference grew +0.5% in the last 30 days, ranks 50th of 497 in Local Runtime / Inference Engine, actively maintained, last commit 6 days ago.

Star trajectory

126 days tracked
2026-06-215.5k stars today2026-10-26
Momentum

+0.5% in 30d, below the Local Runtime / Inference Engine median of +1.7%.

Maintenance

Last commit 6 days ago, staler than the median of 6d.

How it compares in Local Runtime / Inference Engine

Awesome-LLM-Inference
5.5k
stars
+0.5% 30d
commit 6 days ago
Local Runtime / Inference Engine median
407
stars
+1.7% 30d
commit ~6d ago
Leader ยท ollama
184.8k
stars
+1.7% 30d
commit today

Ranked 50th of 497 by stars.

Language
Python
License
GNU General Public License v3.0
Contributors
45
Forks
441
Watchers
133
Open issues
1
Releases
45
Created
2023-08-27
Stars this week
+9

You've seen where Awesome-LLM-Inference stands today.

Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain Awesome-LLM-Inference?

Claim this page to add your own call-to-action.

Claim this page