text-generation-inference
Large Language Model Text Generation Inference
huggingface/text-generation-inference
View on GitHub ↗Large Language Model Text Generation Inference
text-generation-inference grew -0.0% in the last 30 days, ranks 17th of 318 in Production Serving & Deployment, last commit 215 days ago.
Star trajectory
119 days tracked2026-06-2610.9k stars today2026-10-23
Momentum
-0.0% in 30d, below the Production Serving & Deployment median of +1.1%.
Maintenance
Last commit 215 days ago, staler than the median of 3d.
How it compares in Production Serving & Deployment
text-generation-inference
10.9k
stars
-0.0% 30d
commit 215 days ago
Production Serving & Deployment median
311
stars
+1.1% 30d
commit ~3d ago
Leader · vllm
95.2k
stars
+2.9% 30d
commit today
Ranked 17th of 318 by stars.
LMCache/LMCache12.2k-1.3ktriton-inference-server/server11.1k-227
huggingface/text-generation-inference10.9k
skypilot-org/skypilot10.7k+147xorbitsai/inference9.6k+1.3k- Language
- Python
- License
- Apache License 2.0
- Contributors
- 148
- Forks
- 1.3k
- Watchers
- 103
- Open issues
- 285
- Releases
- 67
- Created
- 2022-10-08
- Stars this week
- +4
You've seen where text-generation-inference stands today.
Get the moves before everyone else: the 5 Production Serving & Deployment repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.