modelsphere

ModelSphere is an open-source LLM inference infrastructure designed to make production-grade model serving simple, efficient, and continuously optimized.

modelsphere/modelsphere

View on GitHub ↗

ModelSphere is an open-source LLM inference infrastructure designed to make production-grade model serving simple, efficient, and continuously optimized.

modelsphere ranks 224th of 320 in Production Serving & Deployment, actively maintained, last commit yesterday.

Star trajectory

14 days tracked
2026-10-12168 stars today2026-10-25
Momentum

- in 30d, below the Production Serving & Deployment median of +1.2%.

Maintenance

Last commit yesterday, fresher than the median of 3d.

How it compares in Production Serving & Deployment

modelsphere
168
stars
- 30d
commit yesterday
Production Serving & Deployment median
313
stars
+1.2% 30d
commit ~3d ago
Leader · vllm
95.4k
stars
+3.0% 30d
commit today

Ranked 224th of 320 by stars.

Language
Shell
License
Apache License 2.0
Contributors
4
Forks
7
Watchers
0
Open issues
3
Releases
1
Created
2026-09-27
Stars this week
+101

You've seen where modelsphere stands today.

Get the moves before everyone else: the 5 Production Serving & Deployment repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain modelsphere?

Claim this page to add your own call-to-action.

Claim this page