OpenLLM

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

bentoml/OpenLLM

View on GitHub ↗

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

OpenLLM grew +0.1% in the last 30 days, ranks 14th of 320 in Production Serving & Deployment, actively maintained, last commit 2 days ago.

Star trajectory

122 days tracked
2026-06-2512.6k stars today2026-10-25
Momentum

+0.1% in 30d, below the Production Serving & Deployment median of +1.2%.

Maintenance

Last commit 2 days ago, fresher than the median of 3d.

How it compares in Production Serving & Deployment

OpenLLM
12.6k
stars
+0.1% 30d
commit 2 days ago
Production Serving & Deployment median
313
stars
+1.2% 30d
commit ~3d ago
Leader · vllm
95.4k
stars
+3.0% 30d
commit today

Ranked 14th of 320 by stars.

Language
Python
License
Apache License 2.0
Contributors
34
Forks
851
Watchers
82
Open issues
6
Releases
147
Created
2023-04-19
Stars this week
+6

You've seen where OpenLLM stands today.

Get the moves before everyone else: the 5 Production Serving & Deployment repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain OpenLLM?

Claim this page to add your own call-to-action.

Claim this page