llm-optimizer

Benchmark and optimize LLM inference across frameworks with ease

bentoml/llm-optimizer

View on GitHub ↗

Benchmark and optimize LLM inference across frameworks with ease

llm-optimizer grew +0.5% in the last 30 days, ranks 179th of 305 in Inference Optimization, actively maintained, last commit 6 days ago.

Star trajectory

70 days tracked
2026-08-17202 stars today2026-10-26
Momentum

+0.5% in 30d, below the Inference Optimization median of +1.6%.

Maintenance

Last commit 6 days ago, fresher than the median of 15d.

How it compares in Inference Optimization

llm-optimizer
202
stars
+0.5% 30d
commit 6 days ago
Inference Optimization median
254
stars
+1.6% 30d
commit ~15d ago
Leader · supertonic
13.8k
stars
-0.2% 30d
commit 47 days ago

Ranked 179th of 305 by stars.

Language
Python
License
Apache License 2.0
Contributors
3
Forks
26
Watchers
1
Open issues
10
Releases
0
Created
2025-07-28
Stars this week
+0

You've seen where llm-optimizer stands today.

Get the moves before everyone else: the 5 Inference Optimization repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain llm-optimizer?

Claim this page to add your own call-to-action.

Claim this page