llm-inference-handbook

Everything you need to know about LLM inference

bentoml/llm-inference-handbook

View on GitHub ↗

Everything you need to know about LLM inference

llm-inference-handbook grew +4.7% in the last 30 days, ranks 117th of 349 in Getting Started / Hands-On, actively maintained, last commit today.

Star trajectory

116 days tracked
2026-07-02465 stars today2026-10-26
Momentum

+4.7% in 30d, above the Getting Started / Hands-On median of +1.3%.

Maintenance

Last commit today, fresher than the median of 69d.

How it compares in Getting Started / Hands-On

llm-inference-handbook
465
stars
+4.7% 30d
commit today
Getting Started / Hands-On median
326
stars
+1.3% 30d
commit ~69d ago
Leader · ai-agent-book
56k
stars
+9.6% 30d
commit 17 days ago

Ranked 117th of 349 by stars.

Language
TypeScript
License
Apache License 2.0
Contributors
8
Forks
54
Watchers
4
Open issues
5
Releases
0
Created
2025-07-07
Stars this week
+6

You've seen where llm-inference-handbook stands today.

Get the moves before everyone else: the 5 Getting Started / Hands-On repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain llm-inference-handbook?

Claim this page to add your own call-to-action.

Claim this page