tiny-llm

learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen

skyzh/tiny-llm

View on GitHub ↗

learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen

tiny-llm grew +1.3% in the last 30 days, ranks 37th of 324 in Production Serving & Deployment, actively maintained, last commit 4 days ago.

Star trajectory

126 days tracked
2026-06-214.8k stars today2026-10-26
Momentum

+1.3% in 30d, above the Production Serving & Deployment median of +1.2%.

Maintenance

Last commit 4 days ago, staler than the median of 3d.

How it compares in Production Serving & Deployment

tiny-llm
4.8k
stars
+1.3% 30d
commit 4 days ago
Production Serving & Deployment median
314
stars
+1.2% 30d
commit ~3d ago
Leader · vllm
95.6k
stars
+3.1% 30d
commit today

Ranked 37th of 324 by stars.

Language
Python
License
Apache License 2.0
Contributors
27
Forks
410
Watchers
32
Open issues
8
Releases
0
Created
2025-04-19
Stars this week
+13

You've seen where tiny-llm stands today.

Get the moves before everyone else: the 5 Production Serving & Deployment repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain tiny-llm?

Claim this page to add your own call-to-action.

Claim this page