NanoLLM
Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language models, multimodal agents, speech, vector DB, and RAG.
dusty-nv/NanoLLM
View on GitHub ↗Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language models, multimodal agents, speech, vector DB, and RAG.
NanoLLM grew -0.5% in the last 30 days, ranks 75th of 159 in Web / Edge / On-Device Runtime, last commit 737 days ago.
Star trajectory
115 days tracked2026-07-02380 stars today2026-10-25
Momentum
-0.5% in 30d, below the Web / Edge / On-Device Runtime median of +1.8%.
Maintenance
Last commit 737 days ago, staler than the median of 9d.
How it compares in Web / Edge / On-Device Runtime
NanoLLM
380
stars
-0.5% 30d
commit 737 days ago
Web / Edge / On-Device Runtime median
325
stars
+1.8% 30d
commit ~9d ago
Leader · mlc-llm
23.3k
stars
+0.4% 30d
commit 18 days ago
Ranked 75th of 159 by stars.
- Language
- Python
- License
- MIT License
- Contributors
- 3
- Forks
- 67
- Watchers
- 9
- Open issues
- 61
- Releases
- 0
- Created
- 2024-03-31
- Stars this week
- +0
You've seen where NanoLLM stands today.
Get the moves before everyone else: the 5 Web / Edge / On-Device Runtime repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.