local-llm-lab
Honest local LLM deployment planning and benchmarking for high unified-memory Macs and future Linux/NVIDIA rigs.
duongngocbinh56599-ui/local-llm-lab
View on GitHub ↗Honest local LLM deployment planning and benchmarking for high unified-memory Macs and future Linux/NVIDIA rigs.
local-llm-lab grew -1.1% in the last 30 days, ranks 483rd of 539 in Local Runtime / Inference Engine, last commit 64 days ago.
Star trajectory
61 days tracked-1.1% in 30d, below the Local Runtime / Inference Engine median of +1.9%.
Last commit 64 days ago, staler than the median of 6d.
How it compares in Local Runtime / Inference Engine
Ranked 483rd of 539 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere local-llm-lab sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
The inference engine the open-source world built for itself.
+6 (+2.5%) in 30d · Committed 56d ago · Python
Shares Local Runtime / Inference Engine, Inference Optimization, Model Optimization
Practical local LLM recipes and benchmarks for RTX 5060 Ti setups
+21 (+11%) in 30d · Committed 44d ago · Python · MIT
Shares Local Runtime / Inference Engine, Inference Optimization, Model Optimization
Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM…
+8 (+1.5%) in 30d · Committed 10d ago · C++ · Other license
Shares Local Runtime / Inference Engine, Inference Optimization, Model Optimization
PMetal: high-performance Apple Silicon framework for local LLM inference, LoRA/QLoRA fine-tuning, serving…
+3 (+0.9%) in 30d · Committed 19d ago · Rust · Other license
Shares Local Runtime / Inference Engine, Model Optimization, Inference Optimization
Get more intelligence from every bit. Better quantization formats and smarter calibration let larger, stronger…
+9 (+10%) in 30d · Committed 16d ago · C++ · Apache-2.0
Shares Inference Optimization, Model Optimization, Local Runtime / Inference Engine
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS…
+3.4k (+37%) in 30d · Committed 5d ago · C · Apache-2.0
Shares Local Runtime / Inference Engine, Inference Optimization, Model Optimization
2bit quants, kernels and runtime for consumer devices.
Committed 16d ago · C++ · Other license
Shares Local Runtime / Inference Engine, Inference Optimization, Model Optimization
- syv-ai/HyperQwen2.8k
Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127…
+592 (+27%) in 30d · Committed 12d ago · Python · Apache-2.0
Shares Inference Optimization, Local Runtime / Inference Engine, Model Optimization
- RWKV/rwkv.cpp1.6k
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
+1 (+0.1%) in 30d · Committed 609d ago · C++ · MIT
Shares Local Runtime / Inference Engine, Inference Optimization, Model Optimization
Suno AI's Bark model in C/C++ for fast text-to-speech generation
+0 (+0.0%) in 30d · Committed 735d ago · C++ · MIT
Shares Local Runtime / Inference Engine, Inference Optimization, Model Optimization
- Language
- Python
- License
- MIT License
- Contributors
- 1
- Forks
- 0
- Watchers
- 0
- Open issues
- 0
- Releases
- 1
- Created
- 2026-06-05
- Stars this week
- +0
You've seen where local-llm-lab stands today.
Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.