local-llm-lab

Honest local LLM deployment planning and benchmarking for high unified-memory Macs and future Linux/NVIDIA rigs.

duongngocbinh56599-ui/local-llm-lab

View on GitHub ↗

Honest local LLM deployment planning and benchmarking for high unified-memory Macs and future Linux/NVIDIA rigs.

local-llm-lab grew -1.1% in the last 30 days, ranks 483rd of 539 in Local Runtime / Inference Engine, last commit 64 days ago.

Star trajectory

61 days tracked
2026-09-2193 stars today2026-11-22
Momentum

-1.1% in 30d, below the Local Runtime / Inference Engine median of +1.9%.

Maintenance

Last commit 64 days ago, staler than the median of 6d.

How it compares in Local Runtime / Inference Engine

local-llm-lab
93
stars
-1.1% 30d
commit 64 days ago
Local Runtime / Inference Engine median
360
stars
+1.9% 30d
commit ~6d ago
Leader · ollama
187.8k
stars
+1.9% 30d
commit today

Ranked 483rd of 539 by stars.

Ranked by shared tags, then keywords, then stars
  1. The inference engine the open-source world built for itself.

    +6 (+2.5%) in 30d · Committed 56d ago · Python

    Shares Local Runtime / Inference Engine, Inference Optimization, Model Optimization

  2. Practical local LLM recipes and benchmarks for RTX 5060 Ti setups

    +21 (+11%) in 30d · Committed 44d ago · Python · MIT

    Shares Local Runtime / Inference Engine, Inference Optimization, Model Optimization

  3. Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM…

    +8 (+1.5%) in 30d · Committed 10d ago · C++ · Other license

    Shares Local Runtime / Inference Engine, Inference Optimization, Model Optimization

  4. PMetal: high-performance Apple Silicon framework for local LLM inference, LoRA/QLoRA fine-tuning, serving…

    +3 (+0.9%) in 30d · Committed 19d ago · Rust · Other license

    Shares Local Runtime / Inference Engine, Model Optimization, Inference Optimization

  5. Get more intelligence from every bit. Better quantization formats and smarter calibration let larger, stronger…

    +9 (+10%) in 30d · Committed 16d ago · C++ · Apache-2.0

    Shares Inference Optimization, Model Optimization, Local Runtime / Inference Engine

  6. A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS…

    +3.4k (+37%) in 30d · Committed 5d ago · C · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization, Model Optimization

  7. 2bit quants, kernels and runtime for consumer devices.

    Committed 16d ago · C++ · Other license

    Shares Local Runtime / Inference Engine, Inference Optimization, Model Optimization

  8. Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127…

    +592 (+27%) in 30d · Committed 12d ago · Python · Apache-2.0

    Shares Inference Optimization, Local Runtime / Inference Engine, Model Optimization

  9. INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

    +1 (+0.1%) in 30d · Committed 609d ago · C++ · MIT

    Shares Local Runtime / Inference Engine, Inference Optimization, Model Optimization

  10. Suno AI's Bark model in C/C++ for fast text-to-speech generation

    +0 (+0.0%) in 30d · Committed 735d ago · C++ · MIT

    Shares Local Runtime / Inference Engine, Inference Optimization, Model Optimization

Language
Python
License
MIT License
Contributors
1
Forks
0
Watchers
0
Open issues
0
Releases
1
Created
2026-06-05
Stars this week
+0

You've seen where local-llm-lab stands today.

Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain local-llm-lab?

Claim this page to add your own call-to-action.

Claim this page