LlamaForge

Open-source control panel for the real llama.cpp: see where a model lands in your VRAM before loading, every llama-server flag per model, one-click llama.cpp updates, several models at once, and Embers (local agents whose quotes are checked by code). Windows · Linux · macOS.

dadwritestech/LlamaForge

View on GitHub ↗

Open-source control panel for the real llama.cpp: see where a model lands in your VRAM before loading, every llama-server flag per model, one-click llama.cpp updates, several models at once, and Embers (local agents whose quotes are checked by code). Windows · Linux · macOS.

LlamaForge grew +16.4% in the last 30 days, ranks 437th of 539 in Local Runtime / Inference Engine, last commit 16 days ago.

Star trajectory

49 days tracked
2026-10-04128 stars today2026-11-22
Momentum

+16.4% in 30d, above the Local Runtime / Inference Engine median of +1.9%.

Maintenance

Last commit 16 days ago, staler than the median of 6d.

How it compares in Local Runtime / Inference Engine

LlamaForge
128
stars
+16.4% 30d
commit 16 days ago
Local Runtime / Inference Engine median
360
stars
+1.9% 30d
commit ~6d ago
Leader · ollama
187.8k
stars
+1.9% 30d
commit today

Ranked 437th of 539 by stars.

Ranked by shared tags, then keywords, then stars
  1. A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console…

    Committed today · C# · BSD-3-Clause

    Shares Local Runtime / Inference Engine, Inference Optimization, Agent Frontends / Chat UI

  2. The local model runtime that makes llama.cpp behave like an API provider.

    Committed today · Rust · AGPL-3.0

    Shares Local Runtime / Inference Engine, Inference Optimization, Agent Frontends / Chat UI

  3. The set-and-forget LLM engine for Pascal and Volta: PXQ codec + kernels, auto-tuned per card. Ready-to-run PXQ…

    +39 (+45%) in 30d · Committed today · C++ · MIT

    Shares Local Runtime / Inference Engine, Inference Optimization, Agent Frontends / Chat UI

  4. The local AI app built for the Mac. Run LLMs like Qwen, Gemma and GPT-OSS on Apple Silicon, including models…

    +17 (+28%) in 30d · Committed today · Swift · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization, Agent Frontends / Chat UI

  5. Zero-GPU CPU inference for 30B-284B MoE models (Qwen3.8 176.5B cold-cache certified in 28.26/48.35 GiB Cgroup…

    Committed today · Python · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization

  6. Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4…

    +962 (+243%) in 30d · Committed 3d ago · C++ · MIT

    Shares Local Runtime / Inference Engine, Inference Optimization

  7. llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.

    +2 (+0.7%) in 30d · Committed 2d ago · Go · MIT

    Shares Local Runtime / Inference Engine, Inference Optimization

  8. Bonsai 2 27B: 262k context (trained max) on 12 GB, 54 to 97 tok/s decode, 2x prefill, q8_0 KV recipe, grammar…

    Committed yesterday · Python · Other license

    Shares Local Runtime / Inference Engine, Inference Optimization

  9. Local inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models…

    +341 (+32%) in 30d · Committed 3d ago · Shell · Other license

    Shares Local Runtime / Inference Engine, Inference Optimization

  10. Xolotl: run DeepSeek-V4.1-Flash, all 552B, as a local coding agent on one gaming PC (RTX 4090 + 110 GB RAM)…

    +264 (+90%) in 30d · Committed today · C++ · MIT

    Shares Local Runtime / Inference Engine, Inference Optimization

Language
Python
License
MIT License
Contributors
3
Forks
18
Watchers
0
Open issues
4
Releases
62
Created
2026-07-06
Stars this week
+4

You've seen where LlamaForge stands today.

Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain LlamaForge?

Claim this page to add your own call-to-action.

Claim this page