gglib

The local model runtime that makes llama.cpp behave like an API provider.

The local model runtime that makes llama.cpp behave like an API provider.

gglib ranks 537th of 539 in Local Runtime / Inference Engine, actively maintained, last commit today.

Star trajectory

22 days tracked
2026-10-311 stars today2026-11-22
Momentum

- in 30d, below the Local Runtime / Inference Engine median of +1.9%.

Maintenance

Last commit today, fresher than the median of 6d.

How it compares in Local Runtime / Inference Engine

gglib
1
stars
- 30d
commit today
Local Runtime / Inference Engine median
360
stars
+1.9% 30d
commit ~6d ago
Leader · ollama
187.8k
stars
+1.9% 30d
commit today

Ranked 537th of 539 by stars.

Ranked by shared tags, then keywords, then stars
  1. A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console…

    Committed today · C# · BSD-3-Clause

    Shares Local Runtime / Inference Engine, Inference Optimization, Agent Frontends / Chat UI

  2. Open-source control panel for the real llama.cpp: see where a model lands in your VRAM before loading, every…

    +18 (+16%) in 30d · Committed 16d ago · Python · MIT

    Shares Local Runtime / Inference Engine, Inference Optimization, Agent Frontends / Chat UI

  3. Alzeo is an open-source installer that turns an NVIDIA DGX Spark, or any GB10 machine (ASUS, Dell, HP, Lenovo…

    +36 (+15%) in 30d · Committed 2d ago · Python · MIT

    Shares Local Runtime / Inference Engine, LLM Gateway & Routing, Inference Optimization

  4. Run AI models like Llama, Qwen, and Gemma on every computer you own, and manage them for everyone on your…

    Committed today · Go · AGPL-3.0

    Shares Local Runtime / Inference Engine, LLM Gateway & Routing, Agent Frontends / Chat UI

  5. Streamline your workflow with Lynkr, a CLI tool that acts as an HTTP proxy for efficient code interactions…

    +4 (+0.6%) in 30d · Committed 7d ago · JavaScript · Apache-2.0

    Shares LLM Gateway & Routing, Local Runtime / Inference Engine, Inference Optimization

  6. Deploy a self-hosted AI stack with Docker Compose: local LLMs, chat, document parsing, embeddings…

    +11 (+6.5%) in 30d · Committed 4d ago · Shell · MIT

    Shares Local Runtime / Inference Engine, LLM Gateway & Routing, Agent Frontends / Chat UI

  7. The set-and-forget LLM engine for Pascal and Volta: PXQ codec + kernels, auto-tuned per card. Ready-to-run PXQ…

    +39 (+45%) in 30d · Committed today · C++ · MIT

    Shares Local Runtime / Inference Engine, Inference Optimization, Agent Frontends / Chat UI

  8. The fastest inference engine for Qwen3.8-27B on the NVIDIA RTX 5090: up to 500 tokens/s for one agent and up…

    Committed 17d ago · MIT

    Shares Local Runtime / Inference Engine, Inference Optimization, LLM Gateway & Routing

  9. The local AI app built for the Mac. Run LLMs like Qwen, Gemma and GPT-OSS on Apple Silicon, including models…

    +17 (+28%) in 30d · Committed today · Swift · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization, Agent Frontends / Chat UI

  10. LLM Inference Engine for Metal, CUDA and Vulkan.

    +916 (+63%) in 30d · Committed today · Zig · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization, LLM Gateway & Routing

Language
Rust
License
GNU Affero General Public License v3.0
Contributors
6
Forks
0
Watchers
0
Open issues
29
Releases
170
Created
2025-12-21
Stars this week
+0

You've seen where gglib stands today.

Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain gglib?

Claim this page to add your own call-to-action.

Claim this page