gglib
The local model runtime that makes llama.cpp behave like an API provider.
mmogr/gglib
View on GitHub ↗The local model runtime that makes llama.cpp behave like an API provider.
gglib ranks 537th of 539 in Local Runtime / Inference Engine, actively maintained, last commit today.
Star trajectory
22 days tracked- in 30d, below the Local Runtime / Inference Engine median of +1.9%.
Last commit today, fresher than the median of 6d.
How it compares in Local Runtime / Inference Engine
Ranked 537th of 539 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere gglib sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console…
Committed today · C# · BSD-3-Clause
Shares Local Runtime / Inference Engine, Inference Optimization, Agent Frontends / Chat UI
Open-source control panel for the real llama.cpp: see where a model lands in your VRAM before loading, every…
+18 (+16%) in 30d · Committed 16d ago · Python · MIT
Shares Local Runtime / Inference Engine, Inference Optimization, Agent Frontends / Chat UI
Alzeo is an open-source installer that turns an NVIDIA DGX Spark, or any GB10 machine (ASUS, Dell, HP, Lenovo…
+36 (+15%) in 30d · Committed 2d ago · Python · MIT
Shares Local Runtime / Inference Engine, LLM Gateway & Routing, Inference Optimization
Run AI models like Llama, Qwen, and Gemma on every computer you own, and manage them for everyone on your…
Committed today · Go · AGPL-3.0
Shares Local Runtime / Inference Engine, LLM Gateway & Routing, Agent Frontends / Chat UI
Streamline your workflow with Lynkr, a CLI tool that acts as an HTTP proxy for efficient code interactions…
+4 (+0.6%) in 30d · Committed 7d ago · JavaScript · Apache-2.0
Shares LLM Gateway & Routing, Local Runtime / Inference Engine, Inference Optimization
Deploy a self-hosted AI stack with Docker Compose: local LLMs, chat, document parsing, embeddings…
+11 (+6.5%) in 30d · Committed 4d ago · Shell · MIT
Shares Local Runtime / Inference Engine, LLM Gateway & Routing, Agent Frontends / Chat UI
The set-and-forget LLM engine for Pascal and Volta: PXQ codec + kernels, auto-tuned per card. Ready-to-run PXQ…
+39 (+45%) in 30d · Committed today · C++ · MIT
Shares Local Runtime / Inference Engine, Inference Optimization, Agent Frontends / Chat UI
The fastest inference engine for Qwen3.8-27B on the NVIDIA RTX 5090: up to 500 tokens/s for one agent and up…
Committed 17d ago · MIT
Shares Local Runtime / Inference Engine, Inference Optimization, LLM Gateway & Routing
The local AI app built for the Mac. Run LLMs like Qwen, Gemma and GPT-OSS on Apple Silicon, including models…
+17 (+28%) in 30d · Committed today · Swift · Apache-2.0
Shares Local Runtime / Inference Engine, Inference Optimization, Agent Frontends / Chat UI
LLM Inference Engine for Metal, CUDA and Vulkan.
+916 (+63%) in 30d · Committed today · Zig · Apache-2.0
Shares Local Runtime / Inference Engine, Inference Optimization, LLM Gateway & Routing
- Language
- Rust
- License
- GNU Affero General Public License v3.0
- Contributors
- 6
- Forks
- 0
- Watchers
- 0
- Open issues
- 29
- Releases
- 170
- Created
- 2025-12-21
- Stars this week
- +0
You've seen where gglib stands today.
Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.