ignis
An inference engine for NVIDIA RTX card card family, built for a coding agent and its subagents, and a companion that listens, reads and draws: Qwen3.8 27B and 125B Flash-Next MoE, Qwen-Image-2.1, Qwen3-ASR on the CPU. OpenAI-compatible API and Playground in one binary.
gpillon/ignis
View on GitHub ↗An inference engine for NVIDIA RTX card card family, built for a coding agent and its subagents, and a companion that listens, reads and draws: Qwen3.8 27B and 125B Flash-Next MoE, Qwen-Image-2.1, Qwen3-ASR on the CPU. OpenAI-compatible API and Playground in one binary.
ignis ranks 505th of 539 in Local Runtime / Inference Engine, actively maintained, last commit today.
Star trajectory
18 days tracked- in 30d, below the Local Runtime / Inference Engine median of +1.9%.
Last commit today, fresher than the median of 6d.
How it compares in Local Runtime / Inference Engine
Ranked 505th of 539 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere ignis sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4…
+962 (+243%) in 30d · Committed 3d ago · C++ · MIT
Shares Local Runtime / Inference Engine, Inference Optimization, Production Serving & Deployment
Xolotl: run DeepSeek-V4.1-Flash, all 552B, as a local coding agent on one gaming PC (RTX 4090 + 110 GB RAM)…
+264 (+90%) in 30d · Committed today · C++ · MIT
Shares Local Runtime / Inference Engine, Production Serving & Deployment, Inference Optimization
Alzeo is an open-source installer that turns an NVIDIA DGX Spark, or any GB10 machine (ASUS, Dell, HP, Lenovo…
+36 (+15%) in 30d · Committed 2d ago · Python · MIT
Shares Production Serving & Deployment, Local Runtime / Inference Engine, Inference Optimization
run a 27b local ai on your gaming gpu, rtx 3060 and up, radeon rx 6600 and up in beta, 8gb or more, linux and…
+31 (+19%) in 30d · Committed 35d ago · Python
Shares Local Runtime / Inference Engine, Production Serving & Deployment, Inference Optimization
Run GLM-5.3 (744B), DeepSeek-V4.1-Flash (748B), MiniMax-M3.1-Flash (428B), GLM-5.3-Flash (321B) and Hy4-Flash…
+1.6k (+108%) in 30d · Committed today · Cuda · MIT
Shares Local Runtime / Inference Engine, Production Serving & Deployment, Inference Optimization
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
+25 (+3.5%) in 30d · Committed yesterday · Rust · Apache-2.0
Shares Production Serving & Deployment, Inference Optimization, Local Runtime / Inference Engine
A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console…
Committed today · C# · BSD-3-Clause
Shares Local Runtime / Inference Engine, Production Serving & Deployment, Inference Optimization
Pure-Rust LLM inference engine for GGUF (Qwen, DeepSeek, GLM, Hy4, Flint). Runs models bigger than your VRAM…
Committed today · Rust · Other license
Shares Local Runtime / Inference Engine, Production Serving & Deployment, Inference Optimization
llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.
+2 (+0.7%) in 30d · Committed 2d ago · Go · MIT
Shares Local Runtime / Inference Engine, Inference Optimization, Production Serving & Deployment
PROMETHEVS: run the full DeepSeek-V4.1-Flash-1017 (510 GB) on a gaming PC with 64 GB RAM and a 12 GB GPU…
Committed 12d ago · CC-BY-4.0
Shares Local Runtime / Inference Engine, Inference Optimization, Production Serving & Deployment
- Language
- Rust
- License
- Apache License 2.0
- Contributors
- 5
- Forks
- 9
- Watchers
- 1
- Open issues
- 98
- Releases
- 27
- Created
- 2026-09-01
- Stars this week
- +8
You've seen where ignis stands today.
Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.