sparkinfer
Fastest MoE/LLM inference runtime for consumer and edge Blackwell GPUs. SN74 on Gittensor.
gittensor-ai-lab/sparkinfer
View on GitHub ↗Fastest MoE/LLM inference runtime for consumer and edge Blackwell GPUs. SN74 on Gittensor.
sparkinfer grew +5.7% in the last 30 days, ranks 300th of 343 in Inference Optimization, last commit 41 days ago.
Star trajectory
71 days tracked+5.7% in 30d, above the Inference Optimization median of +1.6%.
Last commit 41 days ago, staler than the median of 16d.
How it compares in Inference Optimization
Ranked 300th of 343 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere sparkinfer sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
Run Mixtral-8x7B models in Colab or consumer desktops
-3 (-0.1%) in 30d · Committed 957d ago · Python · MIT
Shares Inference Optimization, Model Optimization, Web / Edge / On-Device Runtime
OrbitKV is a High Performance KV Cache System for LLM Inference.
-52 (-15%) in 30d · Committed yesterday · Rust · Apache-2.0
Shares Inference Optimization, Model Optimization, Web / Edge / On-Device Runtime
An inference chip design that runs a real LLM (Qwen2.5-0.5B) on FPGA — one transformer decoder layer in RTL…
-123 (-22%) in 30d · Committed 95d ago · Python · Apache-2.0
Shares Web / Edge / On-Device Runtime, Inference Optimization, Model Optimization
On-device LLM Inference Powered by X-Bit Quantization
+0 (+0.0%) in 30d · Committed 9d ago · Python · Apache-2.0
Shares Web / Edge / On-Device Runtime, Inference Optimization, Model Optimization
Flash weight streaming for MLX: run massive models larger than your RAM on Apple Silicon.
+5 (+3.6%) in 30d · Committed 162d ago · Python · MIT
Shares Inference Optimization, Web / Edge / On-Device Runtime, Model Optimization
2bit quants, kernels and runtime for consumer devices.
Committed 16d ago · C++ · Other license
Shares Web / Edge / On-Device Runtime, Inference Optimization, Model Optimization
Run a 1-billion parameter LLM on a $10 board with 256MB RAM
+6 (+0.3%) in 30d · Committed 272d ago · C · MIT
Shares Web / Edge / On-Device Runtime, Inference Optimization, Model Optimization
Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache…
+2 (+0.6%) in 30d · Committed 549d ago · Python · Other license
Shares Inference Optimization, Model Optimization, Web / Edge / On-Device Runtime
RDNA-native LLM inference engine in Rust.
+95 (+13%) in 30d · Committed today · Rust · Other license
Shares Inference Optimization, Model Optimization
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
+25 (+3.5%) in 30d · Committed yesterday · Rust · Apache-2.0
Shares Inference Optimization, Model Optimization
- Language
- C++
- License
- MIT License
- Contributors
- 42
- Forks
- 82
- Watchers
- 0
- Open issues
- 4
- Releases
- 60
- Created
- 2026-06-22
- Stars this week
- +0
You've seen where sparkinfer stands today.
Get the moves before everyone else: the 5 Inference Optimization repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.