ds4-on-spark
Entrpi/ds4, a Blackwell CUDA perf fork of antirez/ds4 on NVIDIA DGX Spark: one-command install, ~3x upstream prefill, ~1.5x decode, DSpark, and full continuous batch support
Entrpi/ds4-on-spark
View on GitHub ↗Entrpi/ds4, a Blackwell CUDA perf fork of antirez/ds4 on NVIDIA DGX Spark: one-command install, ~3x upstream prefill, ~1.5x decode, DSpark, and full continuous batch support
ds4-on-spark grew +1.5% in the last 30 days, ranks 257th of 539 in Local Runtime / Inference Engine, last commit 87 days ago.
Star trajectory
82 days tracked+1.5% in 30d, below the Local Runtime / Inference Engine median of +1.9%.
Last commit 87 days ago, staler than the median of 6d.
How it compares in Local Runtime / Inference Engine
Ranked 257th of 539 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere ds4-on-spark sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
SSD-streaming inference engine for giant MoE models (Rust + CUDA). GLM 5.2 743B at 2 tok/s and Hy3 295B at 7…
+9 (+3.9%) in 30d · Committed 81d ago · Rust · Other license
Shares Local Runtime / Inference Engine, Inference Optimization, Distributed Inference
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
+25 (+3.5%) in 30d · Committed yesterday · Rust · Apache-2.0
Shares Inference Optimization, Distributed Inference, Local Runtime / Inference Engine
RapidLLM is an LLM inference framework with continuous batching, tensor and data parallelism, quantized…
+3 (+1.5%) in 30d · Committed 43d ago · Python
Shares Local Runtime / Inference Engine, Inference Optimization, Distributed Inference
Production-grade recipe for DeepSeek-V4-Flash-0731 (284B MoE) on 2x NVIDIA DGX Spark: self-healing 2-node vLLM…
-3 (-1.7%) in 30d · Committed 100d ago · Shell · MIT
Shares Distributed Inference, Inference Optimization, Local Runtime / Inference Engine
- ahtx/kindi198
Kindi 0.6.1: fast local LLM inference on low-cost GPUs and CPUs. DeepSeek-V4.1-Flash (552B) at 18.7 tok/s on…
Committed 5d ago · Python · AGPL-3.0
Shares Local Runtime / Inference Engine, Distributed Inference, Inference Optimization
An agentic system that auto-optimizes LLM workloads on AMD GPUs.
+33 (+13%) in 30d · Committed today · Python · Other license
Shares Inference Optimization, Distributed Inference, Local Runtime / Inference Engine
Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM…
+8 (+1.5%) in 30d · Committed 10d ago · C++ · Other license
Shares Local Runtime / Inference Engine, Inference Optimization
DeepSeek-V4.1-Flash-1017 on NVIDIA DGX Sparks with TensorFold + EXL3: TP4 (4 Sparks, 93.6 tok/s, 1M context)…
+27 (+19%) in 30d · Committed 26d ago · Python · MIT
Shares Distributed Inference, Inference Optimization
Open Source AI Accelerator Research Platform Standard / 开源推理研究平台
+170 (+8.9%) in 30d · Committed today · Python · Apache-2.0
Shares Inference Optimization, Distributed Inference
- xLLM-AI/xllm1.6k
A high-performance inference engine for LLM, VLM and DiT models, optimized for diverse AI accelerators. It is…
+23 (+1.4%) in 30d · Committed today · C++ · Apache-2.0
Shares Local Runtime / Inference Engine, Inference Optimization
- Language
- Shell
- License
- MIT License
- Contributors
- 1
- Forks
- 31
- Watchers
- 12
- Open issues
- 7
- Releases
- 0
- Created
- 2026-05-12
- Stars this week
- +1
You've seen where ds4-on-spark stands today.
Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.