ds4-on-spark

Entrpi/ds4, a Blackwell CUDA perf fork of antirez/ds4 on NVIDIA DGX Spark: one-command install, ~3x upstream prefill, ~1.5x decode, DSpark, and full continuous batch support

Entrpi/ds4-on-spark

View on GitHub ↗

Entrpi/ds4, a Blackwell CUDA perf fork of antirez/ds4 on NVIDIA DGX Spark: one-command install, ~3x upstream prefill, ~1.5x decode, DSpark, and full continuous batch support

ds4-on-spark grew +1.5% in the last 30 days, ranks 257th of 539 in Local Runtime / Inference Engine, last commit 87 days ago.

Star trajectory

82 days tracked
2026-08-31416 stars today2026-11-22
Momentum

+1.5% in 30d, below the Local Runtime / Inference Engine median of +1.9%.

Maintenance

Last commit 87 days ago, staler than the median of 6d.

How it compares in Local Runtime / Inference Engine

ds4-on-spark
416
stars
+1.5% 30d
commit 87 days ago
Local Runtime / Inference Engine median
360
stars
+1.9% 30d
commit ~6d ago
Leader · ollama
187.8k
stars
+1.9% 30d
commit today

Ranked 257th of 539 by stars.

Ranked by shared tags, then keywords, then stars
  1. SSD-streaming inference engine for giant MoE models (Rust + CUDA). GLM 5.2 743B at 2 tok/s and Hy3 295B at 7…

    +9 (+3.9%) in 30d · Committed 81d ago · Rust · Other license

    Shares Local Runtime / Inference Engine, Inference Optimization, Distributed Inference

  2. Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

    +25 (+3.5%) in 30d · Committed yesterday · Rust · Apache-2.0

    Shares Inference Optimization, Distributed Inference, Local Runtime / Inference Engine

  3. RapidLLM is an LLM inference framework with continuous batching, tensor and data parallelism, quantized…

    +3 (+1.5%) in 30d · Committed 43d ago · Python

    Shares Local Runtime / Inference Engine, Inference Optimization, Distributed Inference

  4. Production-grade recipe for DeepSeek-V4-Flash-0731 (284B MoE) on 2x NVIDIA DGX Spark: self-healing 2-node vLLM…

    -3 (-1.7%) in 30d · Committed 100d ago · Shell · MIT

    Shares Distributed Inference, Inference Optimization, Local Runtime / Inference Engine

  5. Kindi 0.6.1: fast local LLM inference on low-cost GPUs and CPUs. DeepSeek-V4.1-Flash (552B) at 18.7 tok/s on…

    Committed 5d ago · Python · AGPL-3.0

    Shares Local Runtime / Inference Engine, Distributed Inference, Inference Optimization

  6. An agentic system that auto-optimizes LLM workloads on AMD GPUs.

    +33 (+13%) in 30d · Committed today · Python · Other license

    Shares Inference Optimization, Distributed Inference, Local Runtime / Inference Engine

  7. Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM…

    +8 (+1.5%) in 30d · Committed 10d ago · C++ · Other license

    Shares Local Runtime / Inference Engine, Inference Optimization

  8. DeepSeek-V4.1-Flash-1017 on NVIDIA DGX Sparks with TensorFold + EXL3: TP4 (4 Sparks, 93.6 tok/s, 1M context)…

    +27 (+19%) in 30d · Committed 26d ago · Python · MIT

    Shares Distributed Inference, Inference Optimization

  9. Open Source AI Accelerator Research Platform Standard / 开源推理研究平台

    +170 (+8.9%) in 30d · Committed today · Python · Apache-2.0

    Shares Inference Optimization, Distributed Inference

  10. A high-performance inference engine for LLM, VLM and DiT models, optimized for diverse AI accelerators. It is…

    +23 (+1.4%) in 30d · Committed today · C++ · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization

Language
Shell
License
MIT License
Contributors
1
Forks
31
Watchers
12
Open issues
7
Releases
0
Created
2026-05-12
Stars this week
+1

You've seen where ds4-on-spark stands today.

Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain ds4-on-spark?

Claim this page to add your own call-to-action.

Claim this page