splash

A local inference engine for Apple silicon, built around the model.

incoai/splash

View on GitHub ↗

A local inference engine for Apple silicon, built around the model.

splash grew +49.9% in the last 30 days, ranks 78th of 539 in Local Runtime / Inference Engine, actively maintained, last commit 4 days ago.

Star trajectory

61 days tracked
2026-09-212.6k stars today2026-11-22
Momentum

+49.9% in 30d, above the Local Runtime / Inference Engine median of +1.9%.

Maintenance

Last commit 4 days ago, fresher than the median of 6d.

How it compares in Local Runtime / Inference Engine

splash
2.6k
stars
+49.9% 30d
commit 4 days ago
Local Runtime / Inference Engine median
360
stars
+1.9% 30d
commit ~6d ago
Leader · ollama
187.8k
stars
+1.9% 30d
commit today

Ranked 78th of 539 by stars.

Ranked by shared tags, then keywords, then stars
  1. The fastest way to run Inkling 2 Mini, Qwen 3.8 and Ternary Bonsai 2 27B on a Mac: Inkling 2 Mini at up to…

    +107 (+4.1%) in 30d · Committed today · Python · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization

  2. Up to 4× faster LLM decoding on Apple Silicon, lossless. Native MLX port of DeepSeek's DSpark & z-lab's DFlash…

    +18 (+2.5%) in 30d · Committed 13d ago · Python · MIT

    Shares Inference Optimization, Local Runtime / Inference Engine

  3. lithos-metal: high-performance LLM inference kernels and serving for Apple silicon.

    +43 (+14%) in 30d · Committed 31d ago · Python · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization

  4. Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

    +442 (+6.3%) in 30d · Committed 7d ago · Swift · Apache-2.0

    Shares Inference Optimization, Local Runtime / Inference Engine

  5. Lucebox inference engine for heterogeneous hardware & consumer GPUs

    +76 (+2.6%) in 30d · Committed today · C++ · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization

  6. Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127…

    +592 (+27%) in 30d · Committed 12d ago · Python · Apache-2.0

    Shares Inference Optimization, Local Runtime / Inference Engine

  7. Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend…

    +504 (+25%) in 30d · Committed today · Zig · Other license

    Shares Local Runtime / Inference Engine, Inference Optimization

  8. LLM Inference Engine for Metal, CUDA and Vulkan.

    +916 (+63%) in 30d · Committed today · Zig · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization

  9. Community maintained hardware plugin for vLLM on Apple Silicon

    +109 (+5.7%) in 30d · Committed today · Python · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization

  10. Local inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models…

    +341 (+32%) in 30d · Committed 3d ago · Shell · Other license

    Shares Local Runtime / Inference Engine, Inference Optimization

Language
C++
License
Apache License 2.0
Contributors
28
Forks
250
Watchers
23
Open issues
93
Releases
15
Created
2026-09-18
Stars this week
+325

You've seen where splash stands today.

Get the moves before everyone else: the 5 Local Runtime / Inference Engine repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain splash?

Claim this page to add your own call-to-action.

Claim this page