slotstream

Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.

carloslfu/slotstream

View on GitHub ↗

Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.

slotstream grew +40.1% in the last 30 days, ranks 60th of 177 in Web / Edge / On-Device Runtime, actively maintained, last commit 4 days ago.

Star trajectory

79 days tracked
2026-09-03674 stars today2026-11-22
Momentum

+40.1% in 30d, above the Web / Edge / On-Device Runtime median of +1.8%.

Maintenance

Last commit 4 days ago, fresher than the median of 6d.

How it compares in Web / Edge / On-Device Runtime

slotstream
674
stars
+40.1% 30d
commit 4 days ago
Web / Edge / On-Device Runtime median
311
stars
+1.8% 30d
commit ~6d ago
Leader · mlc-llm
23.4k
stars
+0.8% 30d
commit today

Ranked 60th of 177 by stars.

Ranked by shared tags, then keywords, then stars
  1. The local AI app built for the Mac. Run LLMs like Qwen, Gemma and GPT-OSS on Apple Silicon, including models…

    +17 (+28%) in 30d · Committed today · Swift · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization, Web / Edge / On-Device Runtime

  2. Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

    +442 (+6.3%) in 30d · Committed 7d ago · Swift · Apache-2.0

    Shares Web / Edge / On-Device Runtime, Inference Optimization, Local Runtime / Inference Engine

  3. Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp…

    +425 (+65%) in 30d · Committed today · C++ · Apache-2.0

    Shares Web / Edge / On-Device Runtime, Inference Optimization, Local Runtime / Inference Engine

  4. Run full Kimi K3 on a single device. And an OpenAI-compatible API server for local chat and coding agents.

    +15 (+1.8%) in 30d · Committed 49d ago · Rust · Other license

    Shares Local Runtime / Inference Engine, Inference Optimization, Web / Edge / On-Device Runtime

  5. Swiftlet is a Swift and Metal runtime that runs large Qwen Mixture-of-Experts models locally on Apple devices…

    +5 (+0.8%) in 30d · Committed 4d ago · Swift · Apache-2.0

    Shares Local Runtime / Inference Engine, Web / Edge / On-Device Runtime, Inference Optimization

  6. Open-source local AI workspace — advancing on-device inference.

    -6 (-1.5%) in 30d · Committed 34d ago · TypeScript · Apache-2.0

    Shares Local Runtime / Inference Engine, Web / Edge / On-Device Runtime, Inference Optimization

  7. Run MoE models beyond VRAM on AMD, NVIDIA & Intel GPUs. Vulkan-powered, portable Windows app with automatic…

    +46 (+14%) in 30d · Committed yesterday · Rust · Apache-2.0

    Shares Inference Optimization, Local Runtime / Inference Engine, Web / Edge / On-Device Runtime

  8. DeepSeek-V4-Flash-0731 284B inference in ~25 GB of RAM / Qwen3.8-Next-Flash inference in ~15 GB of RAM on any…

    +3 (+2.0%) in 30d · Committed 25d ago · Python · MIT

    Shares Local Runtime / Inference Engine, Inference Optimization, Web / Edge / On-Device Runtime

  9. Private AI that runs entirely on your Mac: a native SwiftUI app on its own Swift + Metal inference engine…

    +1 (+0.8%) in 30d · Committed yesterday · C++ · Other license

    Shares Web / Edge / On-Device Runtime, Local Runtime / Inference Engine, Inference Optimization

  10. 2bit quants, kernels and runtime for consumer devices.

    Committed 16d ago · C++ · Other license

    Shares Local Runtime / Inference Engine, Web / Edge / On-Device Runtime, Inference Optimization

Language
Swift
License
MIT License
Contributors
8
Forks
54
Watchers
4
Open issues
2
Releases
38
Created
2026-08-28
Stars this week
+1

You've seen where slotstream stands today.

Get the moves before everyone else: the 5 Web / Edge / On-Device Runtime repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain slotstream?

Claim this page to add your own call-to-action.

Claim this page