slotstream
Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.
carloslfu/slotstream
View on GitHub ↗Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.
slotstream grew +40.1% in the last 30 days, ranks 60th of 177 in Web / Edge / On-Device Runtime, actively maintained, last commit 4 days ago.
Star trajectory
79 days tracked+40.1% in 30d, above the Web / Edge / On-Device Runtime median of +1.8%.
Last commit 4 days ago, fresher than the median of 6d.
How it compares in Web / Edge / On-Device Runtime
Ranked 60th of 177 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere slotstream sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
The local AI app built for the Mac. Run LLMs like Qwen, Gemma and GPT-OSS on Apple Silicon, including models…
+17 (+28%) in 30d · Committed today · Swift · Apache-2.0
Shares Local Runtime / Inference Engine, Inference Optimization, Web / Edge / On-Device Runtime
Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook
+442 (+6.3%) in 30d · Committed 7d ago · Swift · Apache-2.0
Shares Web / Edge / On-Device Runtime, Inference Optimization, Local Runtime / Inference Engine
Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp…
+425 (+65%) in 30d · Committed today · C++ · Apache-2.0
Shares Web / Edge / On-Device Runtime, Inference Optimization, Local Runtime / Inference Engine
Run full Kimi K3 on a single device. And an OpenAI-compatible API server for local chat and coding agents.
+15 (+1.8%) in 30d · Committed 49d ago · Rust · Other license
Shares Local Runtime / Inference Engine, Inference Optimization, Web / Edge / On-Device Runtime
Swiftlet is a Swift and Metal runtime that runs large Qwen Mixture-of-Experts models locally on Apple devices…
+5 (+0.8%) in 30d · Committed 4d ago · Swift · Apache-2.0
Shares Local Runtime / Inference Engine, Web / Edge / On-Device Runtime, Inference Optimization
Open-source local AI workspace — advancing on-device inference.
-6 (-1.5%) in 30d · Committed 34d ago · TypeScript · Apache-2.0
Shares Local Runtime / Inference Engine, Web / Edge / On-Device Runtime, Inference Optimization
Run MoE models beyond VRAM on AMD, NVIDIA & Intel GPUs. Vulkan-powered, portable Windows app with automatic…
+46 (+14%) in 30d · Committed yesterday · Rust · Apache-2.0
Shares Inference Optimization, Local Runtime / Inference Engine, Web / Edge / On-Device Runtime
DeepSeek-V4-Flash-0731 284B inference in ~25 GB of RAM / Qwen3.8-Next-Flash inference in ~15 GB of RAM on any…
+3 (+2.0%) in 30d · Committed 25d ago · Python · MIT
Shares Local Runtime / Inference Engine, Inference Optimization, Web / Edge / On-Device Runtime
Private AI that runs entirely on your Mac: a native SwiftUI app on its own Swift + Metal inference engine…
+1 (+0.8%) in 30d · Committed yesterday · C++ · Other license
Shares Web / Edge / On-Device Runtime, Local Runtime / Inference Engine, Inference Optimization
2bit quants, kernels and runtime for consumer devices.
Committed 16d ago · C++ · Other license
Shares Local Runtime / Inference Engine, Web / Edge / On-Device Runtime, Inference Optimization
- Language
- Swift
- License
- MIT License
- Contributors
- 8
- Forks
- 54
- Watchers
- 4
- Open issues
- 2
- Releases
- 38
- Created
- 2026-08-28
- Stars this week
- +1
You've seen where slotstream stands today.
Get the moves before everyone else: the 5 Web / Edge / On-Device Runtime repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.