MoE4All
Run MoE models beyond VRAM on AMD, NVIDIA & Intel GPUs. Vulkan-powered, portable Windows app with automatic setup. | 让游戏显卡跑起超显存大模型,支持 AMD、NVIDIA、Intel,免安装、自动配置。只需13MB,即下即用!
Headmaster218/MoE4All
View on GitHub ↗Run MoE models beyond VRAM on AMD, NVIDIA & Intel GPUs. Vulkan-powered, portable Windows app with automatic setup. | 让游戏显卡跑起超显存大模型,支持 AMD、NVIDIA、Intel,免安装、自动配置。只需13MB,即下即用!
MoE4All grew +14.1% in the last 30 days, ranks 129th of 343 in Inference Optimization, actively maintained, last commit yesterday.
Star trajectory
82 days tracked+14.1% in 30d, above the Inference Optimization median of +1.6%.
Last commit yesterday, fresher than the median of 16d.
How it compares in Inference Optimization
Ranked 129th of 343 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere MoE4All sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
Swiftlet is a Swift and Metal runtime that runs large Qwen Mixture-of-Experts models locally on Apple devices…
+5 (+0.8%) in 30d · Committed 4d ago · Swift · Apache-2.0
Shares Local Runtime / Inference Engine, Web / Edge / On-Device Runtime, Inference Optimization
Private AI that runs entirely on your Mac: a native SwiftUI app on its own Swift + Metal inference engine…
+1 (+0.8%) in 30d · Committed yesterday · C++ · Other license
Shares Web / Edge / On-Device Runtime, Local Runtime / Inference Engine, Inference Optimization
The local AI app built for the Mac. Run LLMs like Qwen, Gemma and GPT-OSS on Apple Silicon, including models…
+17 (+28%) in 30d · Committed today · Swift · Apache-2.0
Shares Local Runtime / Inference Engine, Inference Optimization, Web / Edge / On-Device Runtime
Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook
+442 (+6.3%) in 30d · Committed 7d ago · Swift · Apache-2.0
Shares Web / Edge / On-Device Runtime, Inference Optimization, Local Runtime / Inference Engine
- ROCm/FastFlowLM2.1k
Run LLMs on AMD Ryzen™ AI NPUs in minutes; purpose-built and deeply optimized for the AMD NPUs.
+97 (+4.9%) in 30d · Committed today · C++ · Other license
Shares Web / Edge / On-Device Runtime, Local Runtime / Inference Engine, Inference Optimization
Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp…
+425 (+65%) in 30d · Committed today · C++ · Apache-2.0
Shares Web / Edge / On-Device Runtime, Inference Optimization, Local Runtime / Inference Engine
Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB…
+193 (+40%) in 30d · Committed 4d ago · Swift · MIT
Shares Web / Edge / On-Device Runtime, Inference Optimization, Local Runtime / Inference Engine
CPU inference for the DeepSeek family of large language models in C++
+2 (+0.6%) in 30d · Committed 415d ago · C++ · Other license
Shares Local Runtime / Inference Engine, Inference Optimization, Web / Edge / On-Device Runtime
2bit quants, kernels and runtime for consumer devices.
Committed 16d ago · C++ · Other license
Shares Local Runtime / Inference Engine, Web / Edge / On-Device Runtime, Inference Optimization
- trymirai/uzu3.4k
A high-performance inference engine for AI models
+837 (+33%) in 30d · Committed today · Rust · MIT
Shares Local Runtime / Inference Engine, Inference Optimization, Web / Edge / On-Device Runtime
- Language
- Rust
- License
- Apache License 2.0
- Contributors
- 14
- Forks
- 51
- Watchers
- 11
- Open issues
- 28
- Releases
- 19
- Created
- 2026-08-15
- Stars this week
- +10
You've seen where MoE4All stands today.
Get the moves before everyone else: the 5 Inference Optimization repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.