MoE4All

Run MoE models beyond VRAM on AMD, NVIDIA & Intel GPUs. Vulkan-powered, portable Windows app with automatic setup. | 让游戏显卡跑起超显存大模型,支持 AMD、NVIDIA、Intel,免安装、自动配置。只需13MB,即下即用!

Headmaster218/MoE4All

View on GitHub ↗

Run MoE models beyond VRAM on AMD, NVIDIA & Intel GPUs. Vulkan-powered, portable Windows app with automatic setup. | 让游戏显卡跑起超显存大模型,支持 AMD、NVIDIA、Intel,免安装、自动配置。只需13MB,即下即用!

MoE4All grew +14.1% in the last 30 days, ranks 129th of 343 in Inference Optimization, actively maintained, last commit yesterday.

Star trajectory

82 days tracked
2026-08-31372 stars today2026-11-22
Momentum

+14.1% in 30d, above the Inference Optimization median of +1.6%.

Maintenance

Last commit yesterday, fresher than the median of 16d.

How it compares in Inference Optimization

MoE4All
372
stars
+14.1% 30d
commit yesterday
Inference Optimization median
242
stars
+1.6% 30d
commit ~16d ago
Leader · supertonic
13.8k
stars
-0.1% 30d
commit 74 days ago

Ranked 129th of 343 by stars.

Ranked by shared tags, then keywords, then stars
  1. Swiftlet is a Swift and Metal runtime that runs large Qwen Mixture-of-Experts models locally on Apple devices…

    +5 (+0.8%) in 30d · Committed 4d ago · Swift · Apache-2.0

    Shares Local Runtime / Inference Engine, Web / Edge / On-Device Runtime, Inference Optimization

  2. Private AI that runs entirely on your Mac: a native SwiftUI app on its own Swift + Metal inference engine…

    +1 (+0.8%) in 30d · Committed yesterday · C++ · Other license

    Shares Web / Edge / On-Device Runtime, Local Runtime / Inference Engine, Inference Optimization

  3. The local AI app built for the Mac. Run LLMs like Qwen, Gemma and GPT-OSS on Apple Silicon, including models…

    +17 (+28%) in 30d · Committed today · Swift · Apache-2.0

    Shares Local Runtime / Inference Engine, Inference Optimization, Web / Edge / On-Device Runtime

  4. Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

    +442 (+6.3%) in 30d · Committed 7d ago · Swift · Apache-2.0

    Shares Web / Edge / On-Device Runtime, Inference Optimization, Local Runtime / Inference Engine

  5. Run LLMs on AMD Ryzen™ AI NPUs in minutes; purpose-built and deeply optimized for the AMD NPUs.

    +97 (+4.9%) in 30d · Committed today · C++ · Other license

    Shares Web / Edge / On-Device Runtime, Local Runtime / Inference Engine, Inference Optimization

  6. Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp…

    +425 (+65%) in 30d · Committed today · C++ · Apache-2.0

    Shares Web / Edge / On-Device Runtime, Inference Optimization, Local Runtime / Inference Engine

  7. Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB…

    +193 (+40%) in 30d · Committed 4d ago · Swift · MIT

    Shares Web / Edge / On-Device Runtime, Inference Optimization, Local Runtime / Inference Engine

  8. CPU inference for the DeepSeek family of large language models in C++

    +2 (+0.6%) in 30d · Committed 415d ago · C++ · Other license

    Shares Local Runtime / Inference Engine, Inference Optimization, Web / Edge / On-Device Runtime

  9. 2bit quants, kernels and runtime for consumer devices.

    Committed 16d ago · C++ · Other license

    Shares Local Runtime / Inference Engine, Web / Edge / On-Device Runtime, Inference Optimization

  10. A high-performance inference engine for AI models

    +837 (+33%) in 30d · Committed today · Rust · MIT

    Shares Local Runtime / Inference Engine, Inference Optimization, Web / Edge / On-Device Runtime

Language
Rust
License
Apache License 2.0
Contributors
14
Forks
51
Watchers
11
Open issues
28
Releases
19
Created
2026-08-15
Stars this week
+10

You've seen where MoE4All stands today.

Get the moves before everyone else: the 5 Inference Optimization repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain MoE4All?

Claim this page to add your own call-to-action.

Claim this page