vLLM-Moet

Frontier MoE models on RTX PRO 6000 / RTX 5090 (sm_120): DeepSeek-V4.1-Flash on 4x RTX PRO 6000, as a GPU+CPU hybrid on 4x RTX 5090, and 2-bit experts on vLLM v0.24.0

kacper-daftcode/vLLM-Moet

View on GitHub ↗

Frontier MoE models on RTX PRO 6000 / RTX 5090 (sm_120): DeepSeek-V4.1-Flash on 4x RTX PRO 6000, as a GPU+CPU hybrid on 4x RTX 5090, and 2-bit experts on vLLM v0.24.0

vLLM-Moet grew +6.6% in the last 30 days, ranks 89th of 343 in Inference Optimization, actively maintained, last commit 3 days ago.

Star trajectory

82 days tracked
2026-08-31581 stars today2026-11-22
Momentum

+6.6% in 30d, above the Inference Optimization median of +1.6%.

Maintenance

Last commit 3 days ago, fresher than the median of 16d.

How it compares in Inference Optimization

vLLM-Moet
581
stars
+6.6% 30d
commit 3 days ago
Inference Optimization median
242
stars
+1.6% 30d
commit ~16d ago
Leader · supertonic
13.8k
stars
-0.1% 30d
commit 74 days ago

Ranked 89th of 343 by stars.

Ranked by shared tags, then keywords, then stars
  1. Sparse Inferencing for transformer based LLMs

    +1 (+0.5%) in 30d · Committed 242d ago · Python · Apache-2.0

    Shares Inference Optimization, Model Optimization, GPU Kernels

  2. OrbitKV is a High Performance KV Cache System for LLM Inference.

    -52 (-15%) in 30d · Committed yesterday · Rust · Apache-2.0

    Shares Inference Optimization, GPU Kernels, Model Optimization

  3. An agent harness that compiles a model into one provably-correct, self-retargeting CUDA megakernel and…

    +9 (+5.7%) in 30d · Committed 65d ago · Python · MIT

    Shares Inference Optimization, Model Optimization, GPU Kernels

  4. Optimized GPU compiler for LLM inference. Choose from a list of optimized recipes or optimize your own model…

    +12 (+10%) in 30d · Committed today · Python · Apache-2.0

    Shares Inference Optimization, Model Optimization, GPU Kernels

  5. Run Mixtral-8x7B models in Colab or consumer desktops

    -3 (-0.1%) in 30d · Committed 957d ago · Python · MIT

    Shares Inference Optimization, Model Optimization

  6. RDNA-native LLM inference engine in Rust.

    +95 (+13%) in 30d · Committed today · Rust · Other license

    Shares Inference Optimization, Model Optimization

  7. Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

    +25 (+3.5%) in 30d · Committed yesterday · Rust · Apache-2.0

    Shares Inference Optimization, Model Optimization

  8. Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM…

    +8 (+1.5%) in 30d · Committed 10d ago · C++ · Other license

    Shares Inference Optimization, Model Optimization

  9. PyTorch library for cost-effective, fast and easy serving of MoE models.

    +11 (+2.9%) in 30d · Committed yesterday · Python · Apache-2.0

    Shares Inference Optimization, Model Optimization

  10. Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).

    +0 (+0.0%) in 30d · Committed 982d ago · C++ · MIT

    Shares Inference Optimization, Model Optimization

Language
Sass
License
Apache License 2.0
Contributors
5
Forks
49
Watchers
9
Open issues
1
Releases
1
Created
2026-06-15
Stars this week
+4

You've seen where vLLM-Moet stands today.

Get the moves before everyone else: the 5 Inference Optimization repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain vLLM-Moet?

Claim this page to add your own call-to-action.

Claim this page