vLLM-Moet
Frontier MoE models on RTX PRO 6000 / RTX 5090 (sm_120): DeepSeek-V4.1-Flash on 4x RTX PRO 6000, as a GPU+CPU hybrid on 4x RTX 5090, and 2-bit experts on vLLM v0.24.0
kacper-daftcode/vLLM-Moet
View on GitHub ↗Frontier MoE models on RTX PRO 6000 / RTX 5090 (sm_120): DeepSeek-V4.1-Flash on 4x RTX PRO 6000, as a GPU+CPU hybrid on 4x RTX 5090, and 2-bit experts on vLLM v0.24.0
vLLM-Moet grew +6.6% in the last 30 days, ranks 89th of 343 in Inference Optimization, actively maintained, last commit 3 days ago.
Star trajectory
82 days tracked+6.6% in 30d, above the Inference Optimization median of +1.6%.
Last commit 3 days ago, fresher than the median of 16d.
How it compares in Inference Optimization
Ranked 89th of 343 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere vLLM-Moet sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
Sparse Inferencing for transformer based LLMs
+1 (+0.5%) in 30d · Committed 242d ago · Python · Apache-2.0
Shares Inference Optimization, Model Optimization, GPU Kernels
OrbitKV is a High Performance KV Cache System for LLM Inference.
-52 (-15%) in 30d · Committed yesterday · Rust · Apache-2.0
Shares Inference Optimization, GPU Kernels, Model Optimization
An agent harness that compiles a model into one provably-correct, self-retargeting CUDA megakernel and…
+9 (+5.7%) in 30d · Committed 65d ago · Python · MIT
Shares Inference Optimization, Model Optimization, GPU Kernels
Optimized GPU compiler for LLM inference. Choose from a list of optimized recipes or optimize your own model…
+12 (+10%) in 30d · Committed today · Python · Apache-2.0
Shares Inference Optimization, Model Optimization, GPU Kernels
Run Mixtral-8x7B models in Colab or consumer desktops
-3 (-0.1%) in 30d · Committed 957d ago · Python · MIT
Shares Inference Optimization, Model Optimization
RDNA-native LLM inference engine in Rust.
+95 (+13%) in 30d · Committed today · Rust · Other license
Shares Inference Optimization, Model Optimization
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
+25 (+3.5%) in 30d · Committed yesterday · Rust · Apache-2.0
Shares Inference Optimization, Model Optimization
Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM…
+8 (+1.5%) in 30d · Committed 10d ago · C++ · Other license
Shares Inference Optimization, Model Optimization
PyTorch library for cost-effective, fast and easy serving of MoE models.
+11 (+2.9%) in 30d · Committed yesterday · Python · Apache-2.0
Shares Inference Optimization, Model Optimization
Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).
+0 (+0.0%) in 30d · Committed 982d ago · C++ · MIT
Shares Inference Optimization, Model Optimization
- Language
- Sass
- License
- Apache License 2.0
- Contributors
- 5
- Forks
- 49
- Watchers
- 9
- Open issues
- 1
- Releases
- 1
- Created
- 2026-06-15
- Stars this week
- +4
You've seen where vLLM-Moet stands today.
Get the moves before everyone else: the 5 Inference Optimization repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.