QuantumFlow
QuantumFlow - Distributed LLM inference scheduling framework with multi-backend support (vLLM, TGI, SGLang), adaptive scheduling strategies, and cluster management.
zimingttkx/QuantumFlow
View on GitHub ↗QuantumFlow - Distributed LLM inference scheduling framework with multi-backend support (vLLM, TGI, SGLang), adaptive scheduling strategies, and cluster management.
QuantumFlow grew -3.9% in the last 30 days, ranks 64th of 99 in Distributed Inference, last commit 153 days ago.
Star trajectory
82 days tracked-3.9% in 30d, below the Distributed Inference median of +1.2%.
Last commit 153 days ago, staler than the median of 5d.
How it compares in Distributed Inference
Ranked 64th of 99 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere QuantumFlow sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
cubestudio开源云原生一站式机器学习/深度学习/大模型AI平台/MaaS/mlops/人工智能平台/训推平台,算法全链路流程,多租户,算力租赁平台,token中转,拖拉拽任务流pipeline编排,多机多卡分布式…
+50 (+1.9%) in 30d · Committed 40d ago · Python · Other license
Shares Distributed Inference, LLM Gateway & Routing
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM…
+71 (+11%) in 30d · Committed today · Rust · Apache-2.0
Shares LLM Gateway & Routing, Distributed Inference
Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management…
+10 (+1.9%) in 30d · Committed today · Go · Apache-2.0
Shares Distributed Inference, LLM Gateway & Routing
llm-d Router: The intelligent entry point for inference requests
+45 (+10%) in 30d · Committed today · Go · Apache-2.0
Shares LLM Gateway & Routing, Distributed Inference
An Open-source, self-hosted AI model hub with Hugging Face compatibility, accelerating vLLM/SGLang…
+12 (+3.4%) in 30d · Committed yesterday · Go · Apache-2.0
Shares Distributed Inference, LLM Gateway & Routing
CacheRoute is an innovative LLM scheduling scheme dedicated to enabling flexible KV cache reuse across LLM…
+41 (+17%) in 30d · Committed 103d ago · Python · Apache-2.0
Shares LLM Gateway & Routing, Distributed Inference
Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
-2 (-0.7%) in 30d · Committed 1,115d ago · Go · Apache-2.0
Shares Distributed Inference, LLM Gateway & Routing
Open-source infrastructure for the full inference lifecycle: deploy, observe, scale, optimize, and safely…
-22 (-41%) in 30d · Committed today · Go · Apache-2.0
Shares Distributed Inference, LLM Gateway & Routing
Paxeer X is a Distributed HyperState Machine for payments, code execution and intent routing. Designed for…
-135 (-24%) in 30d · Committed today · TypeScript · Other license
Shares Distributed Inference, LLM Gateway & Routing
- thushan/olla340
High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic…
+20 (+6.3%) in 30d · Committed today · Go · Apache-2.0
Shares LLM Gateway & Routing, Distributed Inference
- Language
- Python
- License
- MIT License
- Contributors
- 1
- Forks
- 1
- Watchers
- 2
- Open issues
- 0
- Releases
- 0
- Created
- 2026-05-16
- Stars this week
- +0
You've seen where QuantumFlow stands today.
Get the moves before everyone else: the 5 Distributed Inference repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.