QuantumFlow

QuantumFlow - Distributed LLM inference scheduling framework with multi-backend support (vLLM, TGI, SGLang), adaptive scheduling strategies, and cluster management.

zimingttkx/QuantumFlow

View on GitHub ↗

QuantumFlow - Distributed LLM inference scheduling framework with multi-backend support (vLLM, TGI, SGLang), adaptive scheduling strategies, and cluster management.

QuantumFlow grew -3.9% in the last 30 days, ranks 64th of 99 in Distributed Inference, last commit 153 days ago.

Star trajectory

82 days tracked
2026-08-31199 stars today2026-11-22
Momentum

-3.9% in 30d, below the Distributed Inference median of +1.2%.

Maintenance

Last commit 153 days ago, staler than the median of 5d.

How it compares in Distributed Inference

QuantumFlow
199
stars
-3.9% 30d
commit 153 days ago
Distributed Inference median
299
stars
+1.2% 30d
commit ~5d ago
Leader · exo
48.5k
stars
+1.1% 30d
commit 15 days ago

Ranked 64th of 99 by stars.

Ranked by shared tags, then keywords, then stars

Where QuantumFlow sits

Hover or focus a node for details. Click to open it.

  • This repo
  • Related repo
  • Tag or category
  1. cubestudio开源云原生一站式机器学习/深度学习/大模型AI平台/MaaS/mlops/人工智能平台/训推平台,算法全链路流程,多租户,算力租赁平台,token中转,拖拉拽任务流pipeline编排,多机多卡分布式…

    +50 (+1.9%) in 30d · Committed 40d ago · Python · Other license

    Shares Distributed Inference, LLM Gateway & Routing

  2. Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM…

    +71 (+11%) in 30d · Committed today · Rust · Apache-2.0

    Shares LLM Gateway & Routing, Distributed Inference

  3. Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management…

    +10 (+1.9%) in 30d · Committed today · Go · Apache-2.0

    Shares Distributed Inference, LLM Gateway & Routing

  4. llm-d Router: The intelligent entry point for inference requests

    +45 (+10%) in 30d · Committed today · Go · Apache-2.0

    Shares LLM Gateway & Routing, Distributed Inference

  5. An Open-source, self-hosted AI model hub with Hugging Face compatibility, accelerating vLLM/SGLang…

    +12 (+3.4%) in 30d · Committed yesterday · Go · Apache-2.0

    Shares Distributed Inference, LLM Gateway & Routing

  6. CacheRoute is an innovative LLM scheduling scheme dedicated to enabling flexible KV cache reuse across LLM…

    +41 (+17%) in 30d · Committed 103d ago · Python · Apache-2.0

    Shares LLM Gateway & Routing, Distributed Inference

  7. Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)

    -2 (-0.7%) in 30d · Committed 1,115d ago · Go · Apache-2.0

    Shares Distributed Inference, LLM Gateway & Routing

  8. Open-source infrastructure for the full inference lifecycle: deploy, observe, scale, optimize, and safely…

    -22 (-41%) in 30d · Committed today · Go · Apache-2.0

    Shares Distributed Inference, LLM Gateway & Routing

  9. Paxeer X is a Distributed HyperState Machine for payments, code execution and intent routing. Designed for…

    -135 (-24%) in 30d · Committed today · TypeScript · Other license

    Shares Distributed Inference, LLM Gateway & Routing

  10. High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic…

    +20 (+6.3%) in 30d · Committed today · Go · Apache-2.0

    Shares LLM Gateway & Routing, Distributed Inference

Language
Python
License
MIT License
Contributors
1
Forks
1
Watchers
2
Open issues
0
Releases
0
Created
2026-05-16
Stars this week
+0

You've seen where QuantumFlow stands today.

Get the moves before everyone else: the 5 Distributed Inference repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain QuantumFlow?

Claim this page to add your own call-to-action.

Claim this page