CacheRoute
CacheRoute is an innovative LLM scheduling scheme dedicated to enabling flexible KV cache reuse across LLM systems, improving task performance and system efficiency.
AstraNetLab/CacheRoute
View on GitHub ↗CacheRoute is an innovative LLM scheduling scheme dedicated to enabling flexible KV cache reuse across LLM systems, improving task performance and system efficiency.
CacheRoute grew -23.5% in the last 30 days, ranks 158th of 303 in Inference Optimization, last commit 75 days ago.
Star trajectory
101 days tracked-23.5% in 30d, below the Inference Optimization median of +1.5%.
Last commit 75 days ago, staler than the median of 15d.
How it compares in Inference Optimization
Ranked 158th of 303 by stars.
- Language
- Python
- License
- Apache License 2.0
- Contributors
- 4
- Forks
- 2
- Watchers
- 8
- Open issues
- 16
- Releases
- 10
- Created
- 2025-11-17
- Stars this week
- +12
You've seen where CacheRoute stands today.
Get the moves before everyone else: the 5 Inference Optimization repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.