ModelCache
A LLM semantic caching system aiming to enhance user experience by reducing response time via cached query-result pairs.
codefuse-ai/ModelCache
View on GitHub ↗A LLM semantic caching system aiming to enhance user experience by reducing response time via cached query-result pairs.
ModelCache grew -0.4% in the last 30 days, ranks 52nd of 301 in Inference Optimization, last commit 481 days ago.
Star trajectory
78 days tracked2026-08-07933 stars today2026-10-24
Momentum
-0.4% in 30d, below the Inference Optimization median of +1.5%.
Maintenance
Last commit 481 days ago, staler than the median of 14d.
How it compares in Inference Optimization
ModelCache
933
stars
-0.4% 30d
commit 481 days ago
Inference Optimization median
257
stars
+1.5% 30d
commit ~14d ago
Leader · supertonic
13.8k
stars
-0.2% 30d
commit 44 days ago
Ranked 52nd of 301 by stars.
efeslab/Nanoflow977-44eagle-hq/EAGLE-4957-24
codefuse-ai/ModelCache933
candle-org/mindnlp920+13candle-org/MindAct920+13- Language
- Python
- License
- Other
- Contributors
- 10
- Forks
- 65
- Watchers
- 15
- Open issues
- 2
- Releases
- 2
- Created
- 2023-11-01
- Stars this week
- +1
You've seen where ModelCache stands today.
Get the moves before everyone else: the 5 Inference Optimization repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.