prompt-cache
Cut LLM costs by up to 80% and unlock sub-millisecond responses with intelligent semantic caching.A drop-in, provider-agnostic LLM proxy written in Go with sub-millisecond response
messkan/prompt-cache
View on GitHub ↗Cut LLM costs by up to 80% and unlock sub-millisecond responses with intelligent semantic caching.A drop-in, provider-agnostic LLM proxy written in Go with sub-millisecond response
prompt-cache grew +3.7% in the last 30 days, ranks 64th of 268 in LLM Gateway & Routing, last commit 67 days ago.
Star trajectory
115 days tracked+3.7% in 30d, above the LLM Gateway & Routing median of +2.1%.
Last commit 67 days ago, staler than the median of 5d.
How it compares in LLM Gateway & Routing
Ranked 64th of 268 by stars.
- Language
- Go
- License
- MIT License
- Contributors
- 4
- Forks
- 43
- Watchers
- 1
- Open issues
- 4
- Releases
- 4
- Created
- 2025-11-22
- Stars this week
- -4
You've seen where prompt-cache stands today.
Get the moves before everyone else: the 5 LLM Gateway & Routing repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.