jevcache
A decision cache for TypeSafe Jev-class models — memoize decisions so repeats are free, deterministic, and shareable. One 2 MB binary.
hyperspaceai/jevcache
View on GitHub ↗A decision cache for TypeSafe Jev-class models — memoize decisions so repeats are free, deterministic, and shareable. One 2 MB binary.
jevcache grew +1.3% in the last 30 days, ranks 307th of 343 in Inference Optimization, last commit 63 days ago.
Star trajectory
61 days tracked+1.3% in 30d, below the Inference Optimization median of +1.6%.
Last commit 63 days ago, staler than the median of 16d.
How it compares in Inference Optimization
Ranked 307th of 343 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere jevcache sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
CacheRoute is an innovative LLM scheduling scheme dedicated to enabling flexible KV cache reuse across LLM…
+41 (+17%) in 30d · Committed 103d ago · Python · Apache-2.0
Shares Inference Optimization, LLM Gateway & Routing
Official Edgee CLI to interract with Edgee's Agent Gateway. Route Claude Code, Codex, Cursor, VS Code +…
+2 (+1.4%) in 30d · Committed yesterday · Rust · Apache-2.0
Shares LLM Gateway & Routing, Inference Optimization
Local decision engine with typed, calibrated outputs (Noul/Choice/Score): cheap→strong cascade, ECE/Brier…
Committed yesterday · Python · Apache-2.0
Shares LLM Gateway & Routing, Inference Optimization
The local model runtime that makes llama.cpp behave like an API provider.
Committed today · Rust · AGPL-3.0
Shares LLM Gateway & Routing, Inference Optimization
- weave-os/router5.6k
Model router for agentic systems. Routes every prompt to the right model in <50ms. Cut costs 40-70% with just…
+25 (+0.4%) in 30d · Committed today · Go · Apache-2.0
Shares LLM Gateway & Routing, Inference Optimization
LLM Inference Engine for Metal, CUDA and Vulkan.
+916 (+63%) in 30d · Committed today · Zig · Apache-2.0
Shares Inference Optimization, LLM Gateway & Routing
Streamline your workflow with Lynkr, a CLI tool that acts as an HTTP proxy for efficient code interactions…
+4 (+0.6%) in 30d · Committed 7d ago · JavaScript · Apache-2.0
Shares LLM Gateway & Routing, Inference Optimization
Run many AI agents at once on your Mac, up to 3x faster.
+273 (+91%) in 30d · Committed today · Python · Apache-2.0
Shares Inference Optimization, LLM Gateway & Routing
Cut LLM costs by up to 80% and unlock sub-millisecond responses with intelligent semantic caching.A drop-in…
+1 (+0.2%) in 30d · Committed 95d ago · Go · MIT
Shares LLM Gateway & Routing, Inference Optimization
Local proxy that compresses your LLM API requests so you pay less, with no change to the answers. Trims wasted…
+21 (+8.2%) in 30d · Committed 9d ago · Rust · MPL-2.0
Shares LLM Gateway & Routing, Inference Optimization
- Language
- -
- License
- -
- Contributors
- 1
- Forks
- 3
- Watchers
- 1
- Open issues
- 3
- Releases
- 1
- Created
- 2026-09-18
- Stars this week
- +1
You've seen where jevcache stands today.
Get the moves before everyone else: the 5 Inference Optimization repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.