jevcache

A decision cache for TypeSafe Jev-class models — memoize decisions so repeats are free, deterministic, and shareable. One 2 MB binary.

hyperspaceai/jevcache

View on GitHub ↗

A decision cache for TypeSafe Jev-class models — memoize decisions so repeats are free, deterministic, and shareable. One 2 MB binary.

jevcache grew +1.3% in the last 30 days, ranks 307th of 343 in Inference Optimization, last commit 63 days ago.

Star trajectory

61 days tracked
2026-09-2179 stars today2026-11-22
Momentum

+1.3% in 30d, below the Inference Optimization median of +1.6%.

Maintenance

Last commit 63 days ago, staler than the median of 16d.

How it compares in Inference Optimization

jevcache
79
stars
+1.3% 30d
commit 63 days ago
Inference Optimization median
242
stars
+1.6% 30d
commit ~16d ago
Leader · supertonic
13.8k
stars
-0.1% 30d
commit 74 days ago

Ranked 307th of 343 by stars.

Ranked by shared tags, then keywords, then stars

Where jevcache sits

Hover or focus a node for details. Click to open it.

  • This repo
  • Related repo
  • Tag or category
  1. CacheRoute is an innovative LLM scheduling scheme dedicated to enabling flexible KV cache reuse across LLM…

    +41 (+17%) in 30d · Committed 103d ago · Python · Apache-2.0

    Shares Inference Optimization, LLM Gateway & Routing

  2. Official Edgee CLI to interract with Edgee's Agent Gateway. Route Claude Code, Codex, Cursor, VS Code +…

    +2 (+1.4%) in 30d · Committed yesterday · Rust · Apache-2.0

    Shares LLM Gateway & Routing, Inference Optimization

  3. Local decision engine with typed, calibrated outputs (Noul/Choice/Score): cheap→strong cascade, ECE/Brier…

    Committed yesterday · Python · Apache-2.0

    Shares LLM Gateway & Routing, Inference Optimization

  4. The local model runtime that makes llama.cpp behave like an API provider.

    Committed today · Rust · AGPL-3.0

    Shares LLM Gateway & Routing, Inference Optimization

  5. Model router for agentic systems. Routes every prompt to the right model in <50ms. Cut costs 40-70% with just…

    +25 (+0.4%) in 30d · Committed today · Go · Apache-2.0

    Shares LLM Gateway & Routing, Inference Optimization

  6. LLM Inference Engine for Metal, CUDA and Vulkan.

    +916 (+63%) in 30d · Committed today · Zig · Apache-2.0

    Shares Inference Optimization, LLM Gateway & Routing

  7. Streamline your workflow with Lynkr, a CLI tool that acts as an HTTP proxy for efficient code interactions…

    +4 (+0.6%) in 30d · Committed 7d ago · JavaScript · Apache-2.0

    Shares LLM Gateway & Routing, Inference Optimization

  8. Run many AI agents at once on your Mac, up to 3x faster.

    +273 (+91%) in 30d · Committed today · Python · Apache-2.0

    Shares Inference Optimization, LLM Gateway & Routing

  9. Cut LLM costs by up to 80% and unlock sub-millisecond responses with intelligent semantic caching.A drop-in…

    +1 (+0.2%) in 30d · Committed 95d ago · Go · MIT

    Shares LLM Gateway & Routing, Inference Optimization

  10. Local proxy that compresses your LLM API requests so you pay less, with no change to the answers. Trims wasted…

    +21 (+8.2%) in 30d · Committed 9d ago · Rust · MPL-2.0

    Shares LLM Gateway & Routing, Inference Optimization

Language
-
License
-
Contributors
1
Forks
3
Watchers
1
Open issues
3
Releases
1
Created
2026-09-18
Stars this week
+1

You've seen where jevcache stands today.

Get the moves before everyone else: the 5 Inference Optimization repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain jevcache?

Claim this page to add your own call-to-action.

Claim this page