LLMRouterBench

[Findings@ACL'26] LLMRouterBench: A Massive Benchmark and Unified Framework for LLM Routing

ynulihao/LLMRouterBench

View on GitHub ↗

[Findings@ACL'26] LLMRouterBench: A Massive Benchmark and Unified Framework for LLM Routing

LLMRouterBench grew +4.7% in the last 30 days, ranks 198th of 339 in LLM Gateway & Routing, last commit 20 days ago.

Star trajectory

80 days tracked
2026-09-02134 stars today2026-11-22
Momentum

+4.7% in 30d, above the LLM Gateway & Routing median of +1.5%.

Maintenance

Last commit 20 days ago, staler than the median of 5d.

How it compares in LLM Gateway & Routing

LLMRouterBench
134
stars
+4.7% 30d
commit 20 days ago
LLM Gateway & Routing median
162
stars
+1.5% 30d
commit ~5d ago
Leader · OmniRoute
89.5k
stars
+11.9% 30d
commit today

Ranked 198th of 339 by stars.

Ranked by shared tags, then keywords, then stars

Where LLMRouterBench sits

Hover or focus a node for details. Click to open it.

  • This repo
  • Related repo
  • Tag or category
  1. The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System

    +2 (+1.1%) in 30d · Committed 892d ago · Python · MIT

    Shares LLM Gateway & Routing, Evaluation & Guardrails

  2. AI Stupid Level — independent, continuous LLM benchmarks (coding, reasoning, tool use), drift detection and a…

    Committed yesterday · TypeScript · MIT

    Shares Evaluation & Guardrails, LLM Gateway & Routing

  3. [ECCV'26] MMR-Bench: A Comprehensive Benchmark for Multimodal LLM Routing

    +0 (+0.0%) in 30d · Committed 40d ago · Python · MIT

    Shares LLM Gateway & Routing, Evaluation & Guardrails

  4. Local decision engine with typed, calibrated outputs (Noul/Choice/Score): cheap→strong cascade, ECE/Brier…

    Committed yesterday · Python · Apache-2.0

    Shares LLM Gateway & Routing, Evaluation & Guardrails

  5. Stop renting your AI. Throttle tests your AI calls against cheaper models on your own traffic and moves the…

    +0 (+0.0%) in 30d · Committed yesterday · Python · MIT

    Shares Evaluation & Guardrails, LLM Gateway & Routing

  6. TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation…

    -13 (-0.1%) in 30d · Committed 164d ago · Rust · Apache-2.0

    Shares LLM Gateway & Routing, Evaluation & Guardrails

  7. AI gets the context. Not your private data. Local-first privacy proxy for browser chat, AI APIs, and coding…

    +70 (+9.1%) in 30d · Committed today · TypeScript · Apache-2.0

    Shares LLM Gateway & Routing, Evaluation & Guardrails

  8. AI Agent Identity and Access Management and Inference Firewall

    +148 (+54%) in 30d · Committed 28d ago · Python

    Shares LLM Gateway & Routing, Evaluation & Guardrails

  9. Lightweight LLM firewall: masks PII, routes calls, leaves zero trace.

    +10 (+2.5%) in 30d · Committed 340d ago · Python · MIT

    Shares LLM Gateway & Routing, Evaluation & Guardrails

  10. 数据面具 Data Maskit — 专为大模型打造的本地隐私脱敏网关(请求自动打码,回复流式还原;支持 Cursor / Claude Code / Codex / Pi 等任意可配 Base URL 工具)

    +36 (+12%) in 30d · Committed 2d ago · Python · AGPL-3.0

    Shares LLM Gateway & Routing, Evaluation & Guardrails

Language
Python
License
Other
Contributors
2
Forks
25
Watchers
1
Open issues
0
Releases
0
Created
2025-12-09
Stars this week
+1

You've seen where LLMRouterBench stands today.

Get the moves before everyone else: the 5 LLM Gateway & Routing repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain LLMRouterBench?

Claim this page to add your own call-to-action.

Claim this page