Frontier

Frontier: A Discrete-Event Simulator for Modern LLM Serving

NetX-lab/Frontier

View on GitHub ↗

Frontier: A Discrete-Event Simulator for Modern LLM Serving

Frontier grew +10.8% in the last 30 days, ranks 248th of 397 in Production Serving & Deployment, actively maintained, last commit 2 days ago.

Star trajectory

82 days tracked
2026-08-31185 stars today2026-11-22
Momentum

+10.8% in 30d, above the Production Serving & Deployment median of +1.3%.

Maintenance

Last commit 2 days ago, fresher than the median of 3d.

How it compares in Production Serving & Deployment

Frontier
185
stars
+10.8% 30d
commit 2 days ago
Production Serving & Deployment median
272
stars
+1.3% 30d
commit ~3d ago
Leader · vllm
97.3k
stars
+2.2% 30d
commit today

Ranked 248th of 397 by stars.

Ranked by shared tags, then keywords, then stars
  1. A high-performance inference engine for LLM, VLM and DiT models, optimized for diverse AI accelerators. It is…

    +23 (+1.4%) in 30d · Committed today · C++ · Apache-2.0

    Shares Production Serving & Deployment

  2. Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of…

    +4 (+1.2%) in 30d · Committed 38d ago · Python · MIT

    Shares Production Serving & Deployment

  3. DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various…

    +0 (+0.0%) in 30d · Committed 472d ago · C · Apache-2.0

    Shares Production Serving & Deployment

  4. This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs…

    +1 (+0.5%) in 30d · Committed 706d ago · TypeScript · MIT

    Shares Production Serving & Deployment

  5. 大模型推理案头手册(开源版):给定 GPU 算力,一个模型能扛多少 QPS?三层模型 × 三面墙 × 排队论 × 开环压测

    +1 (+0.5%) in 30d · Committed 63d ago · Other license

    Shares Production Serving & Deployment

  6. Community registry of LLM serving-path traps that produce confidently wrong measurements: templates, tool…

    +38 (+27%) in 30d · Committed today · Python · MIT

    Shares Production Serving & Deployment

  7. SmarterRouter: An intelligent LLM gateway and VRAM-aware router for Ollama, llama.cpp, and OpenAI. Features…

    +11 (+7.1%) in 30d · Committed 196d ago · Python · MIT

    Shares Production Serving & Deployment

  8. Optimized GPU compiler for LLM inference. Choose from a list of optimized recipes or optimize your own model…

    +12 (+10%) in 30d · Committed today · Python · Apache-2.0

    Shares Production Serving & Deployment

  9. Reproducible LLM routing and deployment optimization.

    +0 (+0.0%) in 30d · Committed 88d ago · Python · Apache-2.0

    Shares Production Serving & Deployment

  10. An open-source virtual AI Infra team that discovers, benchmarks, and safely upgrades local LLM inference—with…

    -1 (-1.2%) in 30d · Committed 74d ago · Python · Apache-2.0

    Shares Production Serving & Deployment

Language
Python
License
MIT License
Contributors
3
Forks
29
Watchers
1
Open issues
2
Releases
1
Created
2026-05-21
Stars this week
+5

You've seen where Frontier stands today.

Get the moves before everyone else: the 5 Production Serving & Deployment repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain Frontier?

Claim this page to add your own call-to-action.

Claim this page