InferSim
A Lightweight LLM Inference Performance Simulator
alibaba/InferSim
View on GitHub ↗A Lightweight LLM Inference Performance Simulator
InferSim grew +1.9% in the last 30 days, ranks 290th of 343 in Inference Optimization, last commit 34 days ago.
Star trajectory
71 days tracked+1.9% in 30d, above the Inference Optimization median of +1.6%.
Last commit 34 days ago, staler than the median of 16d.
How it compares in Inference Optimization
Ranked 290th of 343 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere InferSim sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
Open Source AI Accelerator Research Platform Standard / 开源推理研究平台
+170 (+8.9%) in 30d · Committed today · Python · Apache-2.0
Shares Inference Optimization, Observability & Tracing
Benchmark and optimize LLM inference across frameworks with ease
+3 (+1.5%) in 30d · Committed 33d ago · Python · Apache-2.0
Shares Inference Optimization, Observability & Tracing
🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
+0 (+0.0%) in 30d · Committed 849d ago · Shell · MIT
Shares Inference Optimization, Observability & Tracing
Data Center and Client workload and software optimizations for Intel hardware.
+7 (+5.3%) in 30d · Committed 12d ago · Shell · Other license
Shares Inference Optimization, Observability & Tracing
Benchmark local LLM serving by replaying real agent trajectories
+26 (+24%) in 30d · Committed 37d ago · Python · Apache-2.0
Shares Inference Optimization, Observability & Tracing
LLM Inference analyzer for different hardware platforms
+6 (+4.7%) in 30d · Committed 11d ago · Jupyter Notebook · MIT
Shares Inference Optimization, Observability & Tracing
llm theoretical performance analysis tools and support params, flops, memory and latency analysis.
+1 (+0.8%) in 30d · Committed 498d ago · Python
Shares Inference Optimization, Observability & Tracing
Stop renting your AI. Throttle tests your AI calls against cheaper models on your own traffic and moves the…
+0 (+0.0%) in 30d · Committed yesterday · Python · MIT
Shares Observability & Tracing, Inference Optimization
Rust profiler for CPU, memory, SQL, HTTP, and async performance, with Prometheus and Grafana support.
+30 (+1.6%) in 30d · Committed today · Rust · MIT
Shares Observability & Tracing, Inference Optimization
Runtime evidence that helps agents trace, profile, and burn down hotspots in application and native code, GPU…
+28 (+13%) in 30d · Committed 5d ago · Python · MIT
Shares Observability & Tracing, Inference Optimization
- Language
- Python
- License
- Apache License 2.0
- Contributors
- 8
- Forks
- 32
- Watchers
- 0
- Open issues
- 5
- Releases
- 0
- Created
- 2025-09-28
- Stars this week
- +1
You've seen where InferSim stands today.
Get the moves before everyone else: the 5 Inference Optimization repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.