aisim
AISim predicts LLM serving behavior and searches for strong deployment configurations offline, without bringing up a GPU serving cluster
ai-dynamo/aisim
View on GitHub ↗AISim predicts LLM serving behavior and searches for strong deployment configurations offline, without bringing up a GPU serving cluster
aisim grew +40.4% in the last 30 days, ranks 243rd of 343 in Inference Optimization, actively maintained, last commit today.
Star trajectory
36 days tracked+40.4% in 30d, above the Inference Optimization median of +1.6%.
Last commit today, fresher than the median of 16d.
How it compares in Inference Optimization
Ranked 243rd of 343 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere aisim sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
LLM Benchmark for Throughput via Ollama (Local LLMs)
+2 (+0.5%) in 30d · Committed 25d ago · Python · MIT
Shares Inference Optimization
Runtime evidence that helps agents trace, profile, and burn down hotspots in application and native code, GPU…
+28 (+13%) in 30d · Committed 5d ago · Python · MIT
Shares Inference Optimization
Optimized GPU compiler for LLM inference. Choose from a list of optimized recipes or optimize your own model…
+12 (+10%) in 30d · Committed today · Python · Apache-2.0
Shares Inference Optimization
llm theoretical performance analysis tools and support params, flops, memory and latency analysis.
+1 (+0.8%) in 30d · Committed 498d ago · Python
Shares Inference Optimization
Run a 110B on a 2016 PC with 16 GB RAM. Know your tok/s before you download. Placement beats budget: predicts…
+3 (+3.3%) in 30d · Committed 46d ago · Python · MIT
Shares Inference Optimization
An open-source virtual AI Infra team that discovers, benchmarks, and safely upgrades local LLM inference—with…
-1 (-1.2%) in 30d · Committed 74d ago · Python · Apache-2.0
Shares Inference Optimization
Local decision engine with typed, calibrated outputs (Noul/Choice/Score): cheap→strong cascade, ECE/Brier…
Committed yesterday · Python · Apache-2.0
Shares Inference Optimization
Stop renting your AI. Throttle tests your AI calls against cheaper models on your own traffic and moves the…
+0 (+0.0%) in 30d · Committed yesterday · Python · MIT
Shares Inference Optimization
Will this LLM run on this Mac, and how fast. Memory and tokens per second for any model on any Apple Silicon…
+0 in 30d · Committed 62d ago · Python · MIT
Shares Inference Optimization
Lightning-Fast, On-Device, Multilingual TTS — running natively via ONNX.
-15 (-0.1%) in 30d · Committed 74d ago · Swift · MIT
Shares Inference Optimization
- Language
- Python
- License
- Other
- Contributors
- 72
- Forks
- 67
- Watchers
- 0
- Open issues
- 37
- Releases
- 3
- Created
- 2026-08-11
- Stars this week
- +5
You've seen where aisim stands today.
Get the moves before everyone else: the 5 Inference Optimization repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.