aa-agentperf-local

Benchmark local LLM serving by replaying real agent trajectories

ArtificialAnalysis/aa-agentperf-local

View on GitHub ↗

Benchmark local LLM serving by replaying real agent trajectories

aa-agentperf-local grew +24.1% in the last 30 days, ranks 251st of 343 in Inference Optimization, last commit 37 days ago.

Star trajectory

50 days tracked
2026-10-03134 stars today2026-11-22
Momentum

+24.1% in 30d, above the Inference Optimization median of +1.6%.

Maintenance

Last commit 37 days ago, staler than the median of 16d.

How it compares in Inference Optimization

aa-agentperf-local
134
stars
+24.1% 30d
commit 37 days ago
Inference Optimization median
242
stars
+1.6% 30d
commit ~16d ago
Leader · supertonic
13.8k
stars
-0.1% 30d
commit 74 days ago

Ranked 251st of 343 by stars.

Ranked by shared tags, then keywords, then stars
  1. Open Source AI Accelerator Research Platform Standard / 开源推理研究平台

    +170 (+8.9%) in 30d · Committed today · Python · Apache-2.0

    Shares Inference Optimization, Observability & Tracing

  2. Benchmark and optimize LLM inference across frameworks with ease

    +3 (+1.5%) in 30d · Committed 33d ago · Python · Apache-2.0

    Shares Inference Optimization, Observability & Tracing

  3. 🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.

    +0 (+0.0%) in 30d · Committed 849d ago · Shell · MIT

    Shares Inference Optimization, Observability & Tracing

  4. Data Center and Client workload and software optimizations for Intel hardware.

    +7 (+5.3%) in 30d · Committed 12d ago · Shell · Other license

    Shares Inference Optimization, Observability & Tracing

  5. LLM Inference analyzer for different hardware platforms

    +6 (+4.7%) in 30d · Committed 11d ago · Jupyter Notebook · MIT

    Shares Inference Optimization, Observability & Tracing

  6. llm theoretical performance analysis tools and support params, flops, memory and latency analysis.

    +1 (+0.8%) in 30d · Committed 498d ago · Python

    Shares Inference Optimization, Observability & Tracing

  7. A Lightweight LLM Inference Performance Simulator

    +2 (+1.9%) in 30d · Committed 34d ago · Python · Apache-2.0

    Shares Inference Optimization, Observability & Tracing

  8. Stop renting your AI. Throttle tests your AI calls against cheaper models on your own traffic and moves the…

    +0 (+0.0%) in 30d · Committed yesterday · Python · MIT

    Shares Observability & Tracing, Inference Optimization

  9. Rust profiler for CPU, memory, SQL, HTTP, and async performance, with Prometheus and Grafana support.

    +30 (+1.6%) in 30d · Committed today · Rust · MIT

    Shares Observability & Tracing, Inference Optimization

  10. Runtime evidence that helps agents trace, profile, and burn down hotspots in application and native code, GPU…

    +28 (+13%) in 30d · Committed 5d ago · Python · MIT

    Shares Observability & Tracing, Inference Optimization

Language
Python
License
Apache License 2.0
Contributors
2
Forks
7
Watchers
0
Open issues
1
Releases
7
Created
2026-09-26
Stars this week
+0

You've seen where aa-agentperf-local stands today.

Get the moves before everyone else: the 5 Inference Optimization repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain aa-agentperf-local?

Claim this page to add your own call-to-action.

Claim this page