sample-agent-cost-bench

Benchmark framework that measures cost, quality, and duration of coding agents across any AI Coding Assistant CLI, any model, and any use case — with pluggable verification and real-repo support.

aws-samples/sample-agent-cost-bench

View on GitHub ↗

Benchmark framework that measures cost, quality, and duration of coding agents across any AI Coding Assistant CLI, any model, and any use case — with pluggable verification and real-repo support.

sample-agent-cost-bench grew +12.2% in the last 30 days, ranks 686th of 872 in Evaluation & Guardrails, actively maintained, last commit 4 days ago.

Star trajectory

76 days tracked
2026-09-06110 stars today2026-11-22
Momentum

+12.2% in 30d, above the Evaluation & Guardrails median of +1.4%.

Maintenance

Last commit 4 days ago, fresher than the median of 15d.

How it compares in Evaluation & Guardrails

sample-agent-cost-bench
110
stars
+12.2% 30d
commit 4 days ago
Evaluation & Guardrails median
235
stars
+1.4% 30d
commit ~15d ago
Leader · impeccable
114.7k
stars
+0.0% 30d
commit today

Ranked 686th of 872 by stars.

Ranked by shared tags, then keywords, then stars
  1. Official Repository for QuantHarness

    +24 (+0.8%) in 30d · Committed 95d ago · HTML · MIT

    Shares Evaluation & Guardrails, Agent SDK / Framework

  2. Open-source benchmark for browser AI agents on daily tasks.

    +246 (+23%) in 30d · Committed 16d ago · Python · Apache-2.0

    Shares Evaluation & Guardrails, Agent SDK / Framework

  3. Learning to Recover from LLM Agent Failures at Test Time

    +861 (+237%) in 30d · Committed yesterday · Python · MIT

    Shares Evaluation & Guardrails, Agent SDK / Framework

  4. Bring your own agent and build a self-improving agentic system. Automatically mine failures, optimize the…

    +5 (+0.9%) in 30d · Committed 66d ago · Python · MIT

    Shares Agent SDK / Framework, Evaluation & Guardrails

  5. Give a coding agent a brief, not a chat, and it works on its own across sessions. Includes an example run: an…

    +4 (+1.0%) in 30d · Committed 34d ago · TypeScript · MIT

    Shares Agent SDK / Framework, Evaluation & Guardrails

  6. An autonomous agent that profiles, optimizes, and validates AI training code.

    +319 (+409%) in 30d · Committed today · Python

    Shares Agent SDK / Framework, Evaluation & Guardrails

  7. 🔁 Improve your agent harness autonomously overnight

    +7 (+2.2%) in 30d · Committed 208d ago · Python · MIT

    Shares Agent SDK / Framework, Evaluation & Guardrails

  8. AgenticVBench: Can AI Agents Complete Real-World Post-Production Tasks?

    +2 (+1.8%) in 30d · Committed 43d ago · Python · Apache-2.0

    Shares Evaluation & Guardrails, Agent SDK / Framework

  9. Auto researching harness that burns through everything.

    Committed 4d ago · TypeScript · Apache-2.0

    Shares Agent SDK / Framework, Evaluation & Guardrails

  10. An Open Harness and Benchmark for AI in Cybersecurity Operations.

    +3 (+4.5%) in 30d · Committed 2d ago · Python · Apache-2.0

    Shares Evaluation & Guardrails, Agent SDK / Framework

Language
Python
License
MIT No Attribution
Contributors
11
Forks
32
Watchers
1
Open issues
4
Releases
0
Created
2026-06-26
Stars this week
+0

You've seen where sample-agent-cost-bench stands today.

Get the moves before everyone else: the 5 Evaluation & Guardrails repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain sample-agent-cost-bench?

Claim this page to add your own call-to-action.

Claim this page