sample-agent-cost-bench
Benchmark framework that measures cost, quality, and duration of coding agents across any AI Coding Assistant CLI, any model, and any use case — with pluggable verification and real-repo support.
aws-samples/sample-agent-cost-bench
View on GitHub ↗Benchmark framework that measures cost, quality, and duration of coding agents across any AI Coding Assistant CLI, any model, and any use case — with pluggable verification and real-repo support.
sample-agent-cost-bench grew +12.2% in the last 30 days, ranks 686th of 872 in Evaluation & Guardrails, actively maintained, last commit 4 days ago.
Star trajectory
76 days tracked+12.2% in 30d, above the Evaluation & Guardrails median of +1.4%.
Last commit 4 days ago, fresher than the median of 15d.
How it compares in Evaluation & Guardrails
Ranked 686th of 872 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere sample-agent-cost-bench sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
Official Repository for QuantHarness
+24 (+0.8%) in 30d · Committed 95d ago · HTML · MIT
Shares Evaluation & Guardrails, Agent SDK / Framework
Open-source benchmark for browser AI agents on daily tasks.
+246 (+23%) in 30d · Committed 16d ago · Python · Apache-2.0
Shares Evaluation & Guardrails, Agent SDK / Framework
Learning to Recover from LLM Agent Failures at Test Time
+861 (+237%) in 30d · Committed yesterday · Python · MIT
Shares Evaluation & Guardrails, Agent SDK / Framework
Bring your own agent and build a self-improving agentic system. Automatically mine failures, optimize the…
+5 (+0.9%) in 30d · Committed 66d ago · Python · MIT
Shares Agent SDK / Framework, Evaluation & Guardrails
Give a coding agent a brief, not a chat, and it works on its own across sessions. Includes an example run: an…
+4 (+1.0%) in 30d · Committed 34d ago · TypeScript · MIT
Shares Agent SDK / Framework, Evaluation & Guardrails
An autonomous agent that profiles, optimizes, and validates AI training code.
+319 (+409%) in 30d · Committed today · Python
Shares Agent SDK / Framework, Evaluation & Guardrails
🔁 Improve your agent harness autonomously overnight
+7 (+2.2%) in 30d · Committed 208d ago · Python · MIT
Shares Agent SDK / Framework, Evaluation & Guardrails
AgenticVBench: Can AI Agents Complete Real-World Post-Production Tasks?
+2 (+1.8%) in 30d · Committed 43d ago · Python · Apache-2.0
Shares Evaluation & Guardrails, Agent SDK / Framework
Auto researching harness that burns through everything.
Committed 4d ago · TypeScript · Apache-2.0
Shares Agent SDK / Framework, Evaluation & Guardrails
An Open Harness and Benchmark for AI in Cybersecurity Operations.
+3 (+4.5%) in 30d · Committed 2d ago · Python · Apache-2.0
Shares Evaluation & Guardrails, Agent SDK / Framework
- Language
- Python
- License
- MIT No Attribution
- Contributors
- 11
- Forks
- 32
- Watchers
- 1
- Open issues
- 4
- Releases
- 0
- Created
- 2026-06-26
- Stars this week
- +0
You've seen where sample-agent-cost-bench stands today.
Get the moves before everyone else: the 5 Evaluation & Guardrails repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.