CommerceAgentBench

CommerceAgentBench: Benchmarking Long-Horizon Agents in High-Fidelity, Stateful, and Reproducible Replicas of Real Online Services

Accio-org/CommerceAgentBench

View on GitHub ↗

CommerceAgentBench: Benchmarking Long-Horizon Agents in High-Fidelity, Stateful, and Reproducible Replicas of Real Online Services

CommerceAgentBench grew +0.9% in the last 30 days, ranks 113th of 872 in Evaluation & Guardrails, last commit 85 days ago.

Star trajectory

82 days tracked
2026-08-311.3k stars today2026-11-22
Momentum

+0.9% in 30d, below the Evaluation & Guardrails median of +1.4%.

Maintenance

Last commit 85 days ago, staler than the median of 15d.

How it compares in Evaluation & Guardrails

CommerceAgentBench
1.3k
stars
+0.9% 30d
commit 85 days ago
Evaluation & Guardrails median
235
stars
+1.4% 30d
commit ~15d ago
Leader · impeccable
114.7k
stars
+0.0% 30d
commit today

Ranked 113th of 872 by stars.

Ranked by shared tags, then keywords, then stars
  1. Open source evals for physical AI. Run any LLM/VLA on any arm/humanoid against any real/sim benchmark.

    +77 (+11%) in 30d · Committed 10d ago · Python · MIT

    Shares Evaluation & Guardrails, RL Environments

  2. A framework for building synthetic worlds for AI agents. Useful for RL and evaluation environments.

    +0 (+0.0%) in 30d · Committed 3d ago · Python · MIT

    Shares RL Environments, Evaluation & Guardrails

  3. ExploitBench measures how far AI agents climb, from reaching vulnerable code, to triggering the bug, to…

    +17 (+3.9%) in 30d · Committed 141d ago · Python · MIT

    Shares RL Environments, Evaluation & Guardrails

  4. Creating realistic RL environments requires collaboration between researchers, engineers, and domain experts…

    +87 (+24%) in 30d · Committed today · Python · Apache-2.0

    Shares RL Environments, Evaluation & Guardrails

  5. An agentic robotics benchmark for coding agents: 1,156 robot tasks in 35 suites on 47 robots, each answered…

    Committed today · Python · MIT

    Shares RL Environments, Evaluation & Guardrails

  6. Harness for running and evaluating AI agents against RL environments

    +16 (+5.5%) in 30d · Committed today · Python · Apache-2.0

    Shares Evaluation & Guardrails, RL Environments

  7. [Public preview] Externally scored agentic ML research benchmark: 60 tasks, real competition ground truth…

    +0 (+0.0%) in 30d · Committed 58d ago · Python · Apache-2.0

    Shares RL Environments, Evaluation & Guardrails

  8. Open-source benchmark for browser AI agents on daily tasks.

    +246 (+23%) in 30d · Committed 16d ago · Python · Apache-2.0

    Shares Evaluation & Guardrails

  9. [EMNLP 2026] MobileGym: A Verifiable and Highly Parallel Simulation Platform for Mobile GUI Agent Research ·…

    +37 (+4.4%) in 30d · Committed 5d ago · Python · Apache-2.0

    Shares RL Environments

  10. AI-powered E2E testing for 10 platforms. 253 MCP tools. Zero config. Works with Claude, Cursor, Windsurf…

    +18 (+4.6%) in 30d · Committed 81d ago · Dart · MIT

    Shares Evaluation & Guardrails

Language
HTML
License
Apache License 2.0
Contributors
4
Forks
72
Watchers
1
Open issues
1
Releases
0
Created
2026-08-02
Stars this week
+2

You've seen where CommerceAgentBench stands today.

Get the moves before everyone else: the 5 Evaluation & Guardrails repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain CommerceAgentBench?

Claim this page to add your own call-to-action.

Claim this page