embodied-first-exam

An agentic robotics benchmark for coding agents: 1,156 robot tasks in 35 suites on 47 robots, each answered with a program and verified in a separate sandbox. Runs on Harbor.

mll-lab-nu/embodied-first-exam

View on GitHub ↗

An agentic robotics benchmark for coding agents: 1,156 robot tasks in 35 suites on 47 robots, each answered with a program and verified in a separate sandbox. Runs on Harbor.

embodied-first-exam ranks 44th of 80 in RL Environments, actively maintained, last commit today.

Star trajectory

23 days tracked
2026-10-30309 stars today2026-11-22
Momentum

- in 30d, below the RL Environments median of +0.7%.

Maintenance

Last commit today, fresher than the median of 122d.

How it compares in RL Environments

embodied-first-exam
309
stars
- 30d
commit today
RL Environments median
318.5
stars
+0.7% 30d
commit ~122d ago
Leader · RAGEN
2.9k
stars
+0.9% 30d
commit 24 days ago

Ranked 44th of 80 by stars.

Ranked by shared tags, then keywords, then stars
  1. Open source evals for physical AI. Run any LLM/VLA on any arm/humanoid against any real/sim benchmark.

    +77 (+11%) in 30d · Committed 10d ago · Python · MIT

    Shares Evaluation & Guardrails, RL Environments

  2. CommerceAgentBench: Benchmarking Long-Horizon Agents in High-Fidelity, Stateful, and Reproducible Replicas of…

    +12 (+0.9%) in 30d · Committed 85d ago · HTML · Apache-2.0

    Shares Evaluation & Guardrails, RL Environments

  3. ExploitBench measures how far AI agents climb, from reaching vulnerable code, to triggering the bug, to…

    +17 (+3.9%) in 30d · Committed 141d ago · Python · MIT

    Shares RL Environments, Evaluation & Guardrails

  4. Creating realistic RL environments requires collaboration between researchers, engineers, and domain experts…

    +87 (+24%) in 30d · Committed today · Python · Apache-2.0

    Shares RL Environments, Evaluation & Guardrails

  5. Harness for running and evaluating AI agents against RL environments

    +16 (+5.5%) in 30d · Committed today · Python · Apache-2.0

    Shares Evaluation & Guardrails, RL Environments

  6. [Public preview] Externally scored agentic ML research benchmark: 60 tasks, real competition ground truth…

    +0 (+0.0%) in 30d · Committed 58d ago · Python · Apache-2.0

    Shares RL Environments, Evaluation & Guardrails

  7. A framework for building synthetic worlds for AI agents. Useful for RL and evaluation environments.

    +0 (+0.0%) in 30d · Committed 3d ago · Python · MIT

    Shares RL Environments, Evaluation & Guardrails

  8. A unified framework for building, evaluating, and recursively improving embodied agents. 🚀 Code release…

    +630 (+251%) in 30d · Committed yesterday · Python · Apache-2.0

    Shares RL Environments

  9. BenchMARL is a library for benchmarking Multi-Agent Reinforcement Learning (MARL). BenchMARL allows to quickly…

    +12 (+1.8%) in 30d · Committed 287d ago · Python · MIT

    Shares RL Environments

  10. Give a coding agent a brief, not a chat, and it works on its own across sessions. Includes an example run: an…

    +4 (+1.0%) in 30d · Committed 34d ago · TypeScript · MIT

    Shares Evaluation & Guardrails

Language
Python
License
MIT License
Contributors
8
Forks
18
Watchers
0
Open issues
3
Releases
1
Created
2026-09-18
Stars this week
+32

You've seen where embodied-first-exam stands today.

Get the moves before everyone else: the 5 RL Environments repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain embodied-first-exam?

Claim this page to add your own call-to-action.

Claim this page