embodied-first-exam
An agentic robotics benchmark for coding agents: 1,156 robot tasks in 35 suites on 47 robots, each answered with a program and verified in a separate sandbox. Runs on Harbor.
mll-lab-nu/embodied-first-exam
View on GitHub ↗An agentic robotics benchmark for coding agents: 1,156 robot tasks in 35 suites on 47 robots, each answered with a program and verified in a separate sandbox. Runs on Harbor.
embodied-first-exam ranks 44th of 80 in RL Environments, actively maintained, last commit today.
Star trajectory
23 days tracked- in 30d, below the RL Environments median of +0.7%.
Last commit today, fresher than the median of 122d.
How it compares in RL Environments
Ranked 44th of 80 by stars.
Related repos
Ranked by shared tags, then keywords, then starsWhere embodied-first-exam sits
Hover or focus a node for details. Click to open it.
- This repo
- Related repo
- Tag or category
Open source evals for physical AI. Run any LLM/VLA on any arm/humanoid against any real/sim benchmark.
+77 (+11%) in 30d · Committed 10d ago · Python · MIT
Shares Evaluation & Guardrails, RL Environments
CommerceAgentBench: Benchmarking Long-Horizon Agents in High-Fidelity, Stateful, and Reproducible Replicas of…
+12 (+0.9%) in 30d · Committed 85d ago · HTML · Apache-2.0
Shares Evaluation & Guardrails, RL Environments
ExploitBench measures how far AI agents climb, from reaching vulnerable code, to triggering the bug, to…
+17 (+3.9%) in 30d · Committed 141d ago · Python · MIT
Shares RL Environments, Evaluation & Guardrails
Creating realistic RL environments requires collaboration between researchers, engineers, and domain experts…
+87 (+24%) in 30d · Committed today · Python · Apache-2.0
Shares RL Environments, Evaluation & Guardrails
Harness for running and evaluating AI agents against RL environments
+16 (+5.5%) in 30d · Committed today · Python · Apache-2.0
Shares Evaluation & Guardrails, RL Environments
[Public preview] Externally scored agentic ML research benchmark: 60 tasks, real competition ground truth…
+0 (+0.0%) in 30d · Committed 58d ago · Python · Apache-2.0
Shares RL Environments, Evaluation & Guardrails
A framework for building synthetic worlds for AI agents. Useful for RL and evaluation environments.
+0 (+0.0%) in 30d · Committed 3d ago · Python · MIT
Shares RL Environments, Evaluation & Guardrails
A unified framework for building, evaluating, and recursively improving embodied agents. 🚀 Code release…
+630 (+251%) in 30d · Committed yesterday · Python · Apache-2.0
Shares RL Environments
BenchMARL is a library for benchmarking Multi-Agent Reinforcement Learning (MARL). BenchMARL allows to quickly…
+12 (+1.8%) in 30d · Committed 287d ago · Python · MIT
Shares RL Environments
Give a coding agent a brief, not a chat, and it works on its own across sessions. Includes an example run: an…
+4 (+1.0%) in 30d · Committed 34d ago · TypeScript · MIT
Shares Evaluation & Guardrails
- Language
- Python
- License
- MIT License
- Contributors
- 8
- Forks
- 18
- Watchers
- 0
- Open issues
- 3
- Releases
- 1
- Created
- 2026-09-18
- Stars this week
- +32
You've seen where embodied-first-exam stands today.
Get the moves before everyone else: the 5 RL Environments repos climbing fastest, every Tuesday.
Free weekly digest. Double opt-in, unsubscribe anytime.