embodied-first-exam
The first exam for code agents in the physical world: frozen robot tasks from many benchmark suites, each answered with a program and verified in a separate sandbox. Runs on Harbor.
Open the source (opens github.com) https://github.com/mll-lab-nu/embodied-first-exam
What it is
Agents & frameworks from mll-lab-nu.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Get the code
git clone https://github.com/mll-lab-nu/embodied-first-exam.git
Standard git access to a public repository
Setup steps: not provided by the source. Follow the instructions on the source.
Related
-
CaPtain
Agents & frameworksCaPtain: A Pipeline for Post-Training Code-as-Policy Robot Agents — CaPtain-Harness, SFT and RL training code, benchmark adapters
git clone https://github.com/waltstephen/CaPtain.git -
cs249r_book
Agents & frameworksMachine Learning Systems: Foundations, Scaling, Agentic AI, and Physical AI (Vols I–IV) • Harvard CS249r | https://mlsysbook.ai
git clone https://github.com/harvard-edge/cs249r_book.git -
agy-staff
Agents & frameworksHire Google's Antigravity CLI (agy) as a fast Gemini staffer for Claude Code, OpenAI Codex, and DeepSeek Harness.
git clone https://github.com/keli-wen/agy-staff.git -
OpenHands
Agents & frameworksAn open-source platform for software-development agents that write code, run commands and browse.
-
overtime
Agents & frameworksGive a coding agent a brief, not a chat, and it works on its own across sessions. Includes an example run: an open-world city built in a real game engine with no human help. In early development.
git clone https://github.com/ukanwat/overtime.git -
AlgoTune
Agents & frameworksAlgoTune is a NeurIPS 2025 benchmark made up of 154 math, physics, and computer science problems. The goal is write code that solves each problem, and is faster than existing implementations.
git clone https://github.com/oripress/AlgoTune.git