InnerVault

embodied-first-exam

Stale GitHub, mll-lab-nu

The first exam for code agents in the physical world: frozen robot tasks from many benchmark suites, each answered with a program and verified in a separate sandbox. Runs on Harbor.

Open the source (opens github.com) https://github.com/mll-lab-nu/embodied-first-exam

What it is

Agents & frameworks from mll-lab-nu.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/mll-lab-nu/embodied-first-exam.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. CaPtain

    Agents & frameworks

    CaPtain: A Pipeline for Post-Training Code-as-Policy Robot Agents — CaPtain-Harness, SFT and RL training code, benchmark adapters

    Indexed GitHub, waltstephen 96 ★MITUpdated 6 days ago

    git clone https://github.com/waltstephen/CaPtain.git
  2. cs249r_book

    Agents & frameworks

    Machine Learning Systems: Foundations, Scaling, Agentic AI, and Physical AI (Vols I–IV) • Harvard CS249r | https://mlsysbook.ai

    Stale GitHub, harvard-edge 30.0k ★Custom licence (see repository)Updated 11 days ago

    git clone https://github.com/harvard-edge/cs249r_book.git
  3. agy-staff

    Agents & frameworks

    Hire Google's Antigravity CLI (agy) as a fast Gemini staffer for Claude Code, OpenAI Codex, and DeepSeek Harness.

    Indexed GitHub, keli-wen 860 ★MITUpdated 4 days ago

    git clone https://github.com/keli-wen/agy-staff.git
  4. OpenHands

    Agents & frameworks

    An open-source platform for software-development agents that write code, run commands and browse.

    Hand-checked InnerVault (hand-checked), OpenHands 93.5k ★MIT

  5. overtime

    Agents & frameworks

    Give a coding agent a brief, not a chat, and it works on its own across sessions. Includes an example run: an open-world city built in a real game engine with no human help. In early development.

    Stale GitHub, ukanwat 399 ★MITUpdated 30 days ago

    git clone https://github.com/ukanwat/overtime.git
  6. AlgoTune

    Agents & frameworks

    AlgoTune is a NeurIPS 2025 benchmark made up of 154 math, physics, and computer science problems. The goal is write code that solves each problem, and is faster than existing implementations.

    Stale GitHub, oripress 118 ★MITUpdated 4 months ago

    git clone https://github.com/oripress/AlgoTune.git