InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

Looks like a goal we have a starting path for: I want to build an AI agent

  1. tau2-bench

    Datasets & benchmarks

    τ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains

    Indexed GitHub, sierra-research 2,442 ★MITUpdated 6 days ago

    git clone https://github.com/sierra-research/tau2-bench.git
  2. ClawBench

    Datasets & benchmarks

    Open-source benchmark for browser AI agents on daily tasks.

    Stale GitHub, TIGER-AI-Lab 1,229 ★Apache-2.0Updated 11 days ago

    git clone https://github.com/TIGER-AI-Lab/ClawBench.git
  3. AgentLab

    Datasets & benchmarks

    AgentLab: An open-source framework for developing, testing, and benchmarking web agents on diverse tasks, designed for scalability and reproducibility.

    Stale GitHub, ServiceNow 653 ★Custom licence (see repository)Updated 41 days ago

    git clone https://github.com/ServiceNow/AgentLab.git
  4. nautilus-compass

    Datasets & benchmarks

    Open memory & reliability layer for AI agents + independent judging/verification (NACRE judge, caliber-bench meta-benchmark, preregistered criteria) — by Nautilus Platform

    Indexed GitHub, chunxiaoxx 1,258 ★Custom licence (see repository)Updated 2 days ago

    git clone https://github.com/chunxiaoxx/nautilus-compass.git
  5. OSWorld

    Datasets & benchmarks

    [NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

    Indexed GitHub, xlang-ai 3,262 ★Apache-2.0Updated 2 days ago

    git clone https://github.com/xlang-ai/OSWorld.git
  6. mobilegym

    Datasets & benchmarks

    [EMNLP 2026] MobileGym: A Verifiable and Highly Parallel Simulation Platform for Mobile GUI Agent Research · 浏览器里运行的安卓模拟器 · Browser-hosted Android Simulator · Verifiable Evaluation · Scalable Online RL Training

    Indexed GitHub, Purewhiter 866 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/Purewhiter/mobilegym.git
  7. UltraData-SFT-Agent-2609

    Datasets & benchmarks

    Hugging Face dataset by openbmb

    Indexed Hugging Face Hub, openbmb 322 ♥apache-2.0Updated 2 months ago

    openbmb/UltraData-SFT-Agent-2609
  8. meta-agents-research-environments

    Datasets & benchmarks

    Meta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike static benchmarks, this platform introduces evolving environments where agents must adapt their strategies as new information becomes available, mirroring real-world challenges.

    Stale GitHub, facebookresearch 567 ★MITUpdated 47 days ago

    git clone https://github.com/facebookresearch/meta-agents-research-environments.git
  9. hermes-agent-reasoning-traces

    Datasets & benchmarks

    Hugging Face dataset by lambda

    Indexed Hugging Face Hub, lambda 394 ♥apache-2.0Updated 7 months ago

    lambda/hermes-agent-reasoning-traces
  10. agents-last-exam

    Datasets & benchmarks

    Hugging Face dataset by agents-last-exam

    Stale Hugging Face Hub, agents-last-exam 225 ♥cc-by-4.0Updated 33 days ago

    agents-last-exam/agents-last-exam
  11. Nemotron-Agentic-v1

    Datasets & benchmarks

    Hugging Face dataset by nvidia

    Stale Hugging Face Hub, nvidia 189 ♥cc-by-4.0Updated 11 months ago

    nvidia/Nemotron-Agentic-v1
  12. TheAgentCompany

    Datasets & benchmarks

    An agent benchmark with tasks in a simulated software company.

    Stale GitHub, TheAgentCompany 795 ★MITUpdated 12 months ago

    git clone https://github.com/TheAgentCompany/TheAgentCompany.git
  13. AgentTrove

    Datasets & benchmarks

    Hugging Face dataset by open-thoughts

    Stale Hugging Face Hub, open-thoughts 202 ♥apache-2.0Updated 6 months ago

    open-thoughts/AgentTrove
  14. pi-mono

    Datasets & benchmarks

    Hugging Face dataset by badlogicgames

    Stale Hugging Face Hub, badlogicgames 219 ♥otherUpdated 7 months ago

    badlogicgames/pi-mono
  15. claude-fable-5-claude-code

    Datasets & benchmarks

    Hugging Face dataset by armand0e

    Indexed Hugging Face Hub, armand0e 416 ♥mitUpdated 2 months ago

    armand0e/claude-fable-5-claude-code
  16. jupyter-agent-dataset

    Datasets & benchmarks

    Hugging Face dataset by jupyter-agent

    Stale Hugging Face Hub, jupyter-agent 177 ♥apache-2.0Updated 14 months ago

    jupyter-agent/jupyter-agent-dataset
  17. ai-village

    Datasets & benchmarks

    Hugging Face dataset by aidigestorg

    Stale Hugging Face Hub, aidigestorg 138 ♥otherUpdated 40 days ago 1 note

    aidigestorg/ai-village
  18. ClawProBench

    Datasets & benchmarks

    ClawProBench is a live-first benchmark harness for evaluating LLM agents in the OpenClaw runtime with deterministic grading and repeated-trial reliability.

    Stale GitHub, suyoumo 825 ★Apache-2.0Updated 2 months ago

    git clone https://github.com/suyoumo/ClawProBench.git
  19. apex-agents

    Datasets & benchmarks

    Hugging Face dataset by mercor

    Stale Hugging Face Hub, mercor 207 ♥cc-by-4.0Updated 5 months ago 1 note

    mercor/apex-agents
  20. FDE-Gym

    Datasets & benchmarks

    Hugging Face dataset by DeepLethe

    Stale Hugging Face Hub, DeepLethe 437 ♥otherUpdated 31 days ago 1 note

    DeepLethe/FDE-Gym
  21. OSWorld-V2

    Datasets & benchmarks

    OSWorld 2.0: Benchmarking Computer Use Agents on Long-Horizon Real-World Tasks

    Indexed GitHub, xlang-ai 421 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/xlang-ai/OSWorld-V2.git
  22. multi-agents

    Datasets & benchmarks

    Multi-agent teams for real work: run teams of coding agents (Claude Code, Codex, any model) in isolated git worktrees, and measure whether the team beats a solo agent on cost and results.

    Stale GitHub, BichengWang 158 ★MITUpdated 8 days ago

    git clone https://github.com/BichengWang/multi-agents.git
  23. WebsiteBench

    Datasets & benchmarks

    Can AI agents rebuild websites through browser exploration?

    Indexed GitHub, TIGER-AI-Lab 300 ★Apache-2.0Updated 6 days ago

    git clone https://github.com/TIGER-AI-Lab/WebsiteBench.git
  24. Awesome-AI4AI

    Datasets & benchmarks

    Updated weekly — until humanity achieves AI4AI. 1148 curated papers across Benchmarks, Harness Design, and Model Design — from long-horizon agents to recursive self-improvement. Citation rankings, GitHub stars, and source-verified weekly news.

    Stale GitHub, KaiWU5 218 ★MITUpdated 8 days ago

    git clone https://github.com/KaiWU5/Awesome-AI4AI.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.