Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
Looks like a goal we have a starting path for: I want to build an AI agent
-
ClawBench
Datasets & benchmarksOpen-source benchmark for browser AI agents on daily tasks.
git clone https://github.com/TIGER-AI-Lab/ClawBench.git -
AgentLab
Datasets & benchmarksAgentLab: An open-source framework for developing, testing, and benchmarking web agents on diverse tasks, designed for scalability and reproducibility.
git clone https://github.com/ServiceNow/AgentLab.git -
WebsiteBench
Datasets & benchmarksCan AI agents rebuild websites through browser exploration?
git clone https://github.com/TIGER-AI-Lab/WebsiteBench.git -
Mind2Web
Datasets & benchmarksHugging Face dataset by osunlp
osunlp/Mind2Web -
VIBE
Datasets & benchmarksHugging Face dataset by MiniMaxAI
MiniMaxAI/VIBE -
XYZ-Aquila-SFT
Datasets & benchmarksHugging Face dataset by XYZAILab
XYZAILab/XYZ-Aquila-SFT -
open-web-math
Datasets & benchmarksHugging Face dataset by open-web-math
open-web-math/open-web-math -
essential-web-v1.0
Datasets & benchmarksHugging Face dataset by EssentialAI
EssentialAI/essential-web-v1.0 -
Ultra-FineWeb
Datasets & benchmarksHugging Face dataset by openbmb
openbmb/Ultra-FineWeb -
cyber-security
Datasets & benchmarksHugging Face dataset by Vyber07
Vyber07/cyber-security -
UltraX-Preview
Datasets & benchmarksHugging Face dataset by openbmb
openbmb/UltraX-Preview -
Ultra-FineWeb-L1
Datasets & benchmarksHugging Face dataset by openbmb
openbmb/Ultra-FineWeb-L1 -
tau2-bench
Datasets & benchmarksτ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains
git clone https://github.com/sierra-research/tau2-bench.git -
nautilus-compass
Datasets & benchmarksOpen memory & reliability layer for AI agents + independent judging/verification (NACRE judge, caliber-bench meta-benchmark, preregistered criteria) — by Nautilus Platform
git clone https://github.com/chunxiaoxx/nautilus-compass.git -
OSWorld
Datasets & benchmarks[NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
git clone https://github.com/xlang-ai/OSWorld.git -
mobilegym
Datasets & benchmarks[EMNLP 2026] MobileGym: A Verifiable and Highly Parallel Simulation Platform for Mobile GUI Agent Research · 浏览器里运行的安卓模拟器 · Browser-hosted Android Simulator · Verifiable Evaluation · Scalable Online RL Training
git clone https://github.com/Purewhiter/mobilegym.git -
UltraData-SFT-Agent-2609
Datasets & benchmarksHugging Face dataset by openbmb
openbmb/UltraData-SFT-Agent-2609 -
meta-agents-research-environments
Datasets & benchmarksMeta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike static benchmarks, this platform introduces evolving environments where agents must adapt their strategies as new information becomes available, mirroring real-world challenges.
git clone https://github.com/facebookresearch/meta-agents-research-environments.git -
hermes-agent-reasoning-traces
Datasets & benchmarksHugging Face dataset by lambda
lambda/hermes-agent-reasoning-traces -
agents-last-exam
Datasets & benchmarksHugging Face dataset by agents-last-exam
agents-last-exam/agents-last-exam -
Nemotron-Agentic-v1
Datasets & benchmarksHugging Face dataset by nvidia
nvidia/Nemotron-Agentic-v1 -
TheAgentCompany
Datasets & benchmarksAn agent benchmark with tasks in a simulated software company.
git clone https://github.com/TheAgentCompany/TheAgentCompany.git -
AgentTrove
Datasets & benchmarksHugging Face dataset by open-thoughts
open-thoughts/AgentTrove -
pi-mono
Datasets & benchmarksHugging Face dataset by badlogicgames
badlogicgames/pi-mono
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.