Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
SWE-bench-Live
Datasets & benchmarks[NeurIPS 2025 D&B] 🚀 SWE-bench Goes Live!
git clone https://github.com/microsoft/SWE-bench-Live.git -
swe-sweep
Datasets & benchmarksHow many bugs can LMs find & fix in large codebases?
git clone https://github.com/facebookresearch/swe-sweep.git -
SWE-bench_Verified
Datasets & benchmarksHugging Face dataset by SWE-bench
SWE-bench/SWE-bench_Verified -
SWE-bench_Verified
Datasets & benchmarksHugging Face dataset by princeton-nlp
princeton-nlp/SWE-bench_Verified -
Open-SWE-Traces
Datasets & benchmarksHugging Face dataset by nvidia
nvidia/Open-SWE-Traces -
SWE-ZERO-12M-trajectories
Datasets & benchmarksHugging Face dataset by AlienKevin
AlienKevin/SWE-ZERO-12M-trajectories -
SWE-bench
Datasets & benchmarksHugging Face dataset by princeton-nlp
princeton-nlp/SWE-bench -
SWE-bench_Pro
Datasets & benchmarksHugging Face dataset by ScaleAI
ScaleAI/SWE-bench_Pro -
SWE-rebench-openhands-trajectories
Datasets & benchmarksHugging Face dataset by nebius
nebius/SWE-rebench-openhands-trajectories -
WebsiteBench
Datasets & benchmarksCan AI agents rebuild websites through browser exploration?
git clone https://github.com/TIGER-AI-Lab/WebsiteBench.git -
self-bench
Datasets & benchmarksBenchmark coding agents and models on your own repository with private Harbor-formatted evals built from its merged pull requests.
git clone https://github.com/mupt-ai/self-bench.git -
multi-agents
Datasets & benchmarksMulti-agent teams for real work: run teams of coding agents (Claude Code, Codex, any model) in isolated git worktrees, and measure whether the team beats a solo agent on cost and results.
git clone https://github.com/BichengWang/multi-agents.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.