Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
TACO
Datasets & benchmarksHugging Face dataset by BAAI
BAAI/TACO -
Nemotron-Pretraining-Code-v2
Datasets & benchmarksHugging Face dataset by nvidia
nvidia/Nemotron-Pretraining-Code-v2 -
code_contests
Datasets & benchmarksHugging Face dataset by deepmind
deepmind/code_contests -
CodeAlpaca-20k
Datasets & benchmarksHugging Face dataset by sahil2801
sahil2801/CodeAlpaca-20k -
multi-agents
Datasets & benchmarksMulti-agent teams for real work: run teams of coding agents (Claude Code, Codex, any model) in isolated git worktrees, and measure whether the team beats a solo agent on cost and results.
git clone https://github.com/BichengWang/multi-agents.git -
apps
Datasets & benchmarksHugging Face dataset by codeparrot
codeparrot/apps -
CodeX-2M-Thinking
Datasets & benchmarksHugging Face dataset by Modotte
Modotte/CodeX-2M-Thinking -
evol-codealpaca-v1
Datasets & benchmarksHugging Face dataset by theblackcat102
theblackcat102/evol-codealpaca-v1 -
AIRTBench-Code
Datasets & benchmarksCode Repository for: AIRTBench: Measuring Autonomous AI Red Teaming Capabilities in Language Models
git clone https://github.com/dreadnode/AIRTBench-Code.git -
CodeFeedback-Filtered-Instruction
Datasets & benchmarksHugging Face dataset by m-a-p
m-a-p/CodeFeedback-Filtered-Instruction -
OSWorld
Datasets & benchmarks[NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
git clone https://github.com/xlang-ai/OSWorld.git -
jupyter-agent-dataset
Datasets & benchmarksHugging Face dataset by jupyter-agent
jupyter-agent/jupyter-agent-dataset -
ta-prompt
Datasets & benchmarksHugging Face dataset by bigcode
bigcode/ta-prompt -
WebSight
Datasets & benchmarksHugging Face dataset by HuggingFaceM4
HuggingFaceM4/WebSight -
the-stack
Datasets & benchmarksHugging Face dataset by bigcode
bigcode/the-stack -
OctoCodingBench
Datasets & benchmarksHugging Face dataset by MiniMaxAI
MiniMaxAI/OctoCodingBench -
ShareGPT-Chinese-English-90k
Datasets & benchmarksHugging Face dataset by shareAI
shareAI/ShareGPT-Chinese-English-90k -
GPT-5.5-Gemini-3.1-Pro-Grok-4-Claude-Fable-5-Mythos-5-Qwen-3.7-Max-and-more-Distillation-Dataset
Datasets & benchmarksHugging Face dataset by Manusagents
Manusagents/GPT-5.5-Gemini-3.1-Pro-Grok-4-Claude-Fable-5-Mythos-5-Qwen-3.7-Max-and-more-Distillation-Dataset -
Open-SWE-Traces
Datasets & benchmarksHugging Face dataset by nvidia
nvidia/Open-SWE-Traces -
explicit-edit-benchmark
Datasets & benchmarksBenchmark coding agents and agent harnesses on 226 deterministic file-editing tasks with byte-exact verification and a public leaderboard.
git clone https://github.com/alexshpunt/explicit-edit-benchmark.git -
Step-3.5-Flash-SFT
Datasets & benchmarksHugging Face dataset by stepfun-ai
stepfun-ai/Step-3.5-Flash-SFT -
openbench
Datasets & benchmarksSame model, different wrapper: a from-scratch benchmark comparing coding-agent harnesses (codex, pi, opencode, cursor, devin) and open models on correctness, speed, and token cost
git clone https://github.com/minghinmatthewlam/openbench.git -
SGI-Bench
Datasets & benchmarksProbing Scientific General Intelligence of LLMs with Scientist-Aligned Workflows
git clone https://github.com/InternScience/SGI-Bench.git -
Zero-To-CAD-1m
Datasets & benchmarksHugging Face dataset by ADSKAILab
ADSKAILab/Zero-To-CAD-1m
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.