Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
openbench
Datasets & benchmarksSame model, different wrapper: a from-scratch benchmark comparing coding-agent harnesses (codex, pi, opencode, cursor, devin) and open models on correctness, speed, and token cost
git clone https://github.com/minghinmatthewlam/openbench.git -
seo-skill-bench
Datasets & benchmarksOpen benchmark for Claude Code SEO skills — real headless execution against fixture sites with planted-defect answer keys. Deterministic scoring, pre-registered rubric.
git clone https://github.com/aleclindz/seo-skill-bench.git -
CodeAlpaca-20k
Datasets & benchmarksHugging Face dataset by sahil2801
sahil2801/CodeAlpaca-20k -
LoopArena
Datasets & benchmarksBenchmarking models as runtime Controllers for Loop Engineering
git clone https://github.com/AMAP-ML/LoopArena.git -
doc2harness
Datasets & benchmarksOfficial Code for the paper "Doc2Harness: Benchmarking LLMs on Long-Horizon Harness Engineering of Coding Agents "
git clone https://github.com/YuyaoGe/doc2harness.git -
xlam-function-calling-60k
Datasets & benchmarksHugging Face dataset by Salesforce
Salesforce/xlam-function-calling-60k -
OpenThoughts3-1.2M
Datasets & benchmarksHugging Face dataset by open-thoughts
open-thoughts/OpenThoughts3-1.2M -
openai_humaneval
Datasets & benchmarksHugging Face dataset by openai
openai/openai_humaneval -
OpenMathInstruct-1
Datasets & benchmarksHugging Face dataset by nvidia
nvidia/OpenMathInstruct-1 -
evol-codealpaca-v1
Datasets & benchmarksHugging Face dataset by theblackcat102
theblackcat102/evol-codealpaca-v1 -
LaTeX_OCR
Datasets & benchmarksHugging Face dataset by linxy
linxy/LaTeX_OCR -
the-stack-dedup
Datasets & benchmarksHugging Face dataset by bigcode
bigcode/the-stack-dedup -
synthetic_text_to_sql
Datasets & benchmarksHugging Face dataset by gretelai
gretelai/synthetic_text_to_sql -
Turing-Open-Reasoning
Datasets & benchmarksHugging Face dataset by TuringEnterprises
TuringEnterprises/Turing-Open-Reasoning -
CodeFeedback-Filtered-Instruction
Datasets & benchmarksHugging Face dataset by m-a-p
m-a-p/CodeFeedback-Filtered-Instruction -
AM-DeepSeek-R1-Distilled-1.4M
Datasets & benchmarksHugging Face dataset by a-m-team
a-m-team/AM-DeepSeek-R1-Distilled-1.4M -
Nemotron-Terminal-Corpus
Datasets & benchmarksHugging Face dataset by nvidia
nvidia/Nemotron-Terminal-Corpus -
VIBE
Datasets & benchmarksHugging Face dataset by MiniMaxAI
MiniMaxAI/VIBE -
SWE-rebench-openhands-trajectories
Datasets & benchmarksHugging Face dataset by nebius
nebius/SWE-rebench-openhands-trajectories -
nautilus-compass
Datasets & benchmarksOpen memory & reliability layer for AI agents + independent judging/verification (NACRE judge, caliber-bench meta-benchmark, preregistered criteria) — by Nautilus Platform
git clone https://github.com/chunxiaoxx/nautilus-compass.git -
agent-duel
Datasets & benchmarksBlinded battles between coding agents: two agents, one prompt, you pick the winner. Desktop app, runs locally.
git clone https://github.com/bottomless/agent-duel.git -
MegaMath
Datasets & benchmarksHugging Face dataset by IFM
IFM/MegaMath -
Fable-5.1-Max-Reasoning-Filtered-10000x
Datasets & benchmarksHugging Face dataset by MoreThought
MoreThought/Fable-5.1-Max-Reasoning-Filtered-10000x -
UltraData-RL-2609
Datasets & benchmarksHugging Face dataset by openbmb
openbmb/UltraData-RL-2609
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.