Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
Nemotron-Pretraining-Code-v2
Datasets & benchmarksHugging Face dataset by nvidia
nvidia/Nemotron-Pretraining-Code-v2 -
code_contests
Datasets & benchmarksHugging Face dataset by deepmind
deepmind/code_contests -
Amazon-Reviews-2023
Datasets & benchmarksHugging Face dataset by McAuley-Lab
McAuley-Lab/Amazon-Reviews-2023 -
AICGSecEval
Datasets & benchmarksA.S.E (AICGSecEval) is a repository-level AI-generated code security evaluation benchmark developed by Tencent Wukong Code Security Team.
git clone https://github.com/Tencent/AICGSecEval.git -
AIRTBench-Code
Datasets & benchmarksCode Repository for: AIRTBench: Measuring Autonomous AI Red Teaming Capabilities in Language Models
git clone https://github.com/dreadnode/AIRTBench-Code.git -
multi-agents
Datasets & benchmarksMulti-agent teams for real work: run teams of coding agents (Claude Code, Codex, any model) in isolated git worktrees, and measure whether the team beats a solo agent on cost and results.
git clone https://github.com/BichengWang/multi-agents.git -
OSWorld
Datasets & benchmarks[NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
git clone https://github.com/xlang-ai/OSWorld.git -
jupyter-agent-dataset
Datasets & benchmarksHugging Face dataset by jupyter-agent
jupyter-agent/jupyter-agent-dataset -
ta-prompt
Datasets & benchmarksHugging Face dataset by bigcode
bigcode/ta-prompt -
WebSight
Datasets & benchmarksHugging Face dataset by HuggingFaceM4
HuggingFaceM4/WebSight -
the-stack
Datasets & benchmarksHugging Face dataset by bigcode
bigcode/the-stack -
explicit-edit-benchmark
Datasets & benchmarksBenchmark coding agents and agent harnesses on 226 deterministic file-editing tasks with byte-exact verification and a public leaderboard.
git clone https://github.com/alexshpunt/explicit-edit-benchmark.git -
OctoCodingBench
Datasets & benchmarksHugging Face dataset by MiniMaxAI
MiniMaxAI/OctoCodingBench -
ShareGPT-Chinese-English-90k
Datasets & benchmarksHugging Face dataset by shareAI
shareAI/ShareGPT-Chinese-English-90k -
GPT-5.5-Gemini-3.1-Pro-Grok-4-Claude-Fable-5-Mythos-5-Qwen-3.7-Max-and-more-Distillation-Dataset
Datasets & benchmarksHugging Face dataset by Manusagents
Manusagents/GPT-5.5-Gemini-3.1-Pro-Grok-4-Claude-Fable-5-Mythos-5-Qwen-3.7-Max-and-more-Distillation-Dataset -
Open-SWE-Traces
Datasets & benchmarksHugging Face dataset by nvidia
nvidia/Open-SWE-Traces -
Step-3.5-Flash-SFT
Datasets & benchmarksHugging Face dataset by stepfun-ai
stepfun-ai/Step-3.5-Flash-SFT -
apps
Datasets & benchmarksHugging Face dataset by codeparrot
codeparrot/apps -
SGI-Bench
Datasets & benchmarksProbing Scientific General Intelligence of LLMs with Scientist-Aligned Workflows
git clone https://github.com/InternScience/SGI-Bench.git -
Zero-To-CAD-1m
Datasets & benchmarksHugging Face dataset by ADSKAILab
ADSKAILab/Zero-To-CAD-1m -
CodeX-2M-Thinking
Datasets & benchmarksHugging Face dataset by Modotte
Modotte/CodeX-2M-Thinking -
zeta
Datasets & benchmarksHugging Face dataset by zed-industries
zed-industries/zeta -
AI-CUDA-Engineer-Archive
Datasets & benchmarksHugging Face dataset by SakanaAI
SakanaAI/AI-CUDA-Engineer-Archive -
prism
Datasets & benchmarksОткрытый бенчмарк LLM: какая нейросеть лучше пишет код 1С:Предприятие (BSL). Объективная оценка LLM по методике SMOP с реальным исполнением в 1С — Claude, GPT, Gemini, DeepSeek, YandexGPT, GigaChat.
git clone https://github.com/genlab-1c/prism.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.