Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
react-code-instructions
Datasets & benchmarksHugging Face dataset by cfahlgren1
cfahlgren1/react-code-instructions -
dataclaw-peteromallet
Datasets & benchmarksHugging Face dataset by peteromallet
peteromallet/dataclaw-peteromallet -
claude-fable-5-claude-code
Datasets & benchmarksHugging Face dataset by armand0e
armand0e/claude-fable-5-claude-code -
ParseBench
Datasets & benchmarksHugging Face dataset by llamaindex
llamaindex/ParseBench -
stack-v3-train
Datasets & benchmarksHugging Face dataset by HuggingFaceCode
HuggingFaceCode/stack-v3-train -
python-codes-25k
Datasets & benchmarksHugging Face dataset by flytech
flytech/python-codes-25k -
DyCodeEval
Datasets & benchmarksOfficial repository of the ICML2025 paper “Dynamic Benchmarking of Reasoning Capabilities in Code Large Language Models Under Data Contamination”
git clone https://github.com/SeekingDream/DyCodeEval.git -
Vibe-Coding-Instruct
Datasets & benchmarksHugging Face dataset by CodeDevX
CodeDevX/Vibe-Coding-Instruct -
starcoderdata
Datasets & benchmarksHugging Face dataset by bigcode
bigcode/starcoderdata -
sec-code-bench
Datasets & benchmarksSecCodeBench is a benchmark suite focusing on evaluating the security of code generated by large language models (LLMs).
git clone https://github.com/alibaba/sec-code-bench.git -
UltraTextbooks
Datasets & benchmarksHugging Face dataset by Locutusque
Locutusque/UltraTextbooks -
the-stack-v2
Datasets & benchmarksHugging Face dataset by bigcode
bigcode/the-stack-v2 -
Awesome-LLM-Eval
Datasets & benchmarksAwesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, leaderboard, papers, docs and models, mainly for Evaluation on LLMs. 一个由工具、基准/数据、演示、排行榜和大模型等组成的精选列表,主要面向基础大模型评测,旨在探求生成式AI的技术边界.
git clone https://github.com/onejune2018/Awesome-LLM-Eval.git -
VisualNews-Repository
Datasets & benchmarks[EMNLP'21] Visual News: Benchmark and Challenges in News Image Captioning
git clone https://github.com/FuxiaoLiu/VisualNews-Repository.git -
TACO
Datasets & benchmarksHugging Face dataset by BAAI
BAAI/TACO -
Nemotron-Pretraining-Code-v2
Datasets & benchmarksHugging Face dataset by nvidia
nvidia/Nemotron-Pretraining-Code-v2 -
code_contests
Datasets & benchmarksHugging Face dataset by deepmind
deepmind/code_contests -
AICGSecEval
Datasets & benchmarksA.S.E (AICGSecEval) is a repository-level AI-generated code security evaluation benchmark developed by Tencent Wukong Code Security Team.
git clone https://github.com/Tencent/AICGSecEval.git -
AIRTBench-Code
Datasets & benchmarksCode Repository for: AIRTBench: Measuring Autonomous AI Red Teaming Capabilities in Language Models
git clone https://github.com/dreadnode/AIRTBench-Code.git -
multi-agents
Datasets & benchmarksMulti-agent teams for real work: run teams of coding agents (Claude Code, Codex, any model) in isolated git worktrees, and measure whether the team beats a solo agent on cost and results.
git clone https://github.com/BichengWang/multi-agents.git -
OSWorld
Datasets & benchmarks[NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
git clone https://github.com/xlang-ai/OSWorld.git -
jupyter-agent-dataset
Datasets & benchmarksHugging Face dataset by jupyter-agent
jupyter-agent/jupyter-agent-dataset -
ta-prompt
Datasets & benchmarksHugging Face dataset by bigcode
bigcode/ta-prompt -
WebSight
Datasets & benchmarksHugging Face dataset by HuggingFaceM4
HuggingFaceM4/WebSight
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.