Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
Human-Like-DPO-Dataset
Datasets & benchmarksHugging Face dataset by HumanLLMs
HumanLLMs/Human-Like-DPO-Dataset -
hh-rlhf
Datasets & benchmarksHugging Face dataset by Anthropic
Anthropic/hh-rlhf -
EgoStandard
Datasets & benchmarksHugging Face dataset by LightwheelAI
LightwheelAI/EgoStandard -
EgoPro
Datasets & benchmarksHugging Face dataset by LightwheelAI
LightwheelAI/EgoPro -
openai_humaneval
Datasets & benchmarksHugging Face dataset by openai
openai/openai_humaneval -
opus5-5-doctor-patient-conversations-all-human-diseases
Datasets & benchmarksHugging Face dataset by nisten
nisten/opus5-5-doctor-patient-conversations-all-human-diseases -
EgoDemo
Datasets & benchmarksHugging Face dataset by LightwheelAI
LightwheelAI/EgoDemo -
seed
Datasets & benchmarksHugging Face dataset by bones-studio
bones-studio/seed -
mt_bench_human_judgments
Datasets & benchmarksHugging Face dataset by lmsys
lmsys/mt_bench_human_judgments -
arena-human-preference-55k
Datasets & benchmarksHugging Face dataset by lmarena-ai
lmarena-ai/arena-human-preference-55k -
HelpSteer2
Datasets & benchmarksHugging Face dataset by nvidia
nvidia/HelpSteer2 -
humanities_data_benchmark
Datasets & benchmarksLLM Benchmark Suite for Humanities Data
git clone https://github.com/RISE-UNIBAS/humanities_data_benchmark.git -
HelpSteer
Datasets & benchmarksHugging Face dataset by nvidia
nvidia/HelpSteer -
flight-booking-screen-recording
Datasets & benchmarksHugging Face dataset by HumynLabs
HumynLabs/flight-booking-screen-recording -
SHP
Datasets & benchmarksHugging Face dataset by stanfordnlp
stanfordnlp/SHP -
OneMillion-Bench
Datasets & benchmarks[NeurIPS 2026] $OneMillion-Bench: How Far are Language Agents from Human Experts?
git clone https://github.com/humanlaya/OneMillion-Bench.git -
claude-opus-4.6-4.7-reasoning-8.7k
Datasets & benchmarksHugging Face dataset by angrygiraffe
angrygiraffe/claude-opus-4.6-4.7-reasoning-8.7k -
stack-exchange-preferences
Datasets & benchmarksHugging Face dataset by HuggingFaceH4
HuggingFaceH4/stack-exchange-preferences -
PKU-SafeRLHF
Datasets & benchmarksHugging Face dataset by PKU-Alignment
PKU-Alignment/PKU-SafeRLHF -
sacp
Datasets & benchmarksState-Aware Collaboration Protocol: auditable work receipts for AI agents.
git clone https://github.com/aDragon0707/sacp.git -
xperience-10m
Datasets & benchmarksHugging Face dataset by ropedia-ai
ropedia-ai/xperience-10m -
confabulations
Datasets & benchmarksHallucinations (Confabulations) Document-Based Benchmark for RAG. Includes human-verified questions and answers.
git clone https://github.com/lechmazur/confabulations.git -
DeepResearch-Bench-II
Datasets & benchmarksDeepResearch Bench II (DRB2) is the follow-up to DeepResearch Bench, with a stronger focus on measuring the gap between deep research systems and human experts. It does so by decomposing expert-written reports into hierarchical rubrics covering presentation, analysis, and evidence, and using them to evaluate model-generated.
git clone https://github.com/imlrz/DeepResearch-Bench-II.git -
Awesome-AI4AI
Datasets & benchmarksUpdated weekly — until humanity achieves AI4AI. 1148 curated papers across Benchmarks, Harness Design, and Model Design — from long-horizon agents to recursive self-improvement. Citation rankings, GitHub stars, and source-verified weekly news.
git clone https://github.com/KaiWU5/Awesome-AI4AI.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.