Library
85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
US-PD-Books
Datasets & benchmarksHugging Face dataset by storytracer
storytracer/US-PD-Books -
trivia_qa
Datasets & benchmarksHugging Face dataset by mandarjoshi
mandarjoshi/trivia_qa -
tau2-bench
Datasets & benchmarksτ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains
git clone https://github.com/sierra-research/tau2-bench.git -
MathVista
Datasets & benchmarksHugging Face dataset by AI4Math
AI4Math/MathVista -
ScienceQA
Datasets & benchmarksHugging Face dataset by derek-thomas
derek-thomas/ScienceQA -
gpqa
Datasets & benchmarksHugging Face dataset by Idavidrein
Idavidrein/gpqa -
medical_dialog
Datasets & benchmarksHugging Face dataset by UCSD26
UCSD26/medical_dialog -
ai2_arc
Datasets & benchmarksHugging Face dataset by allenai
allenai/ai2_arc -
empathetic_dialogues
Datasets & benchmarksHugging Face dataset by facebook
facebook/empathetic_dialogues -
squad_v2
Datasets & benchmarksHugging Face dataset by rajpurkar
rajpurkar/squad_v2 -
commonsense_qa
Datasets & benchmarksHugging Face dataset by tau
tau/commonsense_qa -
sciq
Datasets & benchmarksHugging Face dataset by allenai
allenai/sciq -
medmcqa
Datasets & benchmarksHugging Face dataset by openlifescienceai
openlifescienceai/medmcqa -
openbookqa
Datasets & benchmarksHugging Face dataset by allenai
allenai/openbookqa -
natural_questions
Datasets & benchmarksHugging Face dataset by google-research-datasets
google-research-datasets/natural_questions -
truthful_qa
Datasets & benchmarksHugging Face dataset by truthfulqa
truthfulqa/truthful_qa -
Simreal-MLBench
Datasets & benchmarks[Public preview] Externally scored agentic ML research benchmark: 60 tasks, real competition ground truth. Open protocol, operated evaluation.
git clone https://github.com/Simreal-AI/Simreal-MLBench.git -
EgoDemo
Datasets & benchmarksHugging Face dataset by LightwheelAI
LightwheelAI/EgoDemo -
lora-speedrun
Datasets & benchmarksSpeedrunning LoRA fine-tuning: frozen task, frozen hardware, public wall-clock leaderboard. modded-nanogpt for fine-tuning.
git clone https://github.com/Saivineeth147/lora-speedrun.git -
elimination_game
Datasets & benchmarksA multi-player tournament benchmark that tests LLMs in social reasoning, strategy, and deception. Players engage in public and private conversations, form alliances, and vote to eliminate each other
git clone https://github.com/lechmazur/elimination_game.git -
explicit-edit-benchmark
Datasets & benchmarksBenchmark coding agents and agent harnesses on 226 deterministic file-editing tasks with byte-exact verification and a public leaderboard.
git clone https://github.com/alexshpunt/explicit-edit-benchmark.git -
sloptotal
Datasets & benchmarksOpen-source AI text detector and ChatGPT detector: 23 engines, one calibrated score, every number measured on a public benchmark. Self-hosted, runs on CPU.
git clone https://github.com/pablocaeg/sloptotal.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.