Library
85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
US-PD-Books
Datasets & benchmarksHugging Face dataset by storytracer
storytracer/US-PD-Books -
AgentTrove
Datasets & benchmarksHugging Face dataset by open-thoughts
open-thoughts/AgentTrove -
NIMStats
Datasets & benchmarks📊 Automated hourly benchmarks for 20+ NVIDIA NIM models — interactive dashboard, zero infra, self-hostable. Open-source & community-driven.
git clone https://github.com/MauroDruwel/NIMStats.git -
squad_v2
Datasets & benchmarksHugging Face dataset by rajpurkar
rajpurkar/squad_v2 -
empathetic_dialogues
Datasets & benchmarksHugging Face dataset by facebook
facebook/empathetic_dialogues -
Big-Math-RL-Verified
Datasets & benchmarksHugging Face dataset by SynthLabsAI
SynthLabsAI/Big-Math-RL-Verified -
commonsense_qa
Datasets & benchmarksHugging Face dataset by tau
tau/commonsense_qa -
LawBench
Datasets & benchmarksBenchmarking Legal Knowledge of Large Language Models
git clone https://github.com/open-compass/LawBench.git -
SlimOrca
Datasets & benchmarksHugging Face dataset by Open-Orca
Open-Orca/SlimOrca -
medmcqa
Datasets & benchmarksHugging Face dataset by openlifescienceai
openlifescienceai/medmcqa -
seo-skill-bench
Datasets & benchmarksOpen benchmark for Claude Code SEO skills — real headless execution against fixture sites with planted-defect answer keys. Deterministic scoring, pre-registered rubric.
git clone https://github.com/aleclindz/seo-skill-bench.git -
truthful_qa
Datasets & benchmarksHugging Face dataset by truthfulqa
truthfulqa/truthful_qa -
AgentLab
Datasets & benchmarksAgentLab: An open-source framework for developing, testing, and benchmarking web agents on diverse tasks, designed for scalability and reproducibility.
git clone https://github.com/ServiceNow/AgentLab.git -
openbookqa
Datasets & benchmarksHugging Face dataset by allenai
allenai/openbookqa -
natural_questions
Datasets & benchmarksHugging Face dataset by google-research-datasets
google-research-datasets/natural_questions -
opencompass
Datasets & benchmarksOpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.
git clone https://github.com/open-compass/opencompass.git -
teor
Datasets & benchmarksBenchmark aberto de LLMs para o processo legislativo brasileiro
git clone https://github.com/como-votam/teor.git -
sloptotal
Datasets & benchmarksOpen-source AI text detector and ChatGPT detector: 23 engines, one calibrated score, every number measured on a public benchmark. Self-hosted, runs on CPU.
git clone https://github.com/pablocaeg/sloptotal.git -
o11y-bench
Datasets & benchmarksOpen benchmark on observability tasks built on Harbor
git clone https://github.com/grafana/o11y-bench.git -
xFinder
Datasets & benchmarks[ICLR 2025] xFinder: Large Language Models as Automated Evaluators for Reliable Evaluation
git clone https://github.com/IAAR-Shanghai/xFinder.git -
nautilus-compass
Datasets & benchmarksOpen memory & reliability layer for AI agents + independent judging/verification (NACRE judge, caliber-bench meta-benchmark, preregistered criteria) — by Nautilus Platform
git clone https://github.com/chunxiaoxx/nautilus-compass.git -
ClawBench
Datasets & benchmarksOpen-source benchmark for browser AI agents on daily tasks.
git clone https://github.com/TIGER-AI-Lab/ClawBench.git -
MathVista
Datasets & benchmarksHugging Face dataset by AI4Math
AI4Math/MathVista -
ScienceQA
Datasets & benchmarksHugging Face dataset by derek-thomas
derek-thomas/ScienceQA
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.