Library
85,766 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
Granary
Datasets & benchmarksHugging Face dataset by nvidia
nvidia/Granary -
xperience-10m
Datasets & benchmarksHugging Face dataset by ropedia-ai
ropedia-ai/xperience-10m -
Global-MMLU
Datasets & benchmarksHugging Face dataset by CohereLabs
CohereLabs/Global-MMLU -
alem-env
Datasets & benchmarksCan LLM/MARL agents coordinate in long-horizon, open-ended tasks? NeurIPS 2026 (Evaluations and Datasets).
git clone https://github.com/alem-world/alem-env.git -
product-database
Datasets & benchmarksHugging Face dataset by openfoodfacts
openfoodfacts/product-database -
CT-RATE
Datasets & benchmarksHugging Face dataset by ibrahimhamamci
ibrahimhamamci/CT-RATE -
smol
Datasets & benchmarksHugging Face dataset by google
google/smol -
omnilingual-asr-corpus
Datasets & benchmarksHugging Face dataset by facebook
facebook/omnilingual-asr-corpus -
voxpopuli
Datasets & benchmarksHugging Face dataset by facebook
facebook/voxpopuli -
belebele
Datasets & benchmarksHugging Face dataset by facebook
facebook/belebele -
Vaani
Datasets & benchmarksHugging Face dataset by ARTPARK-IISc
ARTPARK-IISc/Vaani -
Awesome-AI4AI
Datasets & benchmarksUpdated weekly — until humanity achieves AI4AI. 1148 curated papers across Benchmarks, Harness Design, and Model Design — from long-horizon agents to recursive self-improvement. Citation rankings, GitHub stars, and source-verified weekly news.
git clone https://github.com/KaiWU5/Awesome-AI4AI.git -
LongBench
Datasets & benchmarksLongBench v2 and LongBench (ACL 25'&24')
git clone https://github.com/THUDM/LongBench.git -
kg-gen
Datasets & benchmarks[NeurIPS '25] Knowledge Graph Generation from Any Text
git clone https://github.com/stair-lab/kg-gen.git -
AI_Diplomacy
Datasets & benchmarksFrontier Models playing the board game Diplomacy.
git clone https://github.com/GoodStartLabs/AI_Diplomacy.git -
ArtifactsBenchmark
Datasets & benchmarksgit clone https://github.com/Tencent-Hunyuan/ArtifactsBenchmark.git -
LawBench
Datasets & benchmarksBenchmarking Legal Knowledge of Large Language Models
git clone https://github.com/open-compass/LawBench.git -
WideSearch
Datasets & benchmarksWideSearch: Benchmarking Agentic Broad Info-Seeking
git clone https://github.com/ByteDance-Seed/WideSearch.git -
tau2-bench
Datasets & benchmarksτ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains
git clone https://github.com/sierra-research/tau2-bench.git -
SWE-bench-Live
Datasets & benchmarks[NeurIPS 2025 D&B] 🚀 SWE-bench Goes Live!
git clone https://github.com/microsoft/SWE-bench-Live.git -
TheAgentCompany
Datasets & benchmarksAn agent benchmark with tasks in a simulated software company.
git clone https://github.com/TheAgentCompany/TheAgentCompany.git -
ollama-benchmark
Datasets & benchmarksLLM Benchmark for Throughput via Ollama (Local LLMs)
git clone https://github.com/aidatatools/ollama-benchmark.git -
FastEval
Datasets & benchmarksFast & more realistic evaluation of chat language models. Includes leaderboard.
git clone https://github.com/FastEval/FastEval.git -
llm-colosseum
Datasets & benchmarksBenchmark LLMs by fighting in Street Fighter 3! The new way to evaluate the quality of an LLM
git clone https://github.com/OpenGenerativeAI/llm-colosseum.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.