Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
-
competition_math
Datasets & benchmarksHugging Face dataset by qwedsacf
qwedsacf/competition_math -
One-Eval
Datasets & benchmarksAutomated system for LLM evaluation via agents. Doc as below:
git clone https://github.com/OpenDCAI/One-Eval.git -
proof-pile-2
Datasets & benchmarksHugging Face dataset by EleutherAI
EleutherAI/proof-pile-2 -
Awesome-AI-Scientist
Datasets & benchmarks🧪 Awesome list of AI Scientist papers, systems, benchmarks, datasets and open-source platforms.
git clone https://github.com/Omni-Scientist/Awesome-AI-Scientist.git -
MegaScience
Datasets & benchmarksHugging Face dataset by MegaScience
MegaScience/MegaScience -
xVerify
Datasets & benchmarksxVerify: Efficient Answer Verifier for Reasoning Model Evaluations
git clone https://github.com/IAAR-Shanghai/xVerify.git -
NuminaMath-CoT
Datasets & benchmarksHugging Face dataset by project-numina
project-numina/NuminaMath-CoT -
NuminaMath-CoT
Datasets & benchmarksHugging Face dataset by AI-MO
AI-MO/NuminaMath-CoT -
gsm8k
Datasets & benchmarksHugging Face dataset by openai
openai/gsm8k -
arxiv-latex
Datasets & benchmarksHugging Face dataset by scholarweave
scholarweave/arxiv-latex -
OpenMathReasoning
Datasets & benchmarksHugging Face dataset by nvidia
nvidia/OpenMathReasoning -
DeepMath-103K
Datasets & benchmarksHugging Face dataset by zwhe99
zwhe99/DeepMath-103K -
RubricHub_v1
Datasets & benchmarksHugging Face dataset by sojuL
sojuL/RubricHub_v1 -
ResearchClawBench
Datasets & benchmarks🦞 ResearchClawBench: Evaluating AI Agents for Automated Research from Re-Discovery to New-Discovery
git clone https://github.com/InternScience/ResearchClawBench.git -
AmericanStories
Datasets & benchmarksHugging Face dataset by dell-research-harvard
dell-research-harvard/AmericanStories -
MathVista
Datasets & benchmarksHugging Face dataset by AI4Math
AI4Math/MathVista -
OpenMathInstruct-1
Datasets & benchmarksHugging Face dataset by nvidia
nvidia/OpenMathInstruct-1 -
OpenMathInstruct-2
Datasets & benchmarksHugging Face dataset by nvidia
nvidia/OpenMathInstruct-2 -
Turing-Open-Reasoning
Datasets & benchmarksHugging Face dataset by TuringEnterprises
TuringEnterprises/Turing-Open-Reasoning -
AM-DeepSeek-R1-Distilled-1.4M
Datasets & benchmarksHugging Face dataset by a-m-team
a-m-team/AM-DeepSeek-R1-Distilled-1.4M -
NuminaMath-1.5
Datasets & benchmarksHugging Face dataset by AI-MO
AI-MO/NuminaMath-1.5 -
NuminaMath-TIR
Datasets & benchmarksHugging Face dataset by AI-MO
AI-MO/NuminaMath-TIR -
opencompass
Datasets & benchmarksOpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.
git clone https://github.com/open-compass/opencompass.git -
Capybara
Datasets & benchmarksHugging Face dataset by LDJnr
LDJnr/Capybara
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.