Library
85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
gsm8k
Datasets & benchmarksHugging Face dataset by openai
openai/gsm8k -
MetaMathQA
Datasets & benchmarksHugging Face dataset by meta-math
meta-math/MetaMathQA -
orca-math-word-problems-200k
Datasets & benchmarksHugging Face dataset by microsoft
microsoft/orca-math-word-problems-200k -
open-web-math
Datasets & benchmarksHugging Face dataset by open-web-math
open-web-math/open-web-math -
UltraData-Math
Datasets & benchmarksHugging Face dataset by openbmb
openbmb/UltraData-Math -
OpenR1-Math-220k
Datasets & benchmarksHugging Face dataset by open-r1
open-r1/OpenR1-Math-220k -
MathInstruct
Datasets & benchmarksHugging Face dataset by TIGER-Lab
TIGER-Lab/MathInstruct -
math_dataset
Datasets & benchmarksHugging Face dataset by deepmind
deepmind/math_dataset -
Big-Math-RL-Verified
Datasets & benchmarksHugging Face dataset by SynthLabsAI
SynthLabsAI/Big-Math-RL-Verified -
MathPile
Datasets & benchmarksHugging Face dataset by GAIR
GAIR/MathPile -
LLM-eval-survey
Datasets & benchmarksThe official GitHub page for the survey paper "A Survey on Evaluation of Large Language Models".
git clone https://github.com/MLGroupJLU/LLM-eval-survey.git -
DAPO-Math-17k
Datasets & benchmarksHugging Face dataset by BytedTsinghua-SIA
BytedTsinghua-SIA/DAPO-Math-17k -
Omni-MATH
Datasets & benchmarksHugging Face dataset by KbsdJames
KbsdJames/Omni-MATH -
Nemotron-Math-v2
Datasets & benchmarksHugging Face dataset by nvidia
nvidia/Nemotron-Math-v2 -
MATH-500
Datasets & benchmarksHugging Face dataset by HuggingFaceH4
HuggingFaceH4/MATH-500 -
Nemotron-Math-Proofs-v1
Datasets & benchmarksHugging Face dataset by nvidia
nvidia/Nemotron-Math-Proofs-v1 -
MathVision
Datasets & benchmarksHugging Face dataset by MathLLMs
MathLLMs/MathVision -
AutoMathText
Datasets & benchmarksHugging Face dataset by math-ai
math-ai/AutoMathText -
Awesome-LLM-Eval
Datasets & benchmarksAwesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, leaderboard, papers, docs and models, mainly for Evaluation on LLMs. 一个由工具、基准/数据、演示、排行榜和大模型等组成的精选列表,主要面向基础大模型评测,旨在探求生成式AI的技术边界.
git clone https://github.com/onejune2018/Awesome-LLM-Eval.git -
One-Eval
Datasets & benchmarksAutomated system for LLM evaluation via agents. Doc as below:
git clone https://github.com/OpenDCAI/One-Eval.git -
competition_math
Datasets & benchmarksHugging Face dataset by qwedsacf
qwedsacf/competition_math -
proof-pile-2
Datasets & benchmarksHugging Face dataset by EleutherAI
EleutherAI/proof-pile-2 -
xVerify
Datasets & benchmarksxVerify: Efficient Answer Verifier for Reasoning Model Evaluations
git clone https://github.com/IAAR-Shanghai/xVerify.git -
olmOCR-bench
Datasets & benchmarksHugging Face dataset by allenai
allenai/olmOCR-bench
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.