Library
85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
opencompass
Datasets & benchmarksOpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.
git clone https://github.com/open-compass/opencompass.git -
NuminaMath-CoT
Datasets & benchmarksHugging Face dataset by project-numina
project-numina/NuminaMath-CoT -
NuminaMath-CoT
Datasets & benchmarksHugging Face dataset by AI-MO
AI-MO/NuminaMath-CoT -
OpenMathReasoning
Datasets & benchmarksHugging Face dataset by nvidia
nvidia/OpenMathReasoning -
tweet_eval
Datasets & benchmarksHugging Face dataset by cardiffnlp
cardiffnlp/tweet_eval -
ReForm-Eval
Datasets & benchmarksAn benchmark for evaluating the capabilities of large vision-language models (LVLMs)
git clone https://github.com/FudanDISC/ReForm-Eval.git -
DeepMath-103K
Datasets & benchmarksHugging Face dataset by zwhe99
zwhe99/DeepMath-103K -
OpenThoughts3-1.2M
Datasets & benchmarksHugging Face dataset by open-thoughts
open-thoughts/OpenThoughts3-1.2M -
MathVista
Datasets & benchmarksHugging Face dataset by AI4Math
AI4Math/MathVista -
MMLU-Pro
Datasets & benchmarksHugging Face dataset by TIGER-Lab
TIGER-Lab/MMLU-Pro -
OpenMathInstruct-1
Datasets & benchmarksHugging Face dataset by nvidia
nvidia/OpenMathInstruct-1 -
SWE-bench_Pro
Datasets & benchmarksHugging Face dataset by ScaleAI
ScaleAI/SWE-bench_Pro -
OpenMathInstruct-2
Datasets & benchmarksHugging Face dataset by nvidia
nvidia/OpenMathInstruct-2 -
SWE-bench_Verified
Datasets & benchmarksHugging Face dataset by SWE-bench
SWE-bench/SWE-bench_Verified -
Open-RL
Datasets & benchmarksHugging Face dataset by TuringEnterprises
TuringEnterprises/Open-RL -
UltraTextbooks
Datasets & benchmarksHugging Face dataset by Locutusque
Locutusque/UltraTextbooks -
Turing-Open-Reasoning
Datasets & benchmarksHugging Face dataset by TuringEnterprises
TuringEnterprises/Turing-Open-Reasoning -
AM-DeepSeek-R1-Distilled-1.4M
Datasets & benchmarksHugging Face dataset by a-m-team
a-m-team/AM-DeepSeek-R1-Distilled-1.4M -
NuminaMath-1.5
Datasets & benchmarksHugging Face dataset by AI-MO
AI-MO/NuminaMath-1.5 -
NuminaMath-TIR
Datasets & benchmarksHugging Face dataset by AI-MO
AI-MO/NuminaMath-TIR -
Capybara
Datasets & benchmarksHugging Face dataset by LDJnr
LDJnr/Capybara -
MegaMath
Datasets & benchmarksHugging Face dataset by IFM
IFM/MegaMath -
gamebot
Datasets & benchmarks[ACL 2025] GAMEBoT: Transparent Assessment of LLM Reasoning in Games
git clone https://github.com/Visual-AI/gamebot.git -
Open-MM-RL
Datasets & benchmarksHugging Face dataset by TuringEnterprises
TuringEnterprises/Open-MM-RL
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.