Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
-
DeepPlanning
Datasets & benchmarksHugging Face dataset by Qwen
Qwen/DeepPlanning -
MegaScience
Datasets & benchmarksHugging Face dataset by MegaScience
MegaScience/MegaScience -
nyt-connections
Datasets & benchmarksBenchmark that evaluates LLMs using 759 NYT Connections puzzles extended with extra trick words
git clone https://github.com/lechmazur/nyt-connections.git -
AM-DeepSeek-R1-Distilled-1.4M
Datasets & benchmarksHugging Face dataset by a-m-team
a-m-team/AM-DeepSeek-R1-Distilled-1.4M -
UltraData-Math
Datasets & benchmarksHugging Face dataset by openbmb
openbmb/UltraData-Math -
Nemotron-Math-v2
Datasets & benchmarksHugging Face dataset by nvidia
nvidia/Nemotron-Math-v2 -
llm-bulls-and-cows-benchmark
Datasets & benchmarksA mini-framework for evaluating LLM performance on the Bulls and Cows number guessing game, supporting multiple LLM providers.
git clone https://github.com/stalkermustang/llm-bulls-and-cows-benchmark.git -
PersonaHub
Datasets & benchmarksHugging Face dataset by proj-persona
proj-persona/PersonaHub -
KIMI-K2.5-1000000x
Datasets & benchmarksHugging Face dataset by ianncity
ianncity/KIMI-K2.5-1000000x -
UltraData-SFT-2605
Datasets & benchmarksHugging Face dataset by openbmb
openbmb/UltraData-SFT-2605 -
claude_mythos_distilled_25k
Datasets & benchmarksHugging Face dataset by WithinUsAI
WithinUsAI/claude_mythos_distilled_25k -
MedXpertQA
Datasets & benchmarks[ICML 2025] MedXpertQA: Benchmarking Expert-Level Medical Reasoning and Understanding
git clone https://github.com/TsinghuaC3I/MedXpertQA.git -
opencompass
Datasets & benchmarksOpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.
git clone https://github.com/open-compass/opencompass.git -
Nemotron-Math-Proofs-v1
Datasets & benchmarksHugging Face dataset by nvidia
nvidia/Nemotron-Math-Proofs-v1 -
Big-Math-RL-Verified
Datasets & benchmarksHugging Face dataset by SynthLabsAI
SynthLabsAI/Big-Math-RL-Verified -
frames-benchmark
Datasets & benchmarksHugging Face dataset by google
google/frames-benchmark -
qwen3.8-max-glm5.2-kimi-k3-distillation
Datasets & benchmarksHugging Face dataset by r0b0tlab
r0b0tlab/qwen3.8-max-glm5.2-kimi-k3-distillation -
LLM-RGB
Datasets & benchmarksLLM Reasoning and Generation Benchmark. Evaluate LLMs in complex scenarios systematically.
git clone https://github.com/babelcloud/LLM-RGB.git -
SGI-Bench
Datasets & benchmarksProbing Scientific General Intelligence of LLMs with Scientist-Aligned Workflows
git clone https://github.com/InternScience/SGI-Bench.git -
ChartVerse-SFT-1.8M
Datasets & benchmarksHugging Face dataset by opendatalab
opendatalab/ChartVerse-SFT-1.8M -
PhysGym
Datasets & benchmarksA benchmark suite for evaluating LLM-based interactive scientific reasoning.
git clone https://github.com/principia-ai/PhysGym.git -
GPT-5.5-Gemini-3.1-Pro-Grok-4-Claude-Fable-5-Mythos-5-Qwen-3.7-Max-and-more-Distillation-Dataset
Datasets & benchmarksHugging Face dataset by Manusagents
Manusagents/GPT-5.5-Gemini-3.1-Pro-Grok-4-Claude-Fable-5-Mythos-5-Qwen-3.7-Max-and-more-Distillation-Dataset -
LongPage
Datasets & benchmarksHugging Face dataset by Pageshift-Entertainment
Pageshift-Entertainment/LongPage -
gamebot
Datasets & benchmarks[ACL 2025] GAMEBoT: Transparent Assessment of LLM Reasoning in Games
git clone https://github.com/Visual-AI/gamebot.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.