Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
-
peS2o
Datasets & benchmarksHugging Face dataset by allenai
allenai/peS2o -
chembench
Datasets & benchmarksHow good are LLMs at chemistry?
git clone https://github.com/lamalab-org/chembench.git -
Awesome-Scientific-LLM-Benchmarks
Datasets & benchmarksA curated, accuracy-first list of benchmarks for evaluating LLMs on scientific reasoning and discovery — math, physics, chemistry, materials, biology, and agentic science.
git clone https://github.com/subinium/Awesome-Scientific-LLM-Benchmarks.git -
OpenThoughts3-1.2M
Datasets & benchmarksHugging Face dataset by open-thoughts
open-thoughts/OpenThoughts3-1.2M -
One-Eval
Datasets & benchmarksAutomated system for LLM evaluation via agents. Doc as below:
git clone https://github.com/OpenDCAI/One-Eval.git -
Awesome-AI-Scientist
Datasets & benchmarks🧪 Awesome list of AI Scientist papers, systems, benchmarks, datasets and open-source platforms.
git clone https://github.com/Omni-Scientist/Awesome-AI-Scientist.git -
ScienceQA
Datasets & benchmarksHugging Face dataset by derek-thomas
derek-thomas/ScienceQA -
MegaScience
Datasets & benchmarksHugging Face dataset by MegaScience
MegaScience/MegaScience -
Open-RL
Datasets & benchmarksHugging Face dataset by TuringEnterprises
TuringEnterprises/Open-RL -
UltraTextbooks
Datasets & benchmarksHugging Face dataset by Locutusque
Locutusque/UltraTextbooks -
Open-MM-RL
Datasets & benchmarksHugging Face dataset by TuringEnterprises
TuringEnterprises/Open-MM-RL -
arxiv-latex
Datasets & benchmarksHugging Face dataset by scholarweave
scholarweave/arxiv-latex -
RubricHub_v1
Datasets & benchmarksHugging Face dataset by sojuL
sojuL/RubricHub_v1 -
claude-opus-4.6-4.7-reasoning-8.7k
Datasets & benchmarksHugging Face dataset by angrygiraffe
angrygiraffe/claude-opus-4.6-4.7-reasoning-8.7k -
ResearchClawBench
Datasets & benchmarks🦞 ResearchClawBench: Evaluating AI Agents for Automated Research from Re-Discovery to New-Discovery
git clone https://github.com/InternScience/ResearchClawBench.git -
AmericanStories
Datasets & benchmarksHugging Face dataset by dell-research-harvard
dell-research-harvard/AmericanStories -
opencompass
Datasets & benchmarksOpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.
git clone https://github.com/open-compass/opencompass.git -
SGI-Bench
Datasets & benchmarksProbing Scientific General Intelligence of LLMs with Scientist-Aligned Workflows
git clone https://github.com/InternScience/SGI-Bench.git -
CT-RATE
Datasets & benchmarksHugging Face dataset by ibrahimhamamci
ibrahimhamamci/CT-RATE
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.