Library
85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
peS2o
Datasets & benchmarksHugging Face dataset by allenai
allenai/peS2o -
SciCode
Datasets & benchmarksA benchmark that challenges language models to code solutions for scientific problems
git clone https://github.com/scicode-bench/SciCode.git -
Awesome-AI-Scientist
Datasets & benchmarks🧪 Awesome list of AI Scientist papers, systems, benchmarks, datasets and open-source platforms.
git clone https://github.com/Omni-Scientist/Awesome-AI-Scientist.git -
scientific_papers
Datasets & benchmarksHugging Face dataset by armanc
armanc/scientific_papers -
SGI-Bench
Datasets & benchmarksProbing Scientific General Intelligence of LLMs with Scientist-Aligned Workflows
git clone https://github.com/InternScience/SGI-Bench.git -
Awesome-Scientific-LLM-Benchmarks
Datasets & benchmarksA curated, accuracy-first list of benchmarks for evaluating LLMs on scientific reasoning and discovery — math, physics, chemistry, materials, biology, and agentic science.
git clone https://github.com/subinium/Awesome-Scientific-LLM-Benchmarks.git -
ResearchClawBench
Datasets & benchmarks🦞 ResearchClawBench: Evaluating AI Agents for Automated Research from Re-Discovery to New-Discovery
git clone https://github.com/InternScience/ResearchClawBench.git -
PhysGym
Datasets & benchmarksA benchmark suite for evaluating LLM-based interactive scientific reasoning.
git clone https://github.com/principia-ai/PhysGym.git -
sciq
Datasets & benchmarksHugging Face dataset by allenai
allenai/sciq -
chembench
Datasets & benchmarksHow good are LLMs at chemistry?
git clone https://github.com/lamalab-org/chembench.git -
textbooks-are-all-you-need-lite
Datasets & benchmarksHugging Face dataset by SciPhi
SciPhi/textbooks-are-all-you-need-lite -
arxiv-complete
Datasets & benchmarksHugging Face dataset by secemp9
secemp9/arxiv-complete -
physics-problems
Datasets & benchmarksHugging Face dataset by HumynLabs
HumynLabs/physics-problems -
OpenThoughts3-1.2M
Datasets & benchmarksHugging Face dataset by open-thoughts
open-thoughts/OpenThoughts3-1.2M -
One-Eval
Datasets & benchmarksAutomated system for LLM evaluation via agents. Doc as below:
git clone https://github.com/OpenDCAI/One-Eval.git -
ScienceQA
Datasets & benchmarksHugging Face dataset by derek-thomas
derek-thomas/ScienceQA -
Open-RL
Datasets & benchmarksHugging Face dataset by TuringEnterprises
TuringEnterprises/Open-RL -
MegaScience
Datasets & benchmarksHugging Face dataset by MegaScience
MegaScience/MegaScience -
UltraTextbooks
Datasets & benchmarksHugging Face dataset by Locutusque
Locutusque/UltraTextbooks -
Open-MM-RL
Datasets & benchmarksHugging Face dataset by TuringEnterprises
TuringEnterprises/Open-MM-RL -
arxiv-latex
Datasets & benchmarksHugging Face dataset by scholarweave
scholarweave/arxiv-latex -
Superior-Reasoning-SFT-gpt-oss-120b
Datasets & benchmarksHugging Face dataset by Alibaba-Apsara
Alibaba-Apsara/Superior-Reasoning-SFT-gpt-oss-120b -
RubricHub_v1
Datasets & benchmarksHugging Face dataset by sojuL
sojuL/RubricHub_v1 -
claude-opus-4.6-4.7-reasoning-8.7k
Datasets & benchmarksHugging Face dataset by angrygiraffe
angrygiraffe/claude-opus-4.6-4.7-reasoning-8.7k
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.