Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
chembench
Datasets & benchmarksHow good are LLMs at chemistry?
git clone https://github.com/lamalab-org/chembench.git -
ChemLLMBench
Datasets & benchmarksOfficial Code for What can Large Language Models do in chemistry? A comprehensive benchmark on eight tasks (In NeurIPS 2023)
git clone https://github.com/ChemFoundationModels/ChemLLMBench.git -
Open-RL
Datasets & benchmarksHugging Face dataset by TuringEnterprises
TuringEnterprises/Open-RL -
Turing-Open-Reasoning
Datasets & benchmarksHugging Face dataset by TuringEnterprises
TuringEnterprises/Turing-Open-Reasoning -
Tahoe-100M
Datasets & benchmarksHugging Face dataset by tahoebio
tahoebio/Tahoe-100M -
Capybara
Datasets & benchmarksHugging Face dataset by LDJnr
LDJnr/Capybara -
Open-MM-RL
Datasets & benchmarksHugging Face dataset by TuringEnterprises
TuringEnterprises/Open-MM-RL -
peS2o
Datasets & benchmarksHugging Face dataset by allenai
allenai/peS2o -
MMMU
Datasets & benchmarksHugging Face dataset by MMMU
MMMU/MMMU -
distilabel-capybara-dpo-7k-binarized
Datasets & benchmarksHugging Face dataset by argilla
argilla/distilabel-capybara-dpo-7k-binarized -
Awesome-Scientific-LLM-Benchmarks
Datasets & benchmarksA curated, accuracy-first list of benchmarks for evaluating LLMs on scientific reasoning and discovery — math, physics, chemistry, materials, biology, and agentic science.
git clone https://github.com/subinium/Awesome-Scientific-LLM-Benchmarks.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.