Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
-
peS2o
Datasets & benchmarksHugging Face dataset by allenai
allenai/peS2o -
CT-RATE
Datasets & benchmarksHugging Face dataset by ibrahimhamamci
ibrahimhamamci/CT-RATE -
chembench
Datasets & benchmarksHow good are LLMs at chemistry?
git clone https://github.com/lamalab-org/chembench.git -
OpenThoughts3-1.2M
Datasets & benchmarksHugging Face dataset by open-thoughts
open-thoughts/OpenThoughts3-1.2M -
One-Eval
Datasets & benchmarksAutomated system for LLM evaluation via agents. Doc as below:
git clone https://github.com/OpenDCAI/One-Eval.git -
Awesome-AI-Scientist
Datasets & benchmarks🧪 Awesome list of AI Scientist papers, systems, benchmarks, datasets and open-source platforms.
git clone https://github.com/Omni-Scientist/Awesome-AI-Scientist.git -
ScienceQA
Datasets & benchmarksHugging Face dataset by derek-thomas
derek-thomas/ScienceQA -
MegaScience
Datasets & benchmarksHugging Face dataset by MegaScience
MegaScience/MegaScience -
Open-RL
Datasets & benchmarksHugging Face dataset by TuringEnterprises
TuringEnterprises/Open-RL -
UltraTextbooks
Datasets & benchmarksHugging Face dataset by Locutusque
Locutusque/UltraTextbooks -
computer-use-large
Datasets & benchmarksHugging Face dataset by markov-ai
markov-ai/computer-use-large -
Open-MM-RL
Datasets & benchmarksHugging Face dataset by TuringEnterprises
TuringEnterprises/Open-MM-RL -
Awesome-Scientific-LLM-Benchmarks
Datasets & benchmarksA curated, accuracy-first list of benchmarks for evaluating LLMs on scientific reasoning and discovery — math, physics, chemistry, materials, biology, and agentic science.
git clone https://github.com/subinium/Awesome-Scientific-LLM-Benchmarks.git -
arxiv-latex
Datasets & benchmarksHugging Face dataset by scholarweave
scholarweave/arxiv-latex -
RubricHub_v1
Datasets & benchmarksHugging Face dataset by sojuL
sojuL/RubricHub_v1 -
claude-opus-4.6-4.7-reasoning-8.7k
Datasets & benchmarksHugging Face dataset by angrygiraffe
angrygiraffe/claude-opus-4.6-4.7-reasoning-8.7k -
ResearchClawBench
Datasets & benchmarks🦞 ResearchClawBench: Evaluating AI Agents for Automated Research from Re-Discovery to New-Discovery
git clone https://github.com/InternScience/ResearchClawBench.git -
AmericanStories
Datasets & benchmarksHugging Face dataset by dell-research-harvard
dell-research-harvard/AmericanStories -
opencompass
Datasets & benchmarksOpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.
git clone https://github.com/open-compass/opencompass.git -
SGI-Bench
Datasets & benchmarksProbing Scientific General Intelligence of LLMs with Scientist-Aligned Workflows
git clone https://github.com/InternScience/SGI-Bench.git -
OSWorld-V2
Datasets & benchmarksOSWorld 2.0: Benchmarking Computer Use Agents on Long-Horizon Real-World Tasks
git clone https://github.com/xlang-ai/OSWorld-V2.git -
ai-village
Datasets & benchmarksHugging Face dataset by aidigestorg
aidigestorg/ai-village -
physics-problems
Datasets & benchmarksHugging Face dataset by HumynLabs
HumynLabs/physics-problems -
flight-booking-screen-recording
Datasets & benchmarksHugging Face dataset by HumynLabs
HumynLabs/flight-booking-screen-recording
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.