Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
-
ChemLLMBench
Datasets & benchmarksOfficial Code for What can Large Language Models do in chemistry? A comprehensive benchmark on eight tasks (In NeurIPS 2023)
git clone https://github.com/ChemFoundationModels/ChemLLMBench.git -
HallusionBench
Datasets & benchmarks[CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(ision), LLaVA-1.5, and Other Multi-modality Models
git clone https://github.com/tianyi-lab/HallusionBench.git -
OSWorld
Datasets & benchmarks[NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
git clone https://github.com/xlang-ai/OSWorld.git -
pubmed
Datasets & benchmarksHugging Face dataset by ncbi
ncbi/pubmed -
minipile
Datasets & benchmarksHugging Face dataset by JeanKaddour
JeanKaddour/minipile -
oscar
Datasets & benchmarksHugging Face dataset by oscar-corpus
oscar-corpus/oscar -
apps
Datasets & benchmarksHugging Face dataset by codeparrot
codeparrot/apps -
CharacterCodex
Datasets & benchmarksHugging Face dataset by NousResearch
NousResearch/CharacterCodex -
ParseBench
Datasets & benchmarksParseBench - A Document Parsing Benchmark for AI Agents
git clone https://github.com/run-llama/ParseBench.git -
mc4
Datasets & benchmarksHugging Face dataset by legacy-datasets
legacy-datasets/mc4 -
Omni-SafetyBench
Datasets & benchmarks[ACM MM 2026 Oral] Code for paper "Omni-SafetyBench: A Benchmark for Safety Evaluation of Audio-Visual Large Language Models".
git clone https://github.com/THU-BPM/Omni-SafetyBench.git -
Awesome-LLM-Long-Context-Modeling
Datasets & benchmarks📰 Must-read papers and blogs on LLM based Long Context Modeling 🔥
git clone https://github.com/Xnhyacinth/Awesome-LLM-Long-Context-Modeling.git -
SkyPile-150B
Datasets & benchmarksHugging Face dataset by Skywork
Skywork/SkyPile-150B -
LawBench
Datasets & benchmarksBenchmarking Legal Knowledge of Large Language Models
git clone https://github.com/open-compass/LawBench.git -
OSCAR-2301
Datasets & benchmarksHugging Face dataset by oscar-corpus
oscar-corpus/OSCAR-2301 -
pile-of-law
Datasets & benchmarksHugging Face dataset by pile-of-law
pile-of-law/pile-of-law -
aurora
Datasets & benchmarks[ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark
git clone https://github.com/wenhaochai/aurora.git -
TACO
Datasets & benchmarksHugging Face dataset by BAAI
BAAI/TACO -
xFinder
Datasets & benchmarks[ICLR 2025] xFinder: Large Language Models as Automated Evaluators for Reliable Evaluation
git clone https://github.com/IAAR-Shanghai/xFinder.git -
WebInstructSub
Datasets & benchmarksHugging Face dataset by TIGER-Lab
TIGER-Lab/WebInstructSub -
Matrix
Datasets & benchmarksHugging Face dataset by m-a-p
m-a-p/Matrix -
LightCompress
Datasets & benchmarks[EMNLP 2024 & AAAI 2026] A powerful toolkit for compressing large models including LLMs, VLMs, and video generative models.
git clone https://github.com/ModelTC/LightCompress.git -
OSWorld-V2
Datasets & benchmarksOSWorld 2.0: Benchmarking Computer Use Agents on Long-Horizon Real-World Tasks
git clone https://github.com/xlang-ai/OSWorld-V2.git -
JBB-Behaviors
Datasets & benchmarksHugging Face dataset by JailbreakBench
JailbreakBench/JBB-Behaviors
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.