Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
LLaVA-Pretrain
Datasets & benchmarksHugging Face dataset by liuhaotian
liuhaotian/LLaVA-Pretrain -
LLaVA-CC3M-Pretrain-595K
Datasets & benchmarksHugging Face dataset by liuhaotian
liuhaotian/LLaVA-CC3M-Pretrain-595K -
Nemotron-Pretraining-Code-v2
Datasets & benchmarksHugging Face dataset by nvidia
nvidia/Nemotron-Pretraining-Code-v2 -
Ultra-FineWeb
Datasets & benchmarksHugging Face dataset by openbmb
openbmb/Ultra-FineWeb -
multimodal_textbook
Datasets & benchmarksHugging Face dataset by DAMO-NLP-SG
DAMO-NLP-SG/multimodal_textbook -
AutoMathText
Datasets & benchmarksHugging Face dataset by math-ai
math-ai/AutoMathText -
UltraX-Preview
Datasets & benchmarksHugging Face dataset by openbmb
openbmb/UltraX-Preview -
UltraData-Math
Datasets & benchmarksHugging Face dataset by openbmb
openbmb/UltraData-Math -
UltraData-Code
Datasets & benchmarksHugging Face dataset by openbmb
openbmb/UltraData-Code -
Ultra-FineWeb-L1
Datasets & benchmarksHugging Face dataset by openbmb
openbmb/Ultra-FineWeb-L1 -
Ultra-FineWeb-L3
Datasets & benchmarksHugging Face dataset by openbmb
openbmb/Ultra-FineWeb-L3 -
VisualNews-Repository
Datasets & benchmarks[EMNLP'21] Visual News: Benchmark and Challenges in News Image Captioning
git clone https://github.com/FuxiaoLiu/VisualNews-Repository.git -
Awesome-LLM-Long-Context-Modeling
Datasets & benchmarks📰 Must-read papers and blogs on LLM based Long Context Modeling 🔥
git clone https://github.com/Xnhyacinth/Awesome-LLM-Long-Context-Modeling.git -
opencompass
Datasets & benchmarksOpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.
git clone https://github.com/open-compass/opencompass.git -
LLM-eval-survey
Datasets & benchmarksThe official GitHub page for the survey paper "A Survey on Evaluation of Large Language Models".
git clone https://github.com/MLGroupJLU/LLM-eval-survey.git -
OSWorld
Datasets & benchmarks[NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
git clone https://github.com/xlang-ai/OSWorld.git -
wikipedia
Datasets & benchmarksHugging Face dataset by wikimedia
wikimedia/wikipedia -
MNBVC
Datasets & benchmarksHugging Face dataset by liwu
liwu/MNBVC -
dolma
Datasets & benchmarksHugging Face dataset by allenai
allenai/dolma -
wikitext
Datasets & benchmarksHugging Face dataset by Salesforce
Salesforce/wikitext -
pile
Datasets & benchmarksHugging Face dataset by EleutherAI
EleutherAI/pile -
tau2-bench
Datasets & benchmarksτ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains
git clone https://github.com/sierra-research/tau2-bench.git -
LightCompress
Datasets & benchmarks[EMNLP 2024 & AAAI 2026] A powerful toolkit for compressing large models including LLMs, VLMs, and video generative models.
git clone https://github.com/ModelTC/LightCompress.git -
CulturaX
Datasets & benchmarksHugging Face dataset by uonlp
uonlp/CulturaX
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.