Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
-
openbookqa
Datasets & benchmarksHugging Face dataset by allenai
allenai/openbookqa -
natural_questions
Datasets & benchmarksHugging Face dataset by google-research-datasets
google-research-datasets/natural_questions -
super_glue
Datasets & benchmarksHugging Face dataset by aps
aps/super_glue -
Awesome-LLM-Long-Context-Modeling
Datasets & benchmarks📰 Must-read papers and blogs on LLM based Long Context Modeling 🔥
git clone https://github.com/Xnhyacinth/Awesome-LLM-Long-Context-Modeling.git -
sql-create-context
Datasets & benchmarksHugging Face dataset by b-mc2
b-mc2/sql-create-context -
LongBench
Datasets & benchmarksLongBench v2 and LongBench (ACL 25'&24')
git clone https://github.com/THUDM/LongBench.git -
CL-bench
Datasets & benchmarksHugging Face dataset by tencent
tencent/CL-bench -
NoLiMa
Datasets & benchmarksOfficial repository for "NoLiMa: Long-Context Evaluation Beyond Literal Matching"
git clone https://github.com/adobe-research/NoLiMa.git -
WritingBench
Datasets & benchmarksWritingBench: A Comprehensive Benchmark for Generative Writing
git clone https://github.com/X-PLUG/WritingBench.git -
polymarket-paper-trader
Datasets & benchmarksPaper trading simulator for Polymarket
git clone https://github.com/agent-next/polymarket-paper-trader.git -
LongBench
Datasets & benchmarksHugging Face dataset by zai-org
zai-org/LongBench -
opencompass
Datasets & benchmarksOpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.
git clone https://github.com/open-compass/opencompass.git -
Nemotron-Math-v2
Datasets & benchmarksHugging Face dataset by nvidia
nvidia/Nemotron-Math-v2 -
LongWriter-6k
Datasets & benchmarksHugging Face dataset by zai-org
zai-org/LongWriter-6k -
UltraData-RL-2609
Datasets & benchmarksHugging Face dataset by openbmb
openbmb/UltraData-RL-2609 -
frames-benchmark
Datasets & benchmarksHugging Face dataset by google
google/frames-benchmark -
ReForm-Eval
Datasets & benchmarksAn benchmark for evaluating the capabilities of large vision-language models (LVLMs)
git clone https://github.com/FudanDISC/ReForm-Eval.git -
LongPage
Datasets & benchmarksHugging Face dataset by Pageshift-Entertainment
Pageshift-Entertainment/LongPage -
HallusionBench
Datasets & benchmarks[CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(ision), LLaVA-1.5, and Other Multi-modality Models
git clone https://github.com/tianyi-lab/HallusionBench.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.