Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
-
c4
Datasets & benchmarksHugging Face dataset by allenai
allenai/c4 -
wikipedia
Datasets & benchmarksHugging Face dataset by legacy-datasets
legacy-datasets/wikipedia -
openwebtext
Datasets & benchmarksHugging Face dataset by Skylion007
Skylion007/openwebtext -
ArtifactsBenchmark
Datasets & benchmarksgit clone https://github.com/Tencent-Hunyuan/ArtifactsBenchmark.git -
bookcorpus
Datasets & benchmarksHugging Face dataset by bookcorpus
bookcorpus/bookcorpus -
OpenVid-1M
Datasets & benchmarksHugging Face dataset by nkp37
nkp37/OpenVid-1M -
c4
Datasets & benchmarksHugging Face dataset by legacy-datasets
legacy-datasets/c4 -
github-code
Datasets & benchmarksHugging Face dataset by codeparrot
codeparrot/github-code -
code_search_net
Datasets & benchmarksHugging Face dataset by code-search-net
code-search-net/code_search_net -
HallusionBench
Datasets & benchmarks[CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(ision), LLaVA-1.5, and Other Multi-modality Models
git clone https://github.com/tianyi-lab/HallusionBench.git -
Static-to-Dynamic-LLMEval
Datasets & benchmarksThe official GitHub repository of the paper "Recent advances in large language model benchmarks against data contamination: From static to dynamic evaluation"
git clone https://github.com/SeekingDream/Static-to-Dynamic-LLMEval.git -
the_pile_books3
Datasets & benchmarksHugging Face dataset by defunct-datasets
defunct-datasets/the_pile_books3 -
SkyPile-150B
Datasets & benchmarksHugging Face dataset by Skywork
Skywork/SkyPile-150B -
LLM-Agent-Benchmark-List
Datasets & benchmarksA banchmark list for evaluation of large language models.
git clone https://github.com/zhangxjohn/LLM-Agent-Benchmark-List.git -
ParseBench
Datasets & benchmarksParseBench - A Document Parsing Benchmark for AI Agents
git clone https://github.com/run-llama/ParseBench.git -
ocr
Datasets & benchmarksHugging Face dataset by uv-scripts
uv-scripts/ocr -
CharacterCodex
Datasets & benchmarksHugging Face dataset by NousResearch
NousResearch/CharacterCodex -
xVerify
Datasets & benchmarksxVerify: Efficient Answer Verifier for Reasoning Model Evaluations
git clone https://github.com/IAAR-Shanghai/xVerify.git -
oscar
Datasets & benchmarksHugging Face dataset by oscar-corpus
oscar-corpus/oscar -
ping_pong_bench
Datasets & benchmarksA benchmark for role-playing language models
git clone https://github.com/IlyaGusev/ping_pong_bench.git -
Awesome-LLM-Eval
Datasets & benchmarksAwesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, leaderboard, papers, docs and models, mainly for Evaluation on LLMs. 一个由工具、基准/数据、演示、排行榜和大模型等组成的精选列表,主要面向基础大模型评测,旨在探求生成式AI的技术边界.
git clone https://github.com/onejune2018/Awesome-LLM-Eval.git -
apps
Datasets & benchmarksHugging Face dataset by codeparrot
codeparrot/apps -
pubmed
Datasets & benchmarksHugging Face dataset by ncbi
ncbi/pubmed -
AI_Diplomacy
Datasets & benchmarksFrontier Models playing the board game Diplomacy.
git clone https://github.com/GoodStartLabs/AI_Diplomacy.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.