Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
alpaca-gpt4
Datasets & benchmarksHugging Face dataset by vicgalle
vicgalle/alpaca-gpt4 -
Superior-Reasoning-SFT-gpt-oss-120b
Datasets & benchmarksHugging Face dataset by Alibaba-Apsara
Alibaba-Apsara/Superior-Reasoning-SFT-gpt-oss-120b -
GPT4-LLM-Cleaned
Datasets & benchmarksHugging Face dataset by teknium
teknium/GPT4-LLM-Cleaned -
gpt4all-j-prompt-generations
Datasets & benchmarksHugging Face dataset by nomic-ai
nomic-ai/gpt4all-j-prompt-generations -
prompts.chat
Datasets & benchmarksHugging Face dataset by fka
fka/prompts.chat -
Medical-Reasoning-SFT-GPT-OSS-120B
Datasets & benchmarksHugging Face dataset by OpenMed
OpenMed/Medical-Reasoning-SFT-GPT-OSS-120B -
gpt4all_prompt_generations
Datasets & benchmarksHugging Face dataset by nomic-ai
nomic-ai/gpt4all_prompt_generations -
HallusionBench
Datasets & benchmarks[CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(ision), LLaVA-1.5, and Other Multi-modality Models
git clone https://github.com/tianyi-lab/HallusionBench.git -
OpenHermes-2.5
Datasets & benchmarksHugging Face dataset by teknium
teknium/OpenHermes-2.5 -
UHGEval
Datasets & benchmarks[ACL 2024] User-friendly evaluation framework: Eval Suite & Benchmarks: UHGEval, HaluEval, HalluQA, etc.
git clone https://github.com/IAAR-Shanghai/UHGEval.git -
ShareGPT52K
Datasets & benchmarksHugging Face dataset by RyokoAI
RyokoAI/ShareGPT52K -
GPT-5.5-Gemini-3.1-Pro-Grok-4-Claude-Fable-5-Mythos-5-Qwen-3.7-Max-and-more-Distillation-Dataset
Datasets & benchmarksHugging Face dataset by Manusagents
Manusagents/GPT-5.5-Gemini-3.1-Pro-Grok-4-Claude-Fable-5-Mythos-5-Qwen-3.7-Max-and-more-Distillation-Dataset -
VisualNews-Repository
Datasets & benchmarks[EMNLP'21] Visual News: Benchmark and Challenges in News Image Captioning
git clone https://github.com/FuxiaoLiu/VisualNews-Repository.git -
sharegpt_gpt4
Datasets & benchmarksHugging Face dataset by shibing624
shibing624/sharegpt_gpt4 -
openhermes
Datasets & benchmarksHugging Face dataset by teknium
teknium/openhermes -
nyt-connections
Datasets & benchmarksBenchmark that evaluates LLMs using 759 NYT Connections puzzles extended with extra trick words
git clone https://github.com/lechmazur/nyt-connections.git -
alpaca-zh
Datasets & benchmarksHugging Face dataset by shibing624
shibing624/alpaca-zh -
nagi-bench
Datasets & benchmarksOne-shot LLM eval cases by NAGI STUDIO - same prompt, different agents (model + harness), runnable artifacts side by side.
git clone https://github.com/nagi-studio/nagi-bench.git -
Awesome-LLM-Eval
Datasets & benchmarksAwesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, leaderboard, papers, docs and models, mainly for Evaluation on LLMs. 一个由工具、基准/数据、演示、排行榜和大模型等组成的精选列表,主要面向基础大模型评测,旨在探求生成式AI的技术边界.
git clone https://github.com/onejune2018/Awesome-LLM-Eval.git -
elimination_game
Datasets & benchmarksA multi-player tournament benchmark that tests LLMs in social reasoning, strategy, and deception. Players engage in public and private conversations, form alliances, and vote to eliminate each other
git clone https://github.com/lechmazur/elimination_game.git -
debate
Datasets & benchmarksAdversarial multi-turn benchmark for LLM debate quality, using side-swapped matchups and multi-model judging to rank models by judged debate performance.
git clone https://github.com/lechmazur/debate.git -
ReForm-Eval
Datasets & benchmarksAn benchmark for evaluating the capabilities of large vision-language models (LVLMs)
git clone https://github.com/FudanDISC/ReForm-Eval.git -
xFinder
Datasets & benchmarks[ICLR 2025] xFinder: Large Language Models as Automated Evaluators for Reliable Evaluation
git clone https://github.com/IAAR-Shanghai/xFinder.git -
inferock-bench
Datasets & benchmarksLocal LLM cost-tracking proxy for OpenAI, Anthropic, Gemini, and pinned OpenRouter calls with token usage, failure, and billing-integrity receipts.
git clone https://github.com/inferock/inferock-bench.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.