Library
85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
open-schematics
Datasets & benchmarksHugging Face dataset by bshada
bshada/open-schematics -
CharacterCodex
Datasets & benchmarksHugging Face dataset by NousResearch
NousResearch/CharacterCodex -
xVerify
Datasets & benchmarksxVerify: Efficient Answer Verifier for Reasoning Model Evaluations
git clone https://github.com/IAAR-Shanghai/xVerify.git -
ping_pong_bench
Datasets & benchmarksA benchmark for role-playing language models
git clone https://github.com/IlyaGusev/ping_pong_bench.git -
fable-5-premium
Datasets & benchmarksHugging Face dataset by saidutta69
saidutta69/fable-5-premium -
Awesome-LLM-Eval
Datasets & benchmarksAwesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, leaderboard, papers, docs and models, mainly for Evaluation on LLMs. 一个由工具、基准/数据、演示、排行榜和大模型等组成的精选列表,主要面向基础大模型评测,旨在探求生成式AI的技术边界.
git clone https://github.com/onejune2018/Awesome-LLM-Eval.git -
AI_Diplomacy
Datasets & benchmarksFrontier Models playing the board game Diplomacy.
git clone https://github.com/GoodStartLabs/AI_Diplomacy.git -
Trendyol-Cybersecurity-Instruction-Tuning-Dataset
Datasets & benchmarksHugging Face dataset by Trendyol
Trendyol/Trendyol-Cybersecurity-Instruction-Tuning-Dataset -
10k_prompts_ranked
Datasets & benchmarksHugging Face dataset by data-is-better-together
data-is-better-together/10k_prompts_ranked -
xlsum
Datasets & benchmarksHugging Face dataset by csebuetnlp
csebuetnlp/xlsum -
Nectar
Datasets & benchmarksHugging Face dataset by berkeley-nest
berkeley-nest/Nectar -
xFinder
Datasets & benchmarks[ICLR 2025] xFinder: Large Language Models as Automated Evaluators for Reliable Evaluation
git clone https://github.com/IAAR-Shanghai/xFinder.git -
Long-Horizon-Terminal-Bench
Datasets & benchmarksHugging Face dataset by IntelligenceLab
IntelligenceLab/Long-Horizon-Terminal-Bench -
GPT-5.5-Gemini-3.1-Pro-Grok-4-Claude-Fable-5-Mythos-5-Qwen-3.7-Max-and-more-Distillation-Dataset
Datasets & benchmarksHugging Face dataset by Manusagents
Manusagents/GPT-5.5-Gemini-3.1-Pro-Grok-4-Claude-Fable-5-Mythos-5-Qwen-3.7-Max-and-more-Distillation-Dataset -
openbench
Datasets & benchmarksSame model, different wrapper: a from-scratch benchmark comparing coding-agent harnesses (codex, pi, opencode, cursor, devin) and open models on correctness, speed, and token cost
git clone https://github.com/minghinmatthewlam/openbench.git -
TrustLLM
Datasets & benchmarks[ICML 2024] TrustLLM: LLM trustworthiness evaluation across truthfulness, safety, fairness, robustness, privacy and ethics. Python/CLI toolkit for local models, compatible APIs and AI agent orchestration.
git clone https://github.com/HowieHwong/TrustLLM.git -
LLM-RGB
Datasets & benchmarksLLM Reasoning and Generation Benchmark. Evaluate LLMs in complex scenarios systematically.
git clone https://github.com/babelcloud/LLM-RGB.git -
trivia_qa
Datasets & benchmarksHugging Face dataset by mandarjoshi
mandarjoshi/trivia_qa -
ChemLLMBench
Datasets & benchmarksOfficial Code for What can Large Language Models do in chemistry? A comprehensive benchmark on eight tasks (In NeurIPS 2023)
git clone https://github.com/ChemFoundationModels/ChemLLMBench.git -
pile-of-law
Datasets & benchmarksHugging Face dataset by pile-of-law
pile-of-law/pile-of-law -
LawBench
Datasets & benchmarksBenchmarking Legal Knowledge of Large Language Models
git clone https://github.com/open-compass/LawBench.git -
sharegpt_gpt4
Datasets & benchmarksHugging Face dataset by shibing624
shibing624/sharegpt_gpt4 -
polymarket-paper-trader
Datasets & benchmarksPaper trading simulator for Polymarket
git clone https://github.com/agent-next/polymarket-paper-trader.git -
super_glue
Datasets & benchmarksHugging Face dataset by aps
aps/super_glue
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.