Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
bigcodebench
Datasets & benchmarks[ICLR'25] BigCodeBench: Benchmarking Code Generation Towards AGI
git clone https://github.com/bigcode-project/bigcodebench.git -
starcoderdata
Datasets & benchmarksHugging Face dataset by bigcode
bigcode/starcoderdata -
the-stack-v2
Datasets & benchmarksHugging Face dataset by bigcode
bigcode/the-stack-v2 -
ta-prompt
Datasets & benchmarksHugging Face dataset by bigcode
bigcode/ta-prompt -
the-stack
Datasets & benchmarksHugging Face dataset by bigcode
bigcode/the-stack -
the-stack-dedup
Datasets & benchmarksHugging Face dataset by bigcode
bigcode/the-stack-dedup -
the-stack-v2-dedup
Datasets & benchmarksHugging Face dataset by bigcode
bigcode/the-stack-v2-dedup -
Superior-Reasoning-SFT-gpt-oss-120b
Datasets & benchmarksHugging Face dataset by Alibaba-Apsara
Alibaba-Apsara/Superior-Reasoning-SFT-gpt-oss-120b -
prompts.chat
Datasets & benchmarksHugging Face dataset by fka
fka/prompts.chat -
Medical-Reasoning-SFT-GPT-OSS-120B
Datasets & benchmarksHugging Face dataset by OpenMed
OpenMed/Medical-Reasoning-SFT-GPT-OSS-120B -
HallusionBench
Datasets & benchmarks[CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(ision), LLaVA-1.5, and Other Multi-modality Models
git clone https://github.com/tianyi-lab/HallusionBench.git -
OpenHermes-2.5
Datasets & benchmarksHugging Face dataset by teknium
teknium/OpenHermes-2.5 -
UHGEval
Datasets & benchmarks[ACL 2024] User-friendly evaluation framework: Eval Suite & Benchmarks: UHGEval, HaluEval, HalluQA, etc.
git clone https://github.com/IAAR-Shanghai/UHGEval.git -
ShareGPT52K
Datasets & benchmarksHugging Face dataset by RyokoAI
RyokoAI/ShareGPT52K -
GPT-5.5-Gemini-3.1-Pro-Grok-4-Claude-Fable-5-Mythos-5-Qwen-3.7-Max-and-more-Distillation-Dataset
Datasets & benchmarksHugging Face dataset by Manusagents
Manusagents/GPT-5.5-Gemini-3.1-Pro-Grok-4-Claude-Fable-5-Mythos-5-Qwen-3.7-Max-and-more-Distillation-Dataset -
VisualNews-Repository
Datasets & benchmarks[EMNLP'21] Visual News: Benchmark and Challenges in News Image Captioning
git clone https://github.com/FuxiaoLiu/VisualNews-Repository.git -
openhermes
Datasets & benchmarksHugging Face dataset by teknium
teknium/openhermes -
nyt-connections
Datasets & benchmarksBenchmark that evaluates LLMs using 759 NYT Connections puzzles extended with extra trick words
git clone https://github.com/lechmazur/nyt-connections.git -
alpaca-zh
Datasets & benchmarksHugging Face dataset by shibing624
shibing624/alpaca-zh -
nagi-bench
Datasets & benchmarksOne-shot LLM eval cases by NAGI STUDIO - same prompt, different agents (model + harness), runnable artifacts side by side.
git clone https://github.com/nagi-studio/nagi-bench.git -
debate
Datasets & benchmarksAdversarial multi-turn benchmark for LLM debate quality, using side-swapped matchups and multi-model judging to rank models by judged debate performance.
git clone https://github.com/lechmazur/debate.git -
elimination_game
Datasets & benchmarksA multi-player tournament benchmark that tests LLMs in social reasoning, strategy, and deception. Players engage in public and private conversations, form alliances, and vote to eliminate each other
git clone https://github.com/lechmazur/elimination_game.git -
xFinder
Datasets & benchmarks[ICLR 2025] xFinder: Large Language Models as Automated Evaluators for Reliable Evaluation
git clone https://github.com/IAAR-Shanghai/xFinder.git -
inferock-bench
Datasets & benchmarksLocal LLM cost-tracking proxy for OpenAI, Anthropic, Gemini, and pinned OpenRouter calls with token usage, failure, and billing-integrity receipts.
git clone https://github.com/inferock/inferock-bench.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.