Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
-
soda
Datasets & benchmarksHugging Face dataset by allenai
allenai/soda -
sciq
Datasets & benchmarksHugging Face dataset by allenai
allenai/sciq -
smol
Datasets & benchmarksHugging Face dataset by google
google/smol -
flores_plus
Datasets & benchmarksHugging Face dataset by openlanguagedata
openlanguagedata/flores_plus -
openbookqa
Datasets & benchmarksHugging Face dataset by allenai
allenai/openbookqa -
oscar
Datasets & benchmarksHugging Face dataset by oscar-corpus
oscar-corpus/oscar -
VisualNews-Repository
Datasets & benchmarks[EMNLP'21] Visual News: Benchmark and Challenges in News Image Captioning
git clone https://github.com/FuxiaoLiu/VisualNews-Repository.git -
minebench
Datasets & benchmarksMinecraft-style voxel benchmark for comparing AI models (Arena + Sandbox)
git clone https://github.com/Ammaar-Alam/minebench.git -
elimination_game
Datasets & benchmarksA multi-player tournament benchmark that tests LLMs in social reasoning, strategy, and deception. Players engage in public and private conversations, form alliances, and vote to eliminate each other
git clone https://github.com/lechmazur/elimination_game.git -
SGI-Bench
Datasets & benchmarksProbing Scientific General Intelligence of LLMs with Scientist-Aligned Workflows
git clone https://github.com/InternScience/SGI-Bench.git -
sec-code-bench
Datasets & benchmarksSecCodeBench is a benchmark suite focusing on evaluating the security of code generated by large language models (LLMs).
git clone https://github.com/alibaba/sec-code-bench.git -
TraderHarness
Datasets & benchmarks面向 LLM 交易 Agent 的抗污染回测、确定性回放与训练轨迹生成,支持 A 股研究|Leakage-resistant backtesting, deterministic replay & training trajectory generation for LLM trading agents, with A-share data
git clone https://github.com/HephaestLab/TraderHarness.git -
arena-ai-leaderboards
Datasets & benchmarks📊 Daily auto-updated snapshots of all Arena AI (LMSYS Chatbot Arena) leaderboards — LLM, Vision, Code, Video, Image & more. Structured JSON with historical tracking.
git clone https://github.com/oolong-tea-2026/arena-ai-leaderboards.git -
seo-skill-bench
Datasets & benchmarksOpen benchmark for Claude Code SEO skills — real headless execution against fixture sites with planted-defect answer keys. Deterministic scoring, pre-registered rubric.
git clone https://github.com/aleclindz/seo-skill-bench.git -
explicit-edit-benchmark
Datasets & benchmarksBenchmark coding agents and agent harnesses on 226 deterministic file-editing tasks with byte-exact verification and a public leaderboard.
git clone https://github.com/alexshpunt/explicit-edit-benchmark.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.