Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
lmsys-chat-1m
Datasets & benchmarksHugging Face dataset by lmsys
lmsys/lmsys-chat-1m -
dolma
Datasets & benchmarksHugging Face dataset by allenai
allenai/dolma -
chatbot_arena_conversations
Datasets & benchmarksHugging Face dataset by lmsys
lmsys/chatbot_arena_conversations -
minebench
Datasets & benchmarksMinecraft-style voxel benchmark for comparing AI models (Arena + Sandbox)
git clone https://github.com/Ammaar-Alam/minebench.git -
SkyPile-150B
Datasets & benchmarksHugging Face dataset by Skywork
Skywork/SkyPile-150B -
LMeterX
Datasets & benchmarksA general-purpose API load testing platform that supports LLM services、A2A/MCP services and business HTTP interfaces, enabling one-click performance testing, result comparison, and AI-powered intelligent analysis and summarization. 一站式通用 API 压测平台,支持大模型推理业/务 HTTP 接口、A2A/MCP服务,一键完成性能测试、结果对比与 AI 智能分析总结
git clone https://github.com/MigoXLab/LMeterX.git -
LLaVA-OneVision-Data
Datasets & benchmarksHugging Face dataset by lmms-lab
lmms-lab/LLaVA-OneVision-Data -
toxic-chat
Datasets & benchmarksHugging Face dataset by lmsys
lmsys/toxic-chat -
LLaVA-Video-178K
Datasets & benchmarksHugging Face dataset by lmms-lab
lmms-lab/LLaVA-Video-178K -
mt_bench_human_judgments
Datasets & benchmarksHugging Face dataset by lmsys
lmsys/mt_bench_human_judgments -
arena-human-preference-55k
Datasets & benchmarksHugging Face dataset by lmarena-ai
lmarena-ai/arena-human-preference-55k -
arena-ai-leaderboards
Datasets & benchmarks📊 Daily auto-updated snapshots of all Arena AI (LMSYS Chatbot Arena) leaderboards — LLM, Vision, Code, Video, Image & more. Structured JSON with historical tracking.
git clone https://github.com/oolong-tea-2026/arena-ai-leaderboards.git -
PKU-SafeRLHF
Datasets & benchmarksHugging Face dataset by PKU-Alignment
PKU-Alignment/PKU-SafeRLHF -
HallusionBench
Datasets & benchmarks[CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(ision), LLaVA-1.5, and Other Multi-modality Models
git clone https://github.com/tianyi-lab/HallusionBench.git -
xFinder
Datasets & benchmarks[ICLR 2025] xFinder: Large Language Models as Automated Evaluators for Reliable Evaluation
git clone https://github.com/IAAR-Shanghai/xFinder.git -
swe-sweep
Datasets & benchmarksHow many bugs can LMs find & fix in large codebases?
git clone https://github.com/facebookresearch/swe-sweep.git -
qwen38-strix-halo-harness
Datasets & benchmarksAI coding agent harness for any hardware, local or cloud (OpenAI-compatible engines). Tuned for AMD Strix Halo: Qwen3.8 125B on the iGPU, NPU side-jobs, crash recovery, logged benchmarks.
git clone https://github.com/aic0d3r/qwen38-strix-halo-harness.git -
civ6-mcp
Datasets & benchmarksAn MCP server that lets LLM agents play Civilization VI.
git clone https://github.com/lmwilki/civ6-mcp.git -
apple-silicon-llm-bench
Datasets & benchmarksReproducible on-device LLM benchmarks for Apple Silicon (iPhone 17 Pro, M4 Max): Apple Core AI, MLX, llama.cpp, LiteRT-LM and Core ML on the same model and harness, every number with its quantization and capture session; hybrid Mamba-2 models (Nemotron-3 Nano, Granite-4.0-H, Falcon-H1) included.
git clone https://github.com/john-rocky/apple-silicon-llm-bench.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.