Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
-
binance-futures-ohlcv-2018-2026
Datasets & benchmarksHugging Face dataset by tradecatlabs
tradecatlabs/binance-futures-ohlcv-2018-2026 -
SWE-ZERO-12M-trajectories
Datasets & benchmarksHugging Face dataset by AlienKevin
AlienKevin/SWE-ZERO-12M-trajectories -
Cap3D
Datasets & benchmarksHugging Face dataset by tiange
tiange/Cap3D -
pii-masking-200k
Datasets & benchmarksHugging Face dataset by ai4privacy
ai4privacy/pii-masking-200k -
RealworldQA
Datasets & benchmarksHugging Face dataset by xai-org
xai-org/RealworldQA -
smol-smoltalk
Datasets & benchmarksHugging Face dataset by HuggingFaceTB
HuggingFaceTB/smol-smoltalk -
CodeX-2M-Thinking
Datasets & benchmarksHugging Face dataset by Modotte
Modotte/CodeX-2M-Thinking -
Nemotron-Math-Proofs-v1
Datasets & benchmarksHugging Face dataset by nvidia
nvidia/Nemotron-Math-Proofs-v1 -
OmniScience
Datasets & benchmarksHugging Face dataset by UniParser
UniParser/OmniScience -
rotten_tomatoes
Datasets & benchmarksHugging Face dataset by cornell-movie-review-data
cornell-movie-review-data/rotten_tomatoes -
wikisql
Datasets & benchmarksHugging Face dataset by Salesforce
Salesforce/wikisql -
SWE-bench-Live
Datasets & benchmarks[NeurIPS 2025 D&B] 🚀 SWE-bench Goes Live!
git clone https://github.com/microsoft/SWE-bench-Live.git -
nyt-connections
Datasets & benchmarksBenchmark that evaluates LLMs using 759 NYT Connections puzzles extended with extra trick words
git clone https://github.com/lechmazur/nyt-connections.git -
confabulations
Datasets & benchmarksHallucinations (Confabulations) Document-Based Benchmark for RAG. Includes human-verified questions and answers.
git clone https://github.com/lechmazur/confabulations.git -
turnkeyml
Datasets & benchmarksNo-code CLI designed for accelerating ONNX workflows
git clone https://github.com/onnx/turnkeyml.git -
SciCode
Datasets & benchmarksA benchmark that challenges language models to code solutions for scientific problems
git clone https://github.com/scicode-bench/SciCode.git -
swe-sweep
Datasets & benchmarksHow many bugs can LMs find & fix in large codebases?
git clone https://github.com/facebookresearch/swe-sweep.git -
llm-bulls-and-cows-benchmark
Datasets & benchmarksA mini-framework for evaluating LLM performance on the Bulls and Cows number guessing game, supporting multiple LLM providers.
git clone https://github.com/stalkermustang/llm-bulls-and-cows-benchmark.git -
DyCodeEval
Datasets & benchmarksOfficial repository of the ICML2025 paper “Dynamic Benchmarking of Reasoning Capabilities in Code Large Language Models Under Data Contamination”
git clone https://github.com/SeekingDream/DyCodeEval.git -
llm-price-compass
Datasets & benchmarksThis project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient LLM GPU selections and cost-effective AI models. LLM provider price comparison, gpu benchmarks to price per token calculation, gpu benchmark table
git clone https://github.com/arc53/llm-price-compass.git -
civ6-mcp
Datasets & benchmarksAn MCP server that lets LLM agents play Civilization VI.
git clone https://github.com/lmwilki/civ6-mcp.git -
Awesome-AI4AI
Datasets & benchmarksUpdated weekly — until humanity achieves AI4AI. 1148 curated papers across Benchmarks, Harness Design, and Model Design — from long-horizon agents to recursive self-improvement. Citation rankings, GitHub stars, and source-verified weekly news.
git clone https://github.com/KaiWU5/Awesome-AI4AI.git -
Ditto
Datasets & benchmarksA self-ailgnment method for role-play. Benchmark for role-play. Resources for "Large Language Models are Superpositions of All Characters: Attaining Arbitrary Role-play via Self-Alignment".
git clone https://github.com/OFA-Sys/Ditto.git -
LMeterX
Datasets & benchmarksA general-purpose API load testing platform that supports LLM services、A2A/MCP services and business HTTP interfaces, enabling one-click performance testing, result comparison, and AI-powered intelligent analysis and summarization. 一站式通用 API 压测平台,支持大模型推理业/务 HTTP 接口、A2A/MCP服务,一键完成性能测试、结果对比与 AI 智能分析总结
git clone https://github.com/MigoXLab/LMeterX.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.