Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
wikipedia
Datasets & benchmarksHugging Face dataset by wikimedia
wikimedia/wikipedia -
xFinder
Datasets & benchmarks[ICLR 2025] xFinder: Large Language Models as Automated Evaluators for Reliable Evaluation
git clone https://github.com/IAAR-Shanghai/xFinder.git -
nautilus-compass
Datasets & benchmarksOpen memory & reliability layer for AI agents + independent judging/verification (NACRE judge, caliber-bench meta-benchmark, preregistered criteria) — by Nautilus Platform
git clone https://github.com/chunxiaoxx/nautilus-compass.git -
VIBE
Datasets & benchmarksHugging Face dataset by MiniMaxAI
MiniMaxAI/VIBE -
CulturaX
Datasets & benchmarksHugging Face dataset by uonlp
uonlp/CulturaX -
opus-100
Datasets & benchmarksHugging Face dataset by Helsinki-NLP
Helsinki-NLP/opus-100 -
smol
Datasets & benchmarksHugging Face dataset by google
google/smol -
xVerify
Datasets & benchmarksxVerify: Efficient Answer Verifier for Reasoning Model Evaluations
git clone https://github.com/IAAR-Shanghai/xVerify.git -
LoopArena
Datasets & benchmarksBenchmarking models as runtime Controllers for Loop Engineering
git clone https://github.com/AMAP-ML/LoopArena.git -
oscar
Datasets & benchmarksHugging Face dataset by oscar-corpus
oscar-corpus/oscar -
belebele
Datasets & benchmarksHugging Face dataset by facebook
facebook/belebele -
common_voice
Datasets & benchmarksHugging Face dataset by legacy-datasets
legacy-datasets/common_voice -
One-Eval
Datasets & benchmarksAutomated system for LLM evaluation via agents. Doc as below:
git clone https://github.com/OpenDCAI/One-Eval.git -
OSCAR-2201
Datasets & benchmarksHugging Face dataset by oscar-corpus
oscar-corpus/OSCAR-2201 -
Vaani
Datasets & benchmarksHugging Face dataset by ARTPARK-IISc
ARTPARK-IISc/Vaani -
meta-agents-research-environments
Datasets & benchmarksMeta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike static benchmarks, this platform introduces evolving environments where agents must adapt their strategies as new information becomes available, mirroring real-world challenges.
git clone https://github.com/facebookresearch/meta-agents-research-environments.git -
xorcise
Datasets & benchmarksRun cyber-AI agents against real missions in isolated environments. Record everything as OpenTelemetry evidence. Grade the evidence, not the claim.
git clone https://github.com/xorcise-ai/xorcise.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.