Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
arxiv-complete
Datasets & benchmarksHugging Face dataset by secemp9
secemp9/arxiv-complete -
OpenHermes-2.5
Datasets & benchmarksHugging Face dataset by teknium
teknium/OpenHermes-2.5 -
hacker-news
Datasets & benchmarksHugging Face dataset by open-index
open-index/hacker-news -
e-commerce-customersupport-hinglish-audio
Datasets & benchmarksHugging Face dataset by HumynLabs
HumynLabs/e-commerce-customersupport-hinglish-audio -
YouTube-Commons
Datasets & benchmarksHugging Face dataset by PleIAs
PleIAs/YouTube-Commons -
opencompass
Datasets & benchmarksOpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.
git clone https://github.com/open-compass/opencompass.git -
Awesome-LLM-Long-Context-Modeling
Datasets & benchmarks📰 Must-read papers and blogs on LLM based Long Context Modeling 🔥
git clone https://github.com/Xnhyacinth/Awesome-LLM-Long-Context-Modeling.git -
nautilus-compass
Datasets & benchmarksOpen memory & reliability layer for AI agents + independent judging/verification (NACRE judge, caliber-bench meta-benchmark, preregistered criteria) — by Nautilus Platform
git clone https://github.com/chunxiaoxx/nautilus-compass.git -
e-commerce-customersupport-english-audio
Datasets & benchmarksHugging Face dataset by HumynLabs
HumynLabs/e-commerce-customersupport-english-audio -
OSWorld
Datasets & benchmarks[NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
git clone https://github.com/xlang-ai/OSWorld.git -
common_corpus
Datasets & benchmarksHugging Face dataset by PleIAs
PleIAs/common_corpus -
webgpt_comparisons
Datasets & benchmarksHugging Face dataset by openai
openai/webgpt_comparisons -
flight-booking-screen-recording
Datasets & benchmarksHugging Face dataset by HumynLabs
HumynLabs/flight-booking-screen-recording -
physics-problems
Datasets & benchmarksHugging Face dataset by HumynLabs
HumynLabs/physics-problems -
computer-use-large
Datasets & benchmarksHugging Face dataset by markov-ai
markov-ai/computer-use-large -
ClawBench
Datasets & benchmarksOpen-source benchmark for browser AI agents on daily tasks.
git clone https://github.com/TIGER-AI-Lab/ClawBench.git -
Glyd
Datasets & benchmarksLossless AI compression: 33% less GPU memory, bit for bit.
git clone https://github.com/surya-koritala/Glyd.git -
TheAgentCompany
Datasets & benchmarksAn agent benchmark with tasks in a simulated software company.
git clone https://github.com/TheAgentCompany/TheAgentCompany.git -
TrustLLM
Datasets & benchmarks[ICML 2024] TrustLLM: LLM trustworthiness evaluation across truthfulness, safety, fairness, robustness, privacy and ethics. Python/CLI toolkit for local models, compatible APIs and AI agent orchestration.
git clone https://github.com/HowieHwong/TrustLLM.git -
minebench
Datasets & benchmarksMinecraft-style voxel benchmark for comparing AI models (Arena + Sandbox)
git clone https://github.com/Ammaar-Alam/minebench.git -
Complete-FABLE.5-traces-2M
Datasets & benchmarksHugging Face dataset by Crownelius
Crownelius/Complete-FABLE.5-traces-2M -
OSWorld-V2
Datasets & benchmarksOSWorld 2.0: Benchmarking Computer Use Agents on Long-Horizon Real-World Tasks
git clone https://github.com/xlang-ai/OSWorld-V2.git -
CT-RATE
Datasets & benchmarksHugging Face dataset by ibrahimhamamci
ibrahimhamamci/CT-RATE -
common_voice
Datasets & benchmarksHugging Face dataset by legacy-datasets
legacy-datasets/common_voice
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.