Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
-
MegaMath
Datasets & benchmarksHugging Face dataset by IFM
IFM/MegaMath -
opus5-5-doctor-patient-conversations-all-human-diseases
Datasets & benchmarksHugging Face dataset by nisten
nisten/opus5-5-doctor-patient-conversations-all-human-diseases -
PMC-Patients
Datasets & benchmarksHugging Face dataset by zhengyun21
zhengyun21/PMC-Patients -
opengenome2
Datasets & benchmarksHugging Face dataset by arcinstitute
arcinstitute/opengenome2 -
mac-ml-speed-test
Datasets & benchmarksA few quick scripts focused on testing TensorFlow/PyTorch/Llama 2 on macOS.
git clone https://github.com/mrdbourke/mac-ml-speed-test.git -
LightCompress
Datasets & benchmarks[EMNLP 2024 & AAAI 2026] A powerful toolkit for compressing large models including LLMs, VLMs, and video generative models.
git clone https://github.com/ModelTC/LightCompress.git -
tmmluplus
Datasets & benchmarksHugging Face dataset by ikala
ikala/tmmluplus -
MMMU
Datasets & benchmarksHugging Face dataset by MMMU
MMMU/MMMU -
RubricHub_v1
Datasets & benchmarksHugging Face dataset by sojuL
sojuL/RubricHub_v1 -
guidelines
Datasets & benchmarksHugging Face dataset by epfl-llm
epfl-llm/guidelines -
ChatMed_Consult_Dataset
Datasets & benchmarksHugging Face dataset by michaelwzhu
michaelwzhu/ChatMed_Consult_Dataset -
apex-agents
Datasets & benchmarksHugging Face dataset by mercor
mercor/apex-agents -
dialogsum
Datasets & benchmarksHugging Face dataset by knkarthick
knkarthick/dialogsum -
Simreal-MLBench
Datasets & benchmarks[Public preview] Externally scored agentic ML research benchmark: 60 tasks, real competition ground truth. Open protocol, operated evaluation.
git clone https://github.com/Simreal-AI/Simreal-MLBench.git -
deepmark
Datasets & benchmarksDeepmark AI enables a unique testing environment for language models (LLM) assessment on task-specific metrics and on your own data so your GenAI-powered solution has predictable and reliable performance.
git clone https://github.com/IngestAI/deepmark.git -
strix-halo-guide
Datasets & benchmarksEvidence-backed AMD Strix Halo local-AI setup and benchmarks: Qwen3.8, Ollama, llama.cpp, Vulkan/ROCm, large GGUFs, and cross-OEM results.
git clone https://github.com/hogeheer499-commits/strix-halo-guide.git -
SGI-Bench
Datasets & benchmarksProbing Scientific General Intelligence of LLMs with Scientist-Aligned Workflows
git clone https://github.com/InternScience/SGI-Bench.git -
Ditto
Datasets & benchmarksA self-ailgnment method for role-play. Benchmark for role-play. Resources for "Large Language Models are Superpositions of All Characters: Attaining Arbitrary Role-play via Self-Alignment".
git clone https://github.com/OFA-Sys/Ditto.git -
Glyd
Datasets & benchmarksLossless AI compression: 33% less GPU memory, bit for bit.
git clone https://github.com/surya-koritala/Glyd.git -
AIRTBench-Code
Datasets & benchmarksCode Repository for: AIRTBench: Measuring Autonomous AI Red Teaming Capabilities in Language Models
git clone https://github.com/dreadnode/AIRTBench-Code.git -
Awesome-Datasets-Hub
Datasets & benchmarksA curated collection of datasets for Large Language Models (LLMs), covering medical AI, NLP, multimodal learning, instruction tuning, reasoning, code generation, and evaluation benchmarks.
git clone https://github.com/ahammadmejbah/Awesome-Datasets-Hub.git -
multi-agents
Datasets & benchmarksMulti-agent teams for real work: run teams of coding agents (Claude Code, Codex, any model) in isolated git worktrees, and measure whether the team beats a solo agent on cost and results.
git clone https://github.com/BichengWang/multi-agents.git -
DeepResearch-Bench-II
Datasets & benchmarksDeepResearch Bench II (DRB2) is the follow-up to DeepResearch Bench, with a stronger focus on measuring the gap between deep research systems and human experts. It does so by decomposing expert-written reports into hierarchical rubrics covering presentation, analysis, and evidence, and using them to evaluate model-generated.
git clone https://github.com/imlrz/DeepResearch-Bench-II.git -
self-bench
Datasets & benchmarksBenchmark coding agents and models on your own repository with private Harbor-formatted evals built from its merged pull requests.
git clone https://github.com/mupt-ai/self-bench.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.