Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
mac-ml-speed-test
Datasets & benchmarksA few quick scripts focused on testing TensorFlow/PyTorch/Llama 2 on macOS.
git clone https://github.com/mrdbourke/mac-ml-speed-test.git -
emotion
Datasets & benchmarksHugging Face dataset by dair-ai
dair-ai/emotion -
Awesome-Datasets-Hub
Datasets & benchmarksA curated collection of datasets for Large Language Models (LLMs), covering medical AI, NLP, multimodal learning, instruction tuning, reasoning, code generation, and evaluation benchmarks.
git clone https://github.com/ahammadmejbah/Awesome-Datasets-Hub.git -
peoples_speech
Datasets & benchmarksHugging Face dataset by MLCommons
MLCommons/peoples_speech -
ParseBench
Datasets & benchmarksParseBench - A Document Parsing Benchmark for AI Agents
git clone https://github.com/run-llama/ParseBench.git -
chembench
Datasets & benchmarksHow good are LLMs at chemistry?
git clone https://github.com/lamalab-org/chembench.git -
wikisql
Datasets & benchmarksHugging Face dataset by Salesforce
Salesforce/wikisql -
PyHealth
Datasets & benchmarksA deep learning toolkit for healthcare AI: EHR (MIMIC, eICU, OMOP), clinical text, signals and imaging. 30+ models, reproducible pipelines.
git clone https://github.com/sunlabuiuc/PyHealth.git -
pokemon-blip-captions
Datasets & benchmarksHugging Face dataset by lambda
lambda/pokemon-blip-captions -
PubMedQA
Datasets & benchmarksHugging Face dataset by qiaojin
qiaojin/PubMedQA -
fleurs
Datasets & benchmarksHugging Face dataset by google
google/fleurs -
spider
Datasets & benchmarksHugging Face dataset by xlangai
xlangai/spider -
Simreal-MLBench
Datasets & benchmarks[Public preview] Externally scored agentic ML research benchmark: 60 tasks, real competition ground truth. Open protocol, operated evaluation.
git clone https://github.com/Simreal-AI/Simreal-MLBench.git -
soda
Datasets & benchmarksHugging Face dataset by allenai
allenai/soda -
finephrase
Datasets & benchmarksHugging Face dataset by HuggingFaceFW
HuggingFaceFW/finephrase -
jupyter-agent-dataset
Datasets & benchmarksHugging Face dataset by jupyter-agent
jupyter-agent/jupyter-agent-dataset -
Awesome-LLM-Eval
Datasets & benchmarksAwesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, leaderboard, papers, docs and models, mainly for Evaluation on LLMs. 一个由工具、基准/数据、演示、排行榜和大模型等组成的精选列表,主要面向基础大模型评测,旨在探求生成式AI的技术边界.
git clone https://github.com/onejune2018/Awesome-LLM-Eval.git -
code_search_net
Datasets & benchmarksHugging Face dataset by code-search-net
code-search-net/code_search_net -
TrustLLM
Datasets & benchmarks[ICML 2024] TrustLLM: LLM trustworthiness evaluation across truthfulness, safety, fairness, robustness, privacy and ethics. Python/CLI toolkit for local models, compatible APIs and AI agent orchestration.
git clone https://github.com/HowieHwong/TrustLLM.git -
NIMStats
Datasets & benchmarks📊 Automated hourly benchmarks for 20+ NVIDIA NIM models — interactive dashboard, zero infra, self-hostable. Open-source & community-driven.
git clone https://github.com/MauroDruwel/NIMStats.git -
autoguardrails
Datasets & benchmarksAlignment-research scaffold (autoresearch-style) for LLM guardrails: search over a single policy.md surface
git clone https://github.com/SantanderAI/autoguardrails.git -
trivia_qa
Datasets & benchmarksHugging Face dataset by mandarjoshi
mandarjoshi/trivia_qa -
CodeX-2M-Thinking
Datasets & benchmarksHugging Face dataset by Modotte
Modotte/CodeX-2M-Thinking -
LongPage
Datasets & benchmarksHugging Face dataset by Pageshift-Entertainment
Pageshift-Entertainment/LongPage
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.