InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. mac-ml-speed-test

    Datasets & benchmarks

    A few quick scripts focused on testing TensorFlow/PyTorch/Llama 2 on macOS.

    Stale GitHub, mrdbourke 203 ★Updated 2 years ago

    git clone https://github.com/mrdbourke/mac-ml-speed-test.git
  2. emotion

    Datasets & benchmarks

    Hugging Face dataset by dair-ai

    Indexed Hugging Face Hub, dair-ai 491 ♥otherUpdated 2 years ago

    dair-ai/emotion
  3. Awesome-Datasets-Hub

    Datasets & benchmarks

    A curated collection of datasets for Large Language Models (LLMs), covering medical AI, NLP, multimodal learning, instruction tuning, reasoning, code generation, and evaluation benchmarks.

    Stale GitHub, ahammadmejbah 149 ★Updated 4 months ago

    git clone https://github.com/ahammadmejbah/Awesome-Datasets-Hub.git
  4. peoples_speech

    Datasets & benchmarks

    Hugging Face dataset by MLCommons

    Indexed Hugging Face Hub, MLCommons 305 ♥cc-by-2.0Updated 24 months ago

    MLCommons/peoples_speech
  5. ParseBench

    Datasets & benchmarks

    ParseBench - A Document Parsing Benchmark for AI Agents

    Indexed GitHub, run-llama 640 ★Apache-2.0Updated today

    git clone https://github.com/run-llama/ParseBench.git
  6. chembench

    Datasets & benchmarks

    How good are LLMs at chemistry?

    Stale GitHub, lamalab-org 147 ★MITUpdated 9 months ago

    git clone https://github.com/lamalab-org/chembench.git
  7. wikisql

    Datasets & benchmarks

    Hugging Face dataset by Salesforce

    Stale Hugging Face Hub, Salesforce 128 ♥unknownUpdated 2 years ago

    Salesforce/wikisql
  8. PyHealth

    Datasets & benchmarks

    A deep learning toolkit for healthcare AI: EHR (MIMIC, eICU, OMOP), clinical text, signals and imaging. 30+ models, reproducible pipelines.

    Indexed GitHub, sunlabuiuc 1,699 ★MITUpdated today

    git clone https://github.com/sunlabuiuc/PyHealth.git
  9. pokemon-blip-captions

    Datasets & benchmarks

    Hugging Face dataset by lambda

    Indexed Hugging Face Hub, lambda 316 ♥cc-by-nc-sa-4.0Updated 2 years ago 1 note

    lambda/pokemon-blip-captions
  10. PubMedQA

    Datasets & benchmarks

    Hugging Face dataset by qiaojin

    Indexed Hugging Face Hub, qiaojin 360 ♥mitUpdated 2 years ago

    qiaojin/PubMedQA
  11. fleurs

    Datasets & benchmarks

    Hugging Face dataset by google

    Indexed Hugging Face Hub, google 513 ♥cc-by-4.0Updated 6 months ago

    google/fleurs
  12. spider

    Datasets & benchmarks

    Hugging Face dataset by xlangai

    Stale Hugging Face Hub, xlangai 188 ♥cc-by-sa-4.0Updated 2 years ago

    xlangai/spider
  13. Simreal-MLBench

    Datasets & benchmarks

    [Public preview] Externally scored agentic ML research benchmark: 60 tasks, real competition ground truth. Open protocol, operated evaluation.

    Stale GitHub, Simreal-AI 301 ★Apache-2.0Updated 53 days ago

    git clone https://github.com/Simreal-AI/Simreal-MLBench.git
  14. soda

    Datasets & benchmarks

    Hugging Face dataset by allenai

    Stale Hugging Face Hub, allenai 164 ♥cc-by-4.0Updated 3 years ago

    allenai/soda
  15. finephrase

    Datasets & benchmarks

    Hugging Face dataset by HuggingFaceFW

    Stale Hugging Face Hub, HuggingFaceFW 157 ♥odc-byUpdated 7 months ago

    HuggingFaceFW/finephrase
  16. jupyter-agent-dataset

    Datasets & benchmarks

    Hugging Face dataset by jupyter-agent

    Stale Hugging Face Hub, jupyter-agent 177 ♥apache-2.0Updated 14 months ago

    jupyter-agent/jupyter-agent-dataset
  17. Awesome-LLM-Eval

    Datasets & benchmarks

    Awesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, leaderboard, papers, docs and models, mainly for Evaluation on LLMs. 一个由工具、基准/数据、演示、排行榜和大模型等组成的精选列表,主要面向基础大模型评测,旨在探求生成式AI的技术边界.

    Stale GitHub, onejune2018 659 ★MITUpdated 11 months ago

    git clone https://github.com/onejune2018/Awesome-LLM-Eval.git
  18. code_search_net

    Datasets & benchmarks

    Hugging Face dataset by code-search-net

    Indexed Hugging Face Hub, code-search-net 353 ♥otherUpdated 8 months ago

    code-search-net/code_search_net
  19. TrustLLM

    Datasets & benchmarks

    [ICML 2024] TrustLLM: LLM trustworthiness evaluation across truthfulness, safety, fairness, robustness, privacy and ethics. Python/CLI toolkit for local models, compatible APIs and AI agent orchestration.

    Stale GitHub, HowieHwong 632 ★MITUpdated 43 days ago

    git clone https://github.com/HowieHwong/TrustLLM.git
  20. NIMStats

    Datasets & benchmarks

    📊 Automated hourly benchmarks for 20+ NVIDIA NIM models — interactive dashboard, zero infra, self-hostable. Open-source & community-driven.

    Indexed GitHub, MauroDruwel 57 ★Updated today

    git clone https://github.com/MauroDruwel/NIMStats.git
  21. autoguardrails

    Datasets & benchmarks

    Alignment-research scaffold (autoresearch-style) for LLM guardrails: search over a single policy.md surface

    Stale GitHub, SantanderAI 129 ★Apache-2.0Updated 46 days ago

    git clone https://github.com/SantanderAI/autoguardrails.git
  22. trivia_qa

    Datasets & benchmarks

    Hugging Face dataset by mandarjoshi

    Stale Hugging Face Hub, mandarjoshi 212 ♥unknownUpdated 2 years ago

    mandarjoshi/trivia_qa
  23. CodeX-2M-Thinking

    Datasets & benchmarks

    Hugging Face dataset by Modotte

    Stale Hugging Face Hub, Modotte 129 ♥apache-2.0Updated 9 months ago

    Modotte/CodeX-2M-Thinking
  24. LongPage

    Datasets & benchmarks

    Hugging Face dataset by Pageshift-Entertainment

    Stale Hugging Face Hub, Pageshift-Entertainment 161 ♥cc-by-4.0Updated 10 months ago

    Pageshift-Entertainment/LongPage

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.