InnerVault

Library

85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.

Results

  1. MegaMath

    Datasets & benchmarks

    Hugging Face dataset by IFM

    Stale Hugging Face Hub, IFM 141 ♥odc-byUpdated 19 months ago

    IFM/MegaMath
  2. Hugging Face dataset by nisten

    Indexed Hugging Face Hub, nisten 351 ♥apache-2.0Updated 50 days ago

    nisten/opus5-5-doctor-patient-conversations-all-human-diseases
  3. PMC-Patients

    Datasets & benchmarks

    Hugging Face dataset by zhengyun21

    Stale Hugging Face Hub, zhengyun21 148 ♥cc-by-nc-sa-4.0Updated 23 months ago

    zhengyun21/PMC-Patients
  4. opengenome2

    Datasets & benchmarks

    Hugging Face dataset by arcinstitute

    Stale Hugging Face Hub, arcinstitute 166 ♥apache-2.0Updated 2 months ago

    arcinstitute/opengenome2
  5. mac-ml-speed-test

    Datasets & benchmarks

    A few quick scripts focused on testing TensorFlow/PyTorch/Llama 2 on macOS.

    Stale GitHub, mrdbourke 203 ★Updated 2 years ago

    git clone https://github.com/mrdbourke/mac-ml-speed-test.git
  6. LightCompress

    Datasets & benchmarks

    [EMNLP 2024 & AAAI 2026] A powerful toolkit for compressing large models including LLMs, VLMs, and video generative models.

    Stale GitHub, ModelTC 751 ★Apache-2.0Updated 6 months ago

    git clone https://github.com/ModelTC/LightCompress.git
  7. tmmluplus

    Datasets & benchmarks

    Hugging Face dataset by ikala

    Indexed Hugging Face Hub, ikala 242 ♥mitUpdated 54 days ago

    ikala/tmmluplus
  8. MMMU

    Datasets & benchmarks

    Hugging Face dataset by MMMU

    Indexed Hugging Face Hub, MMMU 347 ♥apache-2.0Updated 42 days ago

    MMMU/MMMU
  9. RubricHub_v1

    Datasets & benchmarks

    Hugging Face dataset by sojuL

    Indexed Hugging Face Hub, sojuL 282 ♥apache-2.0Updated 9 months ago

    sojuL/RubricHub_v1
  10. guidelines

    Datasets & benchmarks

    Hugging Face dataset by epfl-llm

    Stale Hugging Face Hub, epfl-llm 163 ♥otherUpdated 2 years ago

    epfl-llm/guidelines
  11. ChatMed_Consult_Dataset

    Datasets & benchmarks

    Hugging Face dataset by michaelwzhu

    Stale Hugging Face Hub, michaelwzhu 143 ♥cc-by-4.0Updated 3 years ago

    michaelwzhu/ChatMed_Consult_Dataset
  12. apex-agents

    Datasets & benchmarks

    Hugging Face dataset by mercor

    Stale Hugging Face Hub, mercor 207 ♥cc-by-4.0Updated 5 months ago 1 note

    mercor/apex-agents
  13. dialogsum

    Datasets & benchmarks

    Hugging Face dataset by knkarthick

    Indexed Hugging Face Hub, knkarthick 259 ♥cc-by-nc-sa-4.0Updated 3 years ago

    knkarthick/dialogsum
  14. Simreal-MLBench

    Datasets & benchmarks

    [Public preview] Externally scored agentic ML research benchmark: 60 tasks, real competition ground truth. Open protocol, operated evaluation.

    Stale GitHub, Simreal-AI 301 ★Apache-2.0Updated 53 days ago

    git clone https://github.com/Simreal-AI/Simreal-MLBench.git
  15. deepmark

    Datasets & benchmarks

    Deepmark AI enables a unique testing environment for language models (LLM) assessment on task-specific metrics and on your own data so your GenAI-powered solution has predictable and reliable performance.

    Stale GitHub, IngestAI 104 ★AGPL-3.0Updated 2 years ago

    git clone https://github.com/IngestAI/deepmark.git
  16. strix-halo-guide

    Datasets & benchmarks

    Evidence-backed AMD Strix Halo local-AI setup and benchmarks: Qwen3.8, Ollama, llama.cpp, Vulkan/ROCm, large GGUFs, and cross-OEM results.

    Stale GitHub, hogeheer499-commits 373 ★MITUpdated 7 days ago

    git clone https://github.com/hogeheer499-commits/strix-halo-guide.git
  17. SGI-Bench

    Datasets & benchmarks

    Probing Scientific General Intelligence of LLMs with Scientist-Aligned Workflows

    Stale GitHub, InternScience 172 ★MITUpdated 5 months ago

    git clone https://github.com/InternScience/SGI-Bench.git
  18. Ditto

    Datasets & benchmarks

    A self-ailgnment method for role-play. Benchmark for role-play. Resources for "Large Language Models are Superpositions of All Characters: Attaining Arbitrary Role-play via Self-Alignment".

    Stale GitHub, OFA-Sys 214 ★MITUpdated 2 years ago

    git clone https://github.com/OFA-Sys/Ditto.git
  19. Glyd

    Datasets & benchmarks

    Lossless AI compression: 33% less GPU memory, bit for bit.

    Stale GitHub, surya-koritala 321 ★Custom licence (see repository)Updated 14 days ago

    git clone https://github.com/surya-koritala/Glyd.git
  20. AIRTBench-Code

    Datasets & benchmarks

    Code Repository for: AIRTBench: Measuring Autonomous AI Red Teaming Capabilities in Language Models

    Stale GitHub, dreadnode 111 ★Apache-2.0Updated 32 days ago

    git clone https://github.com/dreadnode/AIRTBench-Code.git
  21. Awesome-Datasets-Hub

    Datasets & benchmarks

    A curated collection of datasets for Large Language Models (LLMs), covering medical AI, NLP, multimodal learning, instruction tuning, reasoning, code generation, and evaluation benchmarks.

    Stale GitHub, ahammadmejbah 149 ★Updated 4 months ago

    git clone https://github.com/ahammadmejbah/Awesome-Datasets-Hub.git
  22. multi-agents

    Datasets & benchmarks

    Multi-agent teams for real work: run teams of coding agents (Claude Code, Codex, any model) in isolated git worktrees, and measure whether the team beats a solo agent on cost and results.

    Stale GitHub, BichengWang 158 ★MITUpdated 8 days ago

    git clone https://github.com/BichengWang/multi-agents.git
  23. DeepResearch-Bench-II

    Datasets & benchmarks

    DeepResearch Bench II (DRB2) is the follow-up to DeepResearch Bench, with a stronger focus on measuring the gap between deep research systems and human experts. It does so by decomposing expert-written reports into hierarchical rubrics covering presentation, analysis, and evidence, and using them to evaluate model-generated.

    Stale GitHub, imlrz 96 ★Apache-2.0Updated 28 days ago

    git clone https://github.com/imlrz/DeepResearch-Bench-II.git
  24. self-bench

    Datasets & benchmarks

    Benchmark coding agents and models on your own repository with private Harbor-formatted evals built from its merged pull requests.

    Indexed GitHub, mupt-ai 34 ★MITUpdated today

    git clone https://github.com/mupt-ai/self-bench.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.