InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. olmOCR-bench

    Datasets & benchmarks

    Hugging Face dataset by allenai

    Indexed Hugging Face Hub, allenai 326 ♥odc-byUpdated 9 months ago

    allenai/olmOCR-bench
  2. agents-last-exam

    Datasets & benchmarks

    Hugging Face dataset by agents-last-exam

    Stale Hugging Face Hub, agents-last-exam 225 ♥cc-by-4.0Updated 33 days ago

    agents-last-exam/agents-last-exam
  3. SWE-bench_Pro

    Datasets & benchmarks

    Hugging Face dataset by ScaleAI

    Stale Hugging Face Hub, ScaleAI 197 ♥Updated 55 days ago

    ScaleAI/SWE-bench_Pro
  4. gsm8k

    Datasets & benchmarks

    Hugging Face dataset by openai

    Indexed Hugging Face Hub, openai 2,046 ♥mitUpdated 7 months ago

    openai/gsm8k
  5. SWE-bench_Verified

    Datasets & benchmarks

    Hugging Face dataset by SWE-bench

    Stale Hugging Face Hub, SWE-bench 188 ♥Updated 3 months ago

    SWE-bench/SWE-bench_Verified
  6. hle

    Datasets & benchmarks

    Hugging Face dataset by cais

    Indexed Hugging Face Hub, cais 1,106 ♥mitUpdated 10 months ago 1 note

    cais/hle
  7. MMLU-Pro

    Datasets & benchmarks

    Hugging Face dataset by TIGER-Lab

    Indexed Hugging Face Hub, TIGER-Lab 602 ♥mitUpdated 6 months ago

    TIGER-Lab/MMLU-Pro
  8. apex-agents

    Datasets & benchmarks

    Hugging Face dataset by mercor

    Stale Hugging Face Hub, mercor 207 ♥cc-by-4.0Updated 5 months ago 1 note

    mercor/apex-agents
  9. ParseBench

    Datasets & benchmarks

    Hugging Face dataset by llamaindex

    Stale Hugging Face Hub, llamaindex 137 ♥apache-2.0Updated 7 months ago

    llamaindex/ParseBench
  10. MMLU-CF

    Datasets & benchmarks

    A Contamination-free Multi-task Language Understanding Benchmark [Official, ACL 2025]

    Stale GitHub, microsoft 127 ★MITUpdated 18 months ago

    git clone https://github.com/microsoft/MMLU-CF.git
  11. gpqa

    Datasets & benchmarks

    Hugging Face dataset by Idavidrein

    Indexed Hugging Face Hub, Idavidrein 642 ♥cc-by-4.0Updated 56 days ago 1 note

    Idavidrein/gpqa
  12. Long-Horizon-Terminal-Bench

    Datasets & benchmarks

    Hugging Face dataset by IntelligenceLab

    Stale Hugging Face Hub, IntelligenceLab 140 ♥apache-2.0Updated 36 days ago

    IntelligenceLab/Long-Horizon-Terminal-Bench
  13. typed-decisions

    Datasets & benchmarks

    Hugging Face dataset by LocalLLaMA

    Indexed Hugging Face Hub, LocalLLaMA 277 ♥apache-2.0Updated today

    LocalLLaMA/typed-decisions
  14. DyCodeEval

    Datasets & benchmarks

    Official repository of the ICML2025 paper “Dynamic Benchmarking of Reasoning Capabilities in Code Large Language Models Under Data Contamination”

    Stale GitHub, SeekingDream 222 ★Updated 10 months ago

    git clone https://github.com/SeekingDream/DyCodeEval.git
  15. ChemLLMBench

    Datasets & benchmarks

    Official Code for What can Large Language Models do in chemistry? A comprehensive benchmark on eight tasks (In NeurIPS 2023)

    Stale GitHub, ChemFoundationModels 176 ★Updated 2 years ago

    git clone https://github.com/ChemFoundationModels/ChemLLMBench.git
  16. doc2harness

    Datasets & benchmarks

    Official Code for the paper "Doc2Harness: Benchmarking LLMs on Long-Horizon Harness Engineering of Coding Agents "

    Stale GitHub, YuyaoGe 116 ★Custom licence (see repository)Updated 20 days ago

    git clone https://github.com/YuyaoGe/doc2harness.git
  17. LLM-eval-survey

    Datasets & benchmarks

    The official GitHub page for the survey paper "A Survey on Evaluation of Large Language Models".

    Stale GitHub, MLGroupJLU 1,615 ★Updated 7 days ago

    git clone https://github.com/MLGroupJLU/LLM-eval-survey.git
  18. NoLiMa

    Datasets & benchmarks

    Official repository for "NoLiMa: Long-Context Evaluation Beyond Literal Matching"

    Stale GitHub, adobe-research 205 ★Custom licence (see repository)Updated 16 months ago

    git clone https://github.com/adobe-research/NoLiMa.git
  19. Static-to-Dynamic-LLMEval

    Datasets & benchmarks

    The official GitHub repository of the paper "Recent advances in large language model benchmarks against data contamination: From static to dynamic evaluation"

    Stale GitHub, SeekingDream 493 ★Updated 49 days ago

    git clone https://github.com/SeekingDream/Static-to-Dynamic-LLMEval.git
  20. Multi-User-LLM-Agent

    Datasets & benchmarks

    Official code for the paper: "Multi-User Large Language Model Agents"

    Stale GitHub, Kordi-AI 39 ★Apache-2.0Updated 7 days ago

    git clone https://github.com/Kordi-AI/Multi-User-LLM-Agent.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.