InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. ChemLLMBench

    Datasets & benchmarks

    Official Code for What can Large Language Models do in chemistry? A comprehensive benchmark on eight tasks (In NeurIPS 2023)

    Stale GitHub, ChemFoundationModels 176 ★Updated 2 years ago

    git clone https://github.com/ChemFoundationModels/ChemLLMBench.git
  2. HallusionBench

    Datasets & benchmarks

    [CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(ision), LLaVA-1.5, and Other Multi-modality Models

    Stale GitHub, tianyi-lab 344 ★BSD-3-ClauseUpdated 13 months ago

    git clone https://github.com/tianyi-lab/HallusionBench.git
  3. OSWorld

    Datasets & benchmarks

    [NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

    Indexed GitHub, xlang-ai 3,262 ★Apache-2.0Updated 2 days ago

    git clone https://github.com/xlang-ai/OSWorld.git
  4. pubmed

    Datasets & benchmarks

    Hugging Face dataset by ncbi

    Stale Hugging Face Hub, ncbi 170 ♥otherUpdated 2 years ago

    ncbi/pubmed
  5. minipile

    Datasets & benchmarks

    Hugging Face dataset by JeanKaddour

    Stale Hugging Face Hub, JeanKaddour 155 ♥otherUpdated 3 years ago

    JeanKaddour/minipile
  6. oscar

    Datasets & benchmarks

    Hugging Face dataset by oscar-corpus

    Stale Hugging Face Hub, oscar-corpus 209 ♥cc0-1.0Updated 14 months ago 1 note

    oscar-corpus/oscar
  7. apps

    Datasets & benchmarks

    Hugging Face dataset by codeparrot

    Stale Hugging Face Hub, codeparrot 212 ♥mitUpdated 4 years ago

    codeparrot/apps
  8. CharacterCodex

    Datasets & benchmarks

    Hugging Face dataset by NousResearch

    Indexed Hugging Face Hub, NousResearch 258 ♥apache-2.0Updated 2 years ago

    NousResearch/CharacterCodex
  9. ParseBench

    Datasets & benchmarks

    ParseBench - A Document Parsing Benchmark for AI Agents

    Indexed GitHub, run-llama 640 ★Apache-2.0Updated today

    git clone https://github.com/run-llama/ParseBench.git
  10. mc4

    Datasets & benchmarks

    Hugging Face dataset by legacy-datasets

    Stale Hugging Face Hub, legacy-datasets 160 ♥odc-byUpdated 2 years ago

    legacy-datasets/mc4
  11. Omni-SafetyBench

    Datasets & benchmarks

    [ACM MM 2026 Oral] Code for paper "Omni-SafetyBench: A Benchmark for Safety Evaluation of Audio-Visual Large Language Models".

    Stale GitHub, THU-BPM 115 ★Apache-2.0Updated 2 months ago

    git clone https://github.com/THU-BPM/Omni-SafetyBench.git
  12. Awesome-LLM-Long-Context-Modeling

    Datasets & benchmarks

    📰 Must-read papers and blogs on LLM based Long Context Modeling 🔥

    Indexed GitHub, Xnhyacinth 2,192 ★MITUpdated 3 days ago

    git clone https://github.com/Xnhyacinth/Awesome-LLM-Long-Context-Modeling.git
  13. SkyPile-150B

    Datasets & benchmarks

    Hugging Face dataset by Skywork

    Indexed Hugging Face Hub, Skywork 421 ♥Updated 2 years ago

    Skywork/SkyPile-150B
  14. LawBench

    Datasets & benchmarks

    Benchmarking Legal Knowledge of Large Language Models

    Stale GitHub, open-compass 455 ★Apache-2.0Updated 3 years ago

    git clone https://github.com/open-compass/LawBench.git
  15. OSCAR-2301

    Datasets & benchmarks

    Hugging Face dataset by oscar-corpus

    Stale Hugging Face Hub, oscar-corpus 187 ♥cc0-1.0Updated 15 months ago 1 note

    oscar-corpus/OSCAR-2301
  16. pile-of-law

    Datasets & benchmarks

    Hugging Face dataset by pile-of-law

    Indexed Hugging Face Hub, pile-of-law 295 ♥cc-by-nc-sa-4.0Updated 4 months ago

    pile-of-law/pile-of-law
  17. aurora

    Datasets & benchmarks

    [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark

    Stale GitHub, wenhaochai 149 ★Apache-2.0Updated 17 months ago

    git clone https://github.com/wenhaochai/aurora.git
  18. TACO

    Datasets & benchmarks

    Hugging Face dataset by BAAI

    Stale Hugging Face Hub, BAAI 144 ♥apache-2.0Updated 2 years ago

    BAAI/TACO
  19. xFinder

    Datasets & benchmarks

    [ICLR 2025] xFinder: Large Language Models as Automated Evaluators for Reliable Evaluation

    Stale GitHub, IAAR-Shanghai 178 ★Custom licence (see repository)Updated 12 months ago

    git clone https://github.com/IAAR-Shanghai/xFinder.git
  20. WebInstructSub

    Datasets & benchmarks

    Hugging Face dataset by TIGER-Lab

    Stale Hugging Face Hub, TIGER-Lab 170 ♥apache-2.0Updated 2 years ago

    TIGER-Lab/WebInstructSub
  21. Matrix

    Datasets & benchmarks

    Hugging Face dataset by m-a-p

    Stale Hugging Face Hub, m-a-p 180 ♥apache-2.0Updated 20 months ago

    m-a-p/Matrix
  22. LightCompress

    Datasets & benchmarks

    [EMNLP 2024 & AAAI 2026] A powerful toolkit for compressing large models including LLMs, VLMs, and video generative models.

    Stale GitHub, ModelTC 751 ★Apache-2.0Updated 6 months ago

    git clone https://github.com/ModelTC/LightCompress.git
  23. OSWorld-V2

    Datasets & benchmarks

    OSWorld 2.0: Benchmarking Computer Use Agents on Long-Horizon Real-World Tasks

    Indexed GitHub, xlang-ai 421 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/xlang-ai/OSWorld-V2.git
  24. JBB-Behaviors

    Datasets & benchmarks

    Hugging Face dataset by JailbreakBench

    Stale Hugging Face Hub, JailbreakBench 139 ♥mitUpdated 2 years ago

    JailbreakBench/JBB-Behaviors

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.