InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. SWE-bench_Verified

    Datasets & benchmarks

    Hugging Face dataset by princeton-nlp

    Indexed Hugging Face Hub, princeton-nlp 411 ♥Updated 21 months ago

    princeton-nlp/SWE-bench_Verified
  2. minebench

    Datasets & benchmarks

    Minecraft-style voxel benchmark for comparing AI models (Arena + Sandbox)

    Indexed GitHub, Ammaar-Alam 343 ★MITUpdated 4 days ago

    git clone https://github.com/Ammaar-Alam/minebench.git
  3. NoLiMa

    Datasets & benchmarks

    Official repository for "NoLiMa: Long-Context Evaluation Beyond Literal Matching"

    Stale GitHub, adobe-research 205 ★Custom licence (see repository)Updated 16 months ago

    git clone https://github.com/adobe-research/NoLiMa.git
  4. SWE-bench

    Datasets & benchmarks

    Hugging Face dataset by princeton-nlp

    Stale Hugging Face Hub, princeton-nlp 152 ♥Updated 20 months ago

    princeton-nlp/SWE-bench
  5. WritingBench

    Datasets & benchmarks

    WritingBench: A Comprehensive Benchmark for Generative Writing

    Stale GitHub, X-PLUG 202 ★Apache-2.0Updated 11 months ago

    git clone https://github.com/X-PLUG/WritingBench.git
  6. multimodal_textbook

    Datasets & benchmarks

    Hugging Face dataset by DAMO-NLP-SG

    Stale Hugging Face Hub, DAMO-NLP-SG 166 ♥apache-2.0Updated 20 months ago

    DAMO-NLP-SG/multimodal_textbook
  7. ChemLLMBench

    Datasets & benchmarks

    Official Code for What can Large Language Models do in chemistry? A comprehensive benchmark on eight tasks (In NeurIPS 2023)

    Stale GitHub, ChemFoundationModels 176 ★Updated 2 years ago

    git clone https://github.com/ChemFoundationModels/ChemLLMBench.git
  8. sql-create-context

    Datasets & benchmarks

    Hugging Face dataset by b-mc2

    Indexed Hugging Face Hub, b-mc2 518 ♥cc-by-4.0Updated 2 years ago

    b-mc2/sql-create-context
  9. PyHealth

    Datasets & benchmarks

    A deep learning toolkit for healthcare AI: EHR (MIMIC, eICU, OMOP), clinical text, signals and imaging. 30+ models, reproducible pipelines.

    Indexed GitHub, sunlabuiuc 1,699 ★MITUpdated today

    git clone https://github.com/sunlabuiuc/PyHealth.git
  10. AmericanStories

    Datasets & benchmarks

    Hugging Face dataset by dell-research-harvard

    Stale Hugging Face Hub, dell-research-harvard 181 ♥cc-by-4.0Updated 20 months ago

    dell-research-harvard/AmericanStories
  11. opus-100

    Datasets & benchmarks

    Hugging Face dataset by Helsinki-NLP

    Indexed Hugging Face Hub, Helsinki-NLP 260 ♥unknownUpdated 2 years ago

    Helsinki-NLP/opus-100
  12. Awesome-LLM-Eval

    Datasets & benchmarks

    Awesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, leaderboard, papers, docs and models, mainly for Evaluation on LLMs. 一个由工具、基准/数据、演示、排行榜和大模型等组成的精选列表,主要面向基础大模型评测,旨在探求生成式AI的技术边界.

    Stale GitHub, onejune2018 659 ★MITUpdated 11 months ago

    git clone https://github.com/onejune2018/Awesome-LLM-Eval.git
  13. TrustLLM

    Datasets & benchmarks

    [ICML 2024] TrustLLM: LLM trustworthiness evaluation across truthfulness, safety, fairness, robustness, privacy and ethics. Python/CLI toolkit for local models, compatible APIs and AI agent orchestration.

    Stale GitHub, HowieHwong 632 ★MITUpdated 43 days ago

    git clone https://github.com/HowieHwong/TrustLLM.git
  14. Awesome-Datasets-Hub

    Datasets & benchmarks

    A curated collection of datasets for Large Language Models (LLMs), covering medical AI, NLP, multimodal learning, instruction tuning, reasoning, code generation, and evaluation benchmarks.

    Stale GitHub, ahammadmejbah 149 ★Updated 4 months ago

    git clone https://github.com/ahammadmejbah/Awesome-Datasets-Hub.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.