InnerVault

Library

85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

372 results with any of your words Clear search and filters
  1. WebInstructSub

    Datasets & benchmarks

    Hugging Face dataset by TIGER-Lab

    Stale Hugging Face Hub, TIGER-Lab 170 ♥apache-2.0Updated 2 years ago

    TIGER-Lab/WebInstructSub
  2. Omni-SafetyBench

    Datasets & benchmarks

    [ACM MM 2026 Oral] Code for paper "Omni-SafetyBench: A Benchmark for Safety Evaluation of Audio-Visual Large Language Models".

    Stale GitHub, THU-BPM 115 ★Apache-2.0Updated 2 months ago

    git clone https://github.com/THU-BPM/Omni-SafetyBench.git
  3. JBB-Behaviors

    Datasets & benchmarks

    Hugging Face dataset by JailbreakBench

    Stale Hugging Face Hub, JailbreakBench 139 ♥mitUpdated 2 years ago

    JailbreakBench/JBB-Behaviors
  4. claude_mythos_distilled_25k

    Datasets & benchmarks

    Hugging Face dataset by WithinUsAI

    Stale Hugging Face Hub, WithinUsAI 191 ♥apache-2.0Updated 55 days ago

    WithinUsAI/claude_mythos_distilled_25k
  5. confabulations

    Datasets & benchmarks

    Hallucinations (Confabulations) Document-Based Benchmark for RAG. Includes human-verified questions and answers.

    Stale GitHub, lechmazur 249 ★Updated 15 months ago

    git clone https://github.com/lechmazur/confabulations.git
  6. FastEval

    Datasets & benchmarks

    Fast & more realistic evaluation of chat language models. Includes leaderboard.

    Stale GitHub, FastEval 187 ★Apache-2.0Updated 2 years ago

    git clone https://github.com/FastEval/FastEval.git
  7. swt-bench

    Datasets & benchmarks

    [NeurIPS 2024] Evaluation harness for SWT-Bench, a benchmark for evaluating LLM repository-level test-generation

    Stale GitHub, logic-star-ai 92 ★MITUpdated 13 days ago

    git clone https://github.com/logic-star-ai/swt-bench.git
  8. lasagna

    Datasets & benchmarks

    Swap one RAG pipeline stage, hold the rest fixed, and measure whether the gain survives composition. The framework behind "Retrieval Augmented Generation Compositionality": 450 configurations, eight benchmarks, corpora from 5K to 200K documents.

    Indexed GitHub, dolev31 35 ★Apache-2.0Updated 2 days ago

    git clone https://github.com/dolev31/lasagna.git
  9. minebench

    Datasets & benchmarks

    Minecraft-style voxel benchmark for comparing AI models (Arena + Sandbox)

    Indexed GitHub, Ammaar-Alam 343 ★MITUpdated 5 days ago

    git clone https://github.com/Ammaar-Alam/minebench.git
  10. TurtleBench

    Datasets & benchmarks

    TurtleBench: Evaluating Top Language Models via Real-World Yes/No Puzzles.

    Stale GitHub, mazzzystar 161 ★Apache-2.0Updated 2 years ago

    git clone https://github.com/mazzzystar/TurtleBench.git
  11. SciCode

    Datasets & benchmarks

    A benchmark that challenges language models to code solutions for scientific problems

    Stale GitHub, scicode-bench 246 ★Apache-2.0Updated 15 days ago

    git clone https://github.com/scicode-bench/SciCode.git
  12. active_genie

    Datasets & benchmarks

    The Lodash for GenAI: Real Value + Consistent + Model-Agnostic

    Stale GitHub, Roriz 168 ★Apache-2.0Updated 3 months ago

    git clone https://github.com/Roriz/active_genie.git
  13. pii-masking-200k

    Datasets & benchmarks

    Hugging Face dataset by ai4privacy

    Stale Hugging Face Hub, ai4privacy 129 ♥Updated 5 months ago

    ai4privacy/pii-masking-200k
  14. UHGEval

    Datasets & benchmarks

    [ACL 2024] User-friendly evaluation framework: Eval Suite & Benchmarks: UHGEval, HaluEval, HalluQA, etc.

    Stale GitHub, IAAR-Shanghai 183 ★Apache-2.0Updated 17 months ago

    git clone https://github.com/IAAR-Shanghai/UHGEval.git
  15. meta-agents-research-environments

    Datasets & benchmarks

    Meta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike static benchmarks, this platform introduces evolving environments where agents must adapt their strategies as new information becomes available, mirroring real-world challenges.

    Stale GitHub, facebookresearch 567 ★MITUpdated 48 days ago

    git clone https://github.com/facebookresearch/meta-agents-research-environments.git
  16. LoopArena

    Datasets & benchmarks

    Benchmarking models as runtime Controllers for Loop Engineering

    Stale GitHub, AMAP-ML 151 ★Apache-2.0Updated 33 days ago

    git clone https://github.com/AMAP-ML/LoopArena.git
  17. sloptotal

    Datasets & benchmarks

    Open-source AI text detector and ChatGPT detector: 23 engines, one calibrated score, every number measured on a public benchmark. Self-hosted, runs on CPU.

    Stale GitHub, pablocaeg 98 ★MITUpdated 14 days ago

    git clone https://github.com/pablocaeg/sloptotal.git
  18. PyHealth

    Datasets & benchmarks

    A deep learning toolkit for healthcare AI: EHR (MIMIC, eICU, OMOP), clinical text, signals and imaging. 30+ models, reproducible pipelines.

    Indexed GitHub, sunlabuiuc 1,699 ★MITUpdated yesterday

    git clone https://github.com/sunlabuiuc/PyHealth.git
  19. geobench

    Datasets & benchmarks

    GeoGuessr benchmark for language models

    Indexed GitHub, ccmdi 65 ★MITUpdated 4 days ago

    git clone https://github.com/ccmdi/geobench.git
  20. debate

    Datasets & benchmarks

    Adversarial multi-turn benchmark for LLM debate quality, using side-swapped matchups and multi-model judging to rank models by judged debate performance.

    Stale GitHub, lechmazur 38 ★Updated 22 days ago

    git clone https://github.com/lechmazur/debate.git
  21. ai-hardware-fit

    Datasets & benchmarks

    Can my GPU run this? Pick a GPU to get 3 fitting AI models, quantization, VRAM, speed ranges, and run commands. 한국어·English.

    Indexed GitHub, jaeseok614 44 ★MITUpdated yesterday

    git clone https://github.com/jaeseok614/ai-hardware-fit.git
  22. Ditto

    Datasets & benchmarks

    A self-ailgnment method for role-play. Benchmark for role-play. Resources for "Large Language Models are Superpositions of All Characters: Attaining Arbitrary Role-play via Self-Alignment".

    Stale GitHub, OFA-Sys 214 ★MITUpdated 2 years ago

    git clone https://github.com/OFA-Sys/Ditto.git
  23. humanities_data_benchmark

    Datasets & benchmarks

    LLM Benchmark Suite for Humanities Data

    Stale GitHub, RISE-UNIBAS 32 ★GPL-3.0Updated 13 days ago

    git clone https://github.com/RISE-UNIBAS/humanities_data_benchmark.git
  24. Awesome-AI-Scientist

    Datasets & benchmarks

    🧪 Awesome list of AI Scientist papers, systems, benchmarks, datasets and open-source platforms.

    Indexed GitHub, Omni-Scientist 105 ★Custom licence (see repository)Updated 4 days ago

    git clone https://github.com/Omni-Scientist/Awesome-AI-Scientist.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.