InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. empathetic_dialogues

    Datasets & benchmarks

    Hugging Face dataset by facebook

    Stale Hugging Face Hub, facebook 137 ♥cc-by-nc-4.0Updated 2 years ago

    facebook/empathetic_dialogues
  2. natural_questions

    Datasets & benchmarks

    Hugging Face dataset by google-research-datasets

    Stale Hugging Face Hub, google-research-datasets 130 ♥cc-by-sa-3.0Updated 2 years ago

    google-research-datasets/natural_questions
  3. medmcqa

    Datasets & benchmarks

    Hugging Face dataset by openlifescienceai

    Indexed Hugging Face Hub, openlifescienceai 252 ♥apache-2.0Updated 2 years ago

    openlifescienceai/medmcqa
  4. Big-Math-RL-Verified

    Datasets & benchmarks

    Hugging Face dataset by SynthLabsAI

    Indexed Hugging Face Hub, SynthLabsAI 246 ♥apache-2.0Updated 20 months ago 1 note

    SynthLabsAI/Big-Math-RL-Verified
  5. openbookqa

    Datasets & benchmarks

    Hugging Face dataset by allenai

    Stale Hugging Face Hub, allenai 156 ♥unknownUpdated 2 years ago

    allenai/openbookqa
  6. truthful_qa

    Datasets & benchmarks

    Hugging Face dataset by truthfulqa

    Indexed Hugging Face Hub, truthfulqa 301 ♥apache-2.0Updated 2 years ago

    truthfulqa/truthful_qa
  7. hacker-news

    Datasets & benchmarks

    Hugging Face dataset by open-index

    Indexed Hugging Face Hub, open-index 587 ♥odc-byUpdated 2 months ago

    open-index/hacker-news
  8. teor

    Datasets & benchmarks

    Benchmark aberto de LLMs para o processo legislativo brasileiro

    Stale GitHub, como-votam 30 ★Apache-2.0Updated 18 days ago

    git clone https://github.com/como-votam/teor.git
  9. SlimOrca

    Datasets & benchmarks

    Hugging Face dataset by Open-Orca

    Indexed Hugging Face Hub, Open-Orca 310 ♥mitUpdated 3 years ago

    Open-Orca/SlimOrca
  10. xFinder

    Datasets & benchmarks

    [ICLR 2025] xFinder: Large Language Models as Automated Evaluators for Reliable Evaluation

    Stale GitHub, IAAR-Shanghai 178 ★Custom licence (see repository)Updated 12 months ago

    git clone https://github.com/IAAR-Shanghai/xFinder.git
  11. ClawBench

    Datasets & benchmarks

    Open-source benchmark for browser AI agents on daily tasks.

    Stale GitHub, TIGER-AI-Lab 1,229 ★Apache-2.0Updated 11 days ago

    git clone https://github.com/TIGER-AI-Lab/ClawBench.git
  12. MathVista

    Datasets & benchmarks

    Hugging Face dataset by AI4Math

    Stale Hugging Face Hub, AI4Math 235 ♥cc-by-sa-4.0Updated 2 years ago

    AI4Math/MathVista
  13. opencompass

    Datasets & benchmarks

    OpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.

    Indexed GitHub, open-compass 7,596 ★Apache-2.0Updated 5 days ago

    git clone https://github.com/open-compass/opencompass.git
  14. ScienceQA

    Datasets & benchmarks

    Hugging Face dataset by derek-thomas

    Indexed Hugging Face Hub, derek-thomas 244 ♥cc-by-sa-4.0Updated 3 years ago

    derek-thomas/ScienceQA
  15. alem-env

    Datasets & benchmarks

    Can LLM/MARL agents coordinate in long-horizon, open-ended tasks? NeurIPS 2026 (Evaluations and Datasets).

    Stale GitHub, alem-world 57 ★MITUpdated 11 days ago

    git clone https://github.com/alem-world/alem-env.git
  16. LawBench

    Datasets & benchmarks

    Benchmarking Legal Knowledge of Large Language Models

    Stale GitHub, open-compass 455 ★Apache-2.0Updated 3 years ago

    git clone https://github.com/open-compass/LawBench.git
  17. xVerify

    Datasets & benchmarks

    xVerify: Efficient Answer Verifier for Reasoning Model Evaluations

    Stale GitHub, IAAR-Shanghai 150 ★Custom licence (see repository)Updated 19 days ago

    git clone https://github.com/IAAR-Shanghai/xVerify.git
  18. openbench

    Datasets & benchmarks

    Same model, different wrapper: a from-scratch benchmark comparing coding-agent harnesses (codex, pi, opencode, cursor, devin) and open models on correctness, speed, and token cost

    Stale GitHub, minghinmatthewlam 137 ★MITUpdated 2 months ago

    git clone https://github.com/minghinmatthewlam/openbench.git
  19. o11y-bench

    Datasets & benchmarks

    Open benchmark on observability tasks built on Harbor

    Indexed GitHub, grafana 80 ★AGPL-3.0Updated today

    git clone https://github.com/grafana/o11y-bench.git
  20. NIMStats

    Datasets & benchmarks

    📊 Automated hourly benchmarks for 20+ NVIDIA NIM models — interactive dashboard, zero infra, self-hostable. Open-source & community-driven.

    Indexed GitHub, MauroDruwel 57 ★Updated today

    git clone https://github.com/MauroDruwel/NIMStats.git
  21. OSWorld

    Datasets & benchmarks

    [NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

    Indexed GitHub, xlang-ai 3,262 ★Apache-2.0Updated 2 days ago

    git clone https://github.com/xlang-ai/OSWorld.git
  22. AgentLab

    Datasets & benchmarks

    AgentLab: An open-source framework for developing, testing, and benchmarking web agents on diverse tasks, designed for scalability and reproducibility.

    Stale GitHub, ServiceNow 653 ★Custom licence (see repository)Updated 41 days ago

    git clone https://github.com/ServiceNow/AgentLab.git
  23. Awesome-AI-Scientist

    Datasets & benchmarks

    🧪 Awesome list of AI Scientist papers, systems, benchmarks, datasets and open-source platforms.

    Indexed GitHub, Omni-Scientist 105 ★Custom licence (see repository)Updated 3 days ago

    git clone https://github.com/Omni-Scientist/Awesome-AI-Scientist.git
  24. seo-skill-bench

    Datasets & benchmarks

    Open benchmark for Claude Code SEO skills — real headless execution against fixture sites with planted-defect answer keys. Deterministic scoring, pre-registered rubric.

    Stale GitHub, aleclindz 51 ★MITUpdated 32 days ago

    git clone https://github.com/aleclindz/seo-skill-bench.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.