InnerVault

Library

85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. ChartVerse-SFT-1.8M

    Datasets & benchmarks

    Hugging Face dataset by opendatalab

    Stale Hugging Face Hub, opendatalab 140 ♥apache-2.0Updated 9 months ago

    opendatalab/ChartVerse-SFT-1.8M
  2. ClawBench

    Datasets & benchmarks

    Open-source benchmark for browser AI agents on daily tasks.

    Stale GitHub, TIGER-AI-Lab 1,229 ★Apache-2.0Updated 12 days ago

    git clone https://github.com/TIGER-AI-Lab/ClawBench.git
  3. natural_questions

    Datasets & benchmarks

    Hugging Face dataset by google-research-datasets

    Stale Hugging Face Hub, google-research-datasets 130 ♥cc-by-sa-3.0Updated 2 years ago

    google-research-datasets/natural_questions
  4. seo-skill-bench

    Datasets & benchmarks

    Open benchmark for Claude Code SEO skills — real headless execution against fixture sites with planted-defect answer keys. Deterministic scoring, pre-registered rubric.

    Stale GitHub, aleclindz 51 ★MITUpdated 33 days ago

    git clone https://github.com/aleclindz/seo-skill-bench.git
  5. sloptotal

    Datasets & benchmarks

    Open-source AI text detector and ChatGPT detector: 23 engines, one calibrated score, every number measured on a public benchmark. Self-hosted, runs on CPU.

    Stale GitHub, pablocaeg 98 ★MITUpdated 14 days ago

    git clone https://github.com/pablocaeg/sloptotal.git
  6. MathVista

    Datasets & benchmarks

    Hugging Face dataset by AI4Math

    Stale Hugging Face Hub, AI4Math 235 ♥cc-by-sa-4.0Updated 2 years ago

    AI4Math/MathVista
  7. xFinder

    Datasets & benchmarks

    [ICLR 2025] xFinder: Large Language Models as Automated Evaluators for Reliable Evaluation

    Stale GitHub, IAAR-Shanghai 178 ★Custom licence (see repository)Updated 12 months ago

    git clone https://github.com/IAAR-Shanghai/xFinder.git
  8. ScienceQA

    Datasets & benchmarks

    Hugging Face dataset by derek-thomas

    Indexed Hugging Face Hub, derek-thomas 244 ♥cc-by-sa-4.0Updated 3 years ago

    derek-thomas/ScienceQA
  9. o11y-bench

    Datasets & benchmarks

    Open benchmark on observability tasks built on Harbor

    Indexed GitHub, grafana 80 ★AGPL-3.0Updated yesterday

    git clone https://github.com/grafana/o11y-bench.git
  10. xorcise

    Datasets & benchmarks

    Run cyber-AI agents against real missions in isolated environments. Record everything as OpenTelemetry evidence. Grade the evidence, not the claim.

    Stale GitHub, xorcise-ai 33 ★Custom licence (see repository)Updated 18 days ago

    git clone https://github.com/xorcise-ai/xorcise.git
  11. NextTransformer

    Datasets & benchmarks

    :sunrise: A comprehensive, cutting-edge open-source framework for next-generation Transformers/LLM, with compute-matched benchmarking and a platform for autonomous architecture research.

    Indexed GitHub, Interactive-Active-AI 435 ★MITUpdated yesterday

    git clone https://github.com/Interactive-Active-AI/NextTransformer.git
  12. teor

    Datasets & benchmarks

    Benchmark aberto de LLMs para o processo legislativo brasileiro

    Stale GitHub, como-votam 30 ★Apache-2.0Updated 19 days ago

    git clone https://github.com/como-votam/teor.git
  13. multi-agents

    Datasets & benchmarks

    Multi-agent teams for real work: run teams of coding agents (Claude Code, Codex, any model) in isolated git worktrees, and measure whether the team beats a solo agent on cost and results.

    Stale GitHub, BichengWang 158 ★MITUpdated 9 days ago

    git clone https://github.com/BichengWang/multi-agents.git
  14. tulu-3-sft-mixture

    Datasets & benchmarks

    Hugging Face dataset by allenai

    Indexed Hugging Face Hub, allenai 284 ♥odc-byUpdated 23 months ago

    allenai/tulu-3-sft-mixture
  15. Simreal-MLBench

    Datasets & benchmarks

    [Public preview] Externally scored agentic ML research benchmark: 60 tasks, real competition ground truth. Open protocol, operated evaluation.

    Stale GitHub, Simreal-AI 301 ★Apache-2.0Updated 54 days ago

    git clone https://github.com/Simreal-AI/Simreal-MLBench.git
  16. llm-value-rankings

    Datasets & benchmarks

    Daily LLM value rankings - compare 300+ models by intelligence, speed and price. OpenRouter + Artificial Analysis. 大模型性价比排行榜

    Indexed GitHub, yyh-001 30 ★MITUpdated 2 days ago

    git clone https://github.com/yyh-001/llm-value-rankings.git
  17. qwen38-strix-halo-harness

    Datasets & benchmarks

    AI coding agent harness for any hardware, local or cloud (OpenAI-compatible engines). Tuned for AMD Strix Halo: Qwen3.8 125B on the iGPU, NPU side-jobs, crash recovery, logged benchmarks.

    Stale GitHub, aic0d3r 38 ★MITUpdated 9 days ago

    git clone https://github.com/aic0d3r/qwen38-strix-halo-harness.git
  18. One-Eval

    Datasets & benchmarks

    Automated system for LLM evaluation via agents. Doc as below:

    Stale GitHub, OpenDCAI 165 ★Apache-2.0Updated 2 months ago

    git clone https://github.com/OpenDCAI/One-Eval.git
  19. alem-env

    Datasets & benchmarks

    Can LLM/MARL agents coordinate in long-horizon, open-ended tasks? NeurIPS 2026 (Evaluations and Datasets).

    Stale GitHub, alem-world 57 ★MITUpdated 12 days ago

    git clone https://github.com/alem-world/alem-env.git
  20. primitive-bench

    Datasets & benchmarks

    The marketplace for verifiable AI outcomes: state a task, get a fixed price upfront, and Primitive Bench routes across tools to complete it, refunded if the outcome isn't delivered. This repo is the open verification layer.

    Stale GitHub, primitive-bench 122 ★Apache-2.0Updated 2 months ago

    git clone https://github.com/primitive-bench/primitive-bench.git
  21. Awesome-AI-Scientist

    Datasets & benchmarks

    🧪 Awesome list of AI Scientist papers, systems, benchmarks, datasets and open-source platforms.

    Indexed GitHub, Omni-Scientist 105 ★Custom licence (see repository)Updated 4 days ago

    git clone https://github.com/Omni-Scientist/Awesome-AI-Scientist.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.