InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. somali-language-standard

    AI repositories

    The open, machine-readable standard for the Somali language — orthography, grammar, terminology, translation, and AI/benchmark resources, as a versioned, citable RFC-style catalog.

    Stale GitHub, somastllc 108 ★MITUpdated 19 days ago

    git clone https://github.com/somastllc/somali-language-standard.git
  2. eval-genius

    Skills

    Teach your agent to work with evals: WHEN you actually need an eval or benchmark, HOW to build one that holds up, and how to read what it tells you. Deterministic-first, tool-agnostic.

    Stale GitHub, alexgreensh 24 ★Apache-2.0Updated 11 days ago

    git clone https://github.com/alexgreensh/eval-genius.git
  3. seo-skill-bench

    Datasets & benchmarks

    Open benchmark for Claude Code SEO skills — real headless execution against fixture sites with planted-defect answer keys. Deterministic scoring, pre-registered rubric.

    Stale GitHub, aleclindz 51 ★MITUpdated 32 days ago

    git clone https://github.com/aleclindz/seo-skill-bench.git
  4. Hill-Climb

    Skills

    Make your coding agent prove "done". Each change is kept only if a locked test or benchmark scores it better. Claude Code and Codex skill.

    Indexed GitHub, Bil0000 111 ★MITUpdated 4 days ago

    git clone https://github.com/Bil0000/Hill-Climb.git
  5. Glyd

    Datasets & benchmarks

    Lossless AI compression: 33% less GPU memory, bit for bit.

    Stale GitHub, surya-koritala 321 ★Custom licence (see repository)Updated 14 days ago

    git clone https://github.com/surya-koritala/Glyd.git
  6. llm-value-rankings

    Datasets & benchmarks

    Daily LLM value rankings - compare 300+ models by intelligence, speed and price. OpenRouter + Artificial Analysis. 大模型性价比排行榜

    Indexed GitHub, yyh-001 30 ★MITUpdated yesterday

    git clone https://github.com/yyh-001/llm-value-rankings.git
  7. PyHealth

    Datasets & benchmarks

    A deep learning toolkit for healthcare AI: EHR (MIMIC, eICU, OMOP), clinical text, signals and imaging. 30+ models, reproducible pipelines.

    Indexed GitHub, sunlabuiuc 1,699 ★MITUpdated today

    git clone https://github.com/sunlabuiuc/PyHealth.git
  8. deepsearchqa

    Datasets & benchmarks

    Hugging Face dataset by google

    Stale Hugging Face Hub, google 133 ♥apache-2.0Updated 11 months ago

    google/deepsearchqa
  9. sacp

    Datasets & benchmarks

    State-Aware Collaboration Protocol: auditable work receipts for AI agents.

    Stale GitHub, aDragon0707 107 ★MITUpdated 32 days ago

    git clone https://github.com/aDragon0707/sacp.git
  10. nagi-bench

    Datasets & benchmarks

    One-shot LLM eval cases by NAGI STUDIO - same prompt, different agents (model + harness), runnable artifacts side by side.

    Indexed GitHub, nagi-studio 78 ★MITUpdated 4 days ago

    git clone https://github.com/nagi-studio/nagi-bench.git
  11. Awesome-AI-Scientist

    Datasets & benchmarks

    🧪 Awesome list of AI Scientist papers, systems, benchmarks, datasets and open-source platforms.

    Indexed GitHub, Omni-Scientist 105 ★Custom licence (see repository)Updated 3 days ago

    git clone https://github.com/Omni-Scientist/Awesome-AI-Scientist.git
  12. Indian MSP Benchmarks

    Public APIs

    Statutory Minimum Support Prices and CACP production cost benchmarks across 28 Indian crops

    Indexed public-apis (GitHub list)

  13. Multi-User-LLM-Agent

    Datasets & benchmarks

    Official code for the paper: "Multi-User Large Language Model Agents"

    Stale GitHub, Kordi-AI 39 ★Apache-2.0Updated 7 days ago

    git clone https://github.com/Kordi-AI/Multi-User-LLM-Agent.git
  14. Agents_Failure_Attribution

    Agents & frameworks

    Benchmark for automated failure attributions in agentic systems (🏆 ICML 2025 Spotlight)

    Stale GitHub, ag2ai 397 ★MITUpdated 17 days ago

    git clone https://github.com/ag2ai/Agents_Failure_Attribution.git
  15. ds4-on-spark

    Datasets & benchmarks

    Entrpi/ds4, a Blackwell CUDA perf fork of antirez/ds4 on NVIDIA DGX Spark: one-command install, ~3x upstream prefill, ~1.5x decode, DSpark, and full continuous batch support

    Stale GitHub, Entrpi 409 ★MITUpdated 2 months ago

    git clone https://github.com/Entrpi/ds4-on-spark.git
  16. Free US drug-price benchmarks from federal data (CMS NADAC): a benchmark, not a price anyone owes.

    Stale Official MCP Registry, ai.agentlookups Updated 2 months ago 1 note

  17. Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior.

    Indexed GitHub, NVIDIA 1,963 ★Apache-2.0Updated today

    git clone https://github.com/NVIDIA/SkillEvaluator.git
  18. SigRank benchmark MCP: cascade metrics, leaderboard, operator profiles, simulation, diagnostics.

    Stale Official MCP Registry, com.signalaf Updated 2 months ago 1 note

  19. SQL Benchmarks Lab

    MCP servers

    Query pre-computed SQL engine benchmarks. Runs standalone, no server setup required.

    Stale Official MCP Registry, io.github.rctruta Updated 3 months ago 1 note

    sqlbenchdag@0.1.2
  20. ResearchClawBench

    Datasets & benchmarks

    🦞 ResearchClawBench: Evaluating AI Agents for Automated Research from Re-Discovery to New-Discovery

    Stale GitHub, InternScience 275 ★MITUpdated 19 days ago

    git clone https://github.com/InternScience/ResearchClawBench.git
  21. Create, test, and optimize OpenCode skills. Supports OpenCode V2 and V1 ≥ 1.18.29. Adapted from Anthropic's skill-creator.

    Stale GitHub, antongulin 174 ★Apache-2.0Updated 29 days ago

    git clone https://github.com/antongulin/opencode-skill-creator.git
  22. mcp-benchmark-hygiene

    MCP servers

    Detect pytest config-leakage that corrupts agent-benchmark grading. Deterministic, no-LLM.

    Stale Official MCP Registry, io.github.sudo-ai-git Updated 2 months ago 1 note

    mcp-benchmark-hygiene@1.0.1
  23. AI Benchmark Index

    MCP servers

    Search 264 AI benchmarks by category, with data sources and licences for each.

    Stale Official MCP Registry, com.aibenchmarkindex Updated 31 days ago 1 note

  24. mobilegym

    Datasets & benchmarks

    [EMNLP 2026] MobileGym: A Verifiable and Highly Parallel Simulation Platform for Mobile GUI Agent Research · 浏览器里运行的安卓模拟器 · Browser-hosted Android Simulator · Verifiable Evaluation · Scalable Online RL Training

    Indexed GitHub, Purewhiter 866 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/Purewhiter/mobilegym.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.