Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
somali-language-standard
AI repositoriesThe open, machine-readable standard for the Somali language — orthography, grammar, terminology, translation, and AI/benchmark resources, as a versioned, citable RFC-style catalog.
git clone https://github.com/somastllc/somali-language-standard.git -
eval-genius
SkillsTeach your agent to work with evals: WHEN you actually need an eval or benchmark, HOW to build one that holds up, and how to read what it tells you. Deterministic-first, tool-agnostic.
git clone https://github.com/alexgreensh/eval-genius.git -
seo-skill-bench
Datasets & benchmarksOpen benchmark for Claude Code SEO skills — real headless execution against fixture sites with planted-defect answer keys. Deterministic scoring, pre-registered rubric.
git clone https://github.com/aleclindz/seo-skill-bench.git -
Hill-Climb
SkillsMake your coding agent prove "done". Each change is kept only if a locked test or benchmark scores it better. Claude Code and Codex skill.
git clone https://github.com/Bil0000/Hill-Climb.git -
Glyd
Datasets & benchmarksLossless AI compression: 33% less GPU memory, bit for bit.
git clone https://github.com/surya-koritala/Glyd.git -
llm-value-rankings
Datasets & benchmarksDaily LLM value rankings - compare 300+ models by intelligence, speed and price. OpenRouter + Artificial Analysis. 大模型性价比排行榜
git clone https://github.com/yyh-001/llm-value-rankings.git -
PyHealth
Datasets & benchmarksA deep learning toolkit for healthcare AI: EHR (MIMIC, eICU, OMOP), clinical text, signals and imaging. 30+ models, reproducible pipelines.
git clone https://github.com/sunlabuiuc/PyHealth.git -
deepsearchqa
Datasets & benchmarksHugging Face dataset by google
google/deepsearchqa -
sacp
Datasets & benchmarksState-Aware Collaboration Protocol: auditable work receipts for AI agents.
git clone https://github.com/aDragon0707/sacp.git -
nagi-bench
Datasets & benchmarksOne-shot LLM eval cases by NAGI STUDIO - same prompt, different agents (model + harness), runnable artifacts side by side.
git clone https://github.com/nagi-studio/nagi-bench.git -
Awesome-AI-Scientist
Datasets & benchmarks🧪 Awesome list of AI Scientist papers, systems, benchmarks, datasets and open-source platforms.
git clone https://github.com/Omni-Scientist/Awesome-AI-Scientist.git -
Indian MSP Benchmarks
Public APIsStatutory Minimum Support Prices and CACP production cost benchmarks across 28 Indian crops
-
Multi-User-LLM-Agent
Datasets & benchmarksOfficial code for the paper: "Multi-User Large Language Model Agents"
git clone https://github.com/Kordi-AI/Multi-User-LLM-Agent.git -
Agents_Failure_Attribution
Agents & frameworksBenchmark for automated failure attributions in agentic systems (🏆 ICML 2025 Spotlight)
git clone https://github.com/ag2ai/Agents_Failure_Attribution.git -
ds4-on-spark
Datasets & benchmarksEntrpi/ds4, a Blackwell CUDA perf fork of antirez/ds4 on NVIDIA DGX Spark: one-command install, ~3x upstream prefill, ~1.5x decode, DSpark, and full continuous batch support
git clone https://github.com/Entrpi/ds4-on-spark.git -
CounterScript - Drug Price Benchmarks
MCP serversFree US drug-price benchmarks from federal data (CMS NADAC): a benchmark, not a price anyone owes.
-
SkillEvaluator
SkillsMulti-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior.
git clone https://github.com/NVIDIA/SkillEvaluator.git -
SigRank — AI Operator Benchmarking
MCP serversSigRank benchmark MCP: cascade metrics, leaderboard, operator profiles, simulation, diagnostics.
-
SQL Benchmarks Lab
MCP serversQuery pre-computed SQL engine benchmarks. Runs standalone, no server setup required.
sqlbenchdag@0.1.2 -
ResearchClawBench
Datasets & benchmarks🦞 ResearchClawBench: Evaluating AI Agents for Automated Research from Re-Discovery to New-Discovery
git clone https://github.com/InternScience/ResearchClawBench.git -
opencode-skill-creator
SkillsCreate, test, and optimize OpenCode skills. Supports OpenCode V2 and V1 ≥ 1.18.29. Adapted from Anthropic's skill-creator.
git clone https://github.com/antongulin/opencode-skill-creator.git -
mcp-benchmark-hygiene
MCP serversDetect pytest config-leakage that corrupts agent-benchmark grading. Deterministic, no-LLM.
mcp-benchmark-hygiene@1.0.1 -
AI Benchmark Index
MCP serversSearch 264 AI benchmarks by category, with data sources and licences for each.
-
mobilegym
Datasets & benchmarks[EMNLP 2026] MobileGym: A Verifiable and Highly Parallel Simulation Platform for Mobile GUI Agent Research · 浏览器里运行的安卓模拟器 · Browser-hosted Android Simulator · Verifiable Evaluation · Scalable Online RL Training
git clone https://github.com/Purewhiter/mobilegym.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.