InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. ONS pay percentiles by UK postcode and occupation.

    Stale Official MCP Registry, io.github.donniertf-hub Updated 18 days ago 1 note

  2. agent-duel

    Datasets & benchmarks

    Blinded battles between coding agents: two agents, one prompt, you pick the winner. Desktop app, runs locally.

    Stale GitHub, bottomless 35 ★Custom licence (see repository)Updated 5 days ago

    git clone https://github.com/bottomless/agent-duel.git
  3. autoguardrails

    Datasets & benchmarks

    Alignment-research scaffold (autoresearch-style) for LLM guardrails: search over a single policy.md surface

    Stale GitHub, SantanderAI 129 ★Apache-2.0Updated 46 days ago

    git clone https://github.com/SantanderAI/autoguardrails.git
  4. VLMEvalKit

    AI repositories

    Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks

    Indexed GitHub, open-compass 4,487 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/open-compass/VLMEvalKit.git
  5. POD Benchmark

    MCP servers

    Compare print-on-demand supplier prices, shipping and delivered totals for the same product.

    Stale Official MCP Registry, com.podbenchmark Updated 21 days ago 1 note

  6. evalstats

    Prompts

    Statistical inference for AI evaluations, from model comparisons to corrections for LLM judge bias, optimized for small sample sizes. All defaults battle-tested in Monte Carlo simulations.

    Indexed GitHub, ianarawjo 134 ★Custom licence (see repository)Updated yesterday

    git clone https://github.com/ianarawjo/evalstats.git
  7. SkillCorpus

    Skills

    Open-source infrastructure that turns scattered SKILL.md files into curated, retrieval-ready agent-skill corpora—with retrieval and evaluation tooling included.

    Stale GitHub, EverMind-AI 700 ★Apache-2.0Updated 7 days ago

    git clone https://github.com/EverMind-AI/SkillCorpus.git
  8. OpenART

    Skills

    OpenART is an open-source framework designed to evaluate the safety and robustness of autonomous AI agents in dynamic, long-horizon, and stateful environments. It stress-tests agent runtimes against multi-step state poisoning, privilege escalation, and tool-use vulnerabilities across 10,000+ benchmark scenarios.

    Stale GitHub, AI45Lab 263 ★AGPL-3.0Updated 15 days ago

    git clone https://github.com/AI45Lab/OpenART.git
  9. GTA

    Agents & frameworks

    [NeurIPS 2024 D&B] GTA: A Benchmark for General Tool Agents & [arXiv 2026] GTA-2

    Indexed GitHub, open-compass 153 ★Apache-2.0Updated 6 days ago

    git clone https://github.com/open-compass/GTA.git
  10. Free to compete: testnet faucet funds everything. Accept 1102 Reclaim Probe

    Stale Official MCP Registry, com.a2awire Updated 8 days ago 1 note

  11. Free to compete: testnet faucet funds everything. Accept 1102 Shortfall Probe

    Stale Official MCP Registry, com.a2awire Updated 8 days ago 1 note

  12. Free to compete: testnet faucet funds everything. PR1002 R2 arithmetic dataset

    Stale Official MCP Registry, com.a2awire Updated 8 days ago 1 note

  13. Free to compete: testnet faucet funds everything. PR1002 R2 arithmetic dataset

    Stale Official MCP Registry, com.a2awire Updated 8 days ago 1 note

  14. Free to compete: testnet faucet funds everything. R2 REST-seat dataset

    Stale Official MCP Registry, com.a2awire Updated 8 days ago 1 note

  15. SGI-Bench

    Datasets & benchmarks

    Probing Scientific General Intelligence of LLMs with Scientist-Aligned Workflows

    Stale GitHub, InternScience 172 ★MITUpdated 5 months ago

    git clone https://github.com/InternScience/SGI-Bench.git
  16. Free to compete: testnet faucet funds everything. Support trials. Get scored, get hired.

    Stale Official MCP Registry, com.a2awire Updated 8 days ago 1 note

  17. promptbench

    Prompts

    A unified evaluation framework for large language models

    Stale Archived GitHub, microsoftarchive 2,821 ★MITUpdated 8 months ago 1 note

    git clone https://github.com/microsoftarchive/promptbench.git
  18. Create a high-performance HTTP benchmarking tool in Go. Implement concurrent request generation with configurable thread count. Add detailed statistics including latency, throughput, and error rates. Include support…

    Indexed prompts.chat (CC0 prompt collection), f CC0-1.0

  19. Free to compete: testnet faucet funds everything. Predict news outcomes. Get scored, get hired.

    Stale Official MCP Registry, com.a2awire Updated 8 days ago 1 note

  20. Free to compete: testnet faucet funds everything. Hard support trials. Scored, ranked.

    Stale Official MCP Registry, com.a2awire Updated 8 days ago 1 note

  21. awesome-ai-gateway

    Datasets & benchmarks

    ⚡ Awesome AI Gateway — pick an AI gateway from 240+ (LiteLLM, OpenRouter, Portkey, Kong, Higress, new-api, Bifrost) by cost, security & compliance, see what consolidated in 2026, learn how they actually work from an 8-chapter handbook, and verify every number yourself. Reproducible benchmarks, bilingual; stars & releases refreshed daily.

    Indexed GitHub, cuihuan 158 ★CC0-1.0Updated yesterday

    git clone https://github.com/cuihuan/awesome-ai-gateway.git
  22. Search institutional pre-seed venture capital firms, partner profiles, and valuation.

    Stale Official MCP Registry, com.modevc Updated 29 days ago 1 note

  23. Search institutional series-b venture capital firms, partner profiles, and valuation.

    Stale Official MCP Registry, com.modevc Updated 29 days ago 1 note

  24. Evaluate startup distribution moat defensibility (Tier 1-5) and pre-seed valuation dispersion.

    Stale Official MCP Registry, com.modevc Updated 29 days ago 1 note

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.