InnerVault

Library

85,337 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

Looks like a goal we have a starting path for: I want to build an AI agent

  1. skill-up

    Skills

    Evaluate Agent Skills and environments. Evolve Skills with evidence.

    Indexed GitHub, alibaba 1,476 ★Apache-2.0Updated today

    git clone https://github.com/alibaba/skill-up.git
  2. text generation model by CohereLabs · transformers

    Stale Hugging Face Hub, CohereLabs 580 ♥apache-2.0Updated 5 months ago

    CohereLabs/North-Mini-Code-1.0
  3. overmind

    AI repositories

    The platform for continuously improving AI agents.

    Stale GitHub, overmind-core 753 ★AGPL-3.0Updated 7 days ago

    git clone https://github.com/overmind-core/overmind.git
  4. Build evals from traces, code, and coding sessions, then measure and improve AI agent behavior, including your coding agents

    Indexed GitHub, relai-ai 14 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/relai-ai/agent-eval-loop.git
  5. trulens

    Agents & frameworks

    Evaluation and Tracking for LLM Experiments and AI Agents

    Stale GitHub, truera 3,601 ★MITUpdated 34 days ago

    git clone https://github.com/truera/trulens.git
  6. yao-meta-skill

    Tools & apps

    YAO = Yielding AI Outcomes. A rigorous engineering, evaluation, governance, and portability system for reusable agent skills.

    Stale GitHub, yaojingang 2,732 ★MITUpdated 7 days ago

    git clone https://github.com/yaojingang/yao-meta-skill.git
  7. railtracks

    AI repositories

    An agentic framework that helps developers build resilient agentic systems

    Indexed GitHub, RailtownAI 235 ★MITUpdated 3 days ago

    git clone https://github.com/RailtownAI/railtracks.git
  8. LoopArena

    Datasets & benchmarks

    Benchmarking models as runtime Controllers for Loop Engineering

    Stale GitHub, AMAP-ML 151 ★Apache-2.0Updated 32 days ago

    git clone https://github.com/AMAP-ML/LoopArena.git
  9. Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior.

    Indexed GitHub, NVIDIA 1,963 ★Apache-2.0Updated today

    git clone https://github.com/NVIDIA/SkillEvaluator.git
  10. self-bench

    Datasets & benchmarks

    Benchmark coding agents and models on your own repository with private Harbor-formatted evals built from its merged pull requests.

    Indexed GitHub, mupt-ai 34 ★MITUpdated today

    git clone https://github.com/mupt-ai/self-bench.git
  11. A test runner for agentskills.io-style AI agent skills

    Stale GitHub, darkrishabh 802 ★MITUpdated 33 days ago

    git clone https://github.com/darkrishabh/agent-skills-eval.git
  12. giskard-oss

    AI repositories

    🐢 Open-Source Evaluation & Testing library for LLM Agents

    Indexed GitHub, Giskard-AI 5,954 ★Apache-2.0Updated today

    git clone https://github.com/Giskard-AI/giskard-oss.git
  13. fable-method

    Skills

    The Fable Workflow: how Claude Fable 5 worked, distilled into skills any model can run, with the eval that keeps it honest. Think / act / prove.

    Stale GitHub, Sahir619 2,300 ★MITUpdated 44 days ago

    git clone https://github.com/Sahir619/fable-method.git
  14. Agent evaluation scorecard, delivered per API call as an atom service on Conduit Atoms.

    Indexed Official MCP Registry, org.aimlds Updated yesterday 1 note

  15. coder_eval

    Skills

    Playwright for coding agents. Test that your skills, MCP servers, and CLIs actually work when an agent uses them — sandboxed YAML suites, A/B experiments, CI gates.

    Indexed GitHub, UiPath 160 ★Apache-2.0Updated 2 days ago

    git clone https://github.com/UiPath/coder_eval.git
  16. nemo-helix

    Agents & frameworks

    NeMo Helix: Make the agents you ship faster, more accurate, and safer.

    Indexed GitHub, NVIDIA-NeMo 145 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/NVIDIA-NeMo/nemo-helix.git
  17. agent-eval

    MCP servers

    Statistical regression testing for LLM agents: p-value, effect size, and CI on behavior change.

    Stale Official MCP Registry, io.github.RudrenduPaul Updated 3 months ago 1 note

    agent-regress-cli@0.1.8
  18. Open-source AI evals toolkit: skills that guide AI coding agents to write eval rubrics, eval datasets (User Input Grid), trace codes, code evaluators and LLM-as-a-judge prompts. From the Reforge AI Evals course by Calibre.

    Stale GitHub, Calibre-Labs 95 ★MITUpdated 9 days ago

    git clone https://github.com/Calibre-Labs/reforge-ai-evals.git
  19. ResolveLab

    Agents & frameworks

    Fault-injected tool environments with side-effect grading for evaluating and post-training LLM agents

    Stale GitHub, Ta0p1 106 ★MITUpdated 11 days ago

    git clone https://github.com/Ta0p1/ResolveLab.git
  20. trpc-agent-go

    Agents & frameworks

    A Go framework for building production agent systems with graph workflows, tools, memory, A2A, AG-UI, MCP, evaluation, and observability.

    Indexed GitHub, trpc-group 1,931 ★Apache-2.0Updated yesterday

    git clone https://github.com/trpc-group/trpc-agent-go.git
  21. intelligent-audit-system

    Agents & frameworks

    AuditPilot: auditable enterprise AI agents for evidence-grounded workflows, governed tools, evaluation harnesses, human review, and remediation delivery.

    Stale GitHub, Ricky-7-Yan 1,180 ★MITUpdated 11 days ago

    git clone https://github.com/Ricky-7-Yan/intelligent-audit-system.git
  22. nautilus-compass

    Datasets & benchmarks

    Open memory & reliability layer for AI agents + independent judging/verification (NACRE judge, caliber-bench meta-benchmark, preregistered criteria) — by Nautilus Platform

    Indexed GitHub, chunxiaoxx 1,258 ★Custom licence (see repository)Updated 2 days ago

    git clone https://github.com/chunxiaoxx/nautilus-compass.git
  23. openbench

    Datasets & benchmarks

    Same model, different wrapper: a from-scratch benchmark comparing coding-agent harnesses (codex, pi, opencode, cursor, devin) and open models on correctness, speed, and token cost

    Stale GitHub, minghinmatthewlam 137 ★MITUpdated 2 months ago

    git clone https://github.com/minghinmatthewlam/openbench.git
  24. ClawBench

    Datasets & benchmarks

    Open-source benchmark for browser AI agents on daily tasks.

    Stale GitHub, TIGER-AI-Lab 1,229 ★Apache-2.0Updated 11 days ago

    git clone https://github.com/TIGER-AI-Lab/ClawBench.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.