InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

Looks like a goal we have a starting path for: I want to build an AI agent

  1. skill-up

    Skills

    Evaluate Agent Skills and environments. Evolve Skills with evidence.

    Indexed GitHub, alibaba 1,476 ★Apache-2.0Updated today

    git clone https://github.com/alibaba/skill-up.git
  2. trulens

    Agents & frameworks

    Evaluation and Tracking for LLM Experiments and AI Agents

    Stale GitHub, truera 3,601 ★MITUpdated 34 days ago

    git clone https://github.com/truera/trulens.git
  3. railtracks

    AI repositories

    An agentic framework that helps developers build resilient agentic systems

    Indexed GitHub, RailtownAI 235 ★MITUpdated 3 days ago

    git clone https://github.com/RailtownAI/railtracks.git
  4. yao-meta-skill

    Tools & apps

    YAO = Yielding AI Outcomes. A rigorous engineering, evaluation, governance, and portability system for reusable agent skills.

    Stale GitHub, yaojingang 2,732 ★MITUpdated 7 days ago

    git clone https://github.com/yaojingang/yao-meta-skill.git
  5. LoopArena

    Datasets & benchmarks

    Benchmarking models as runtime Controllers for Loop Engineering

    Stale GitHub, AMAP-ML 151 ★Apache-2.0Updated 32 days ago

    git clone https://github.com/AMAP-ML/LoopArena.git
  6. Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior.

    Indexed GitHub, NVIDIA 1,963 ★Apache-2.0Updated today

    git clone https://github.com/NVIDIA/SkillEvaluator.git
  7. giskard-oss

    AI repositories

    🐢 Open-Source Evaluation & Testing library for LLM Agents

    Indexed GitHub, Giskard-AI 5,954 ★Apache-2.0Updated today

    git clone https://github.com/Giskard-AI/giskard-oss.git
  8. Agent evaluation scorecard, delivered per API call as an atom service on Conduit Atoms.

    Indexed Official MCP Registry, org.aimlds Updated yesterday 1 note

  9. fable-method

    Skills

    The Fable Workflow: how Claude Fable 5 worked, distilled into skills any model can run, with the eval that keeps it honest. Think / act / prove.

    Stale GitHub, Sahir619 2,300 ★MITUpdated 44 days ago

    git clone https://github.com/Sahir619/fable-method.git
  10. coder_eval

    Skills

    Playwright for coding agents. Test that your skills, MCP servers, and CLIs actually work when an agent uses them — sandboxed YAML suites, A/B experiments, CI gates.

    Indexed GitHub, UiPath 160 ★Apache-2.0Updated 2 days ago

    git clone https://github.com/UiPath/coder_eval.git
  11. nemo-helix

    Agents & frameworks

    NeMo Helix: Make the agents you ship faster, more accurate, and safer.

    Indexed GitHub, NVIDIA-NeMo 145 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/NVIDIA-NeMo/nemo-helix.git
  12. ResolveLab

    Agents & frameworks

    Fault-injected tool environments with side-effect grading for evaluating and post-training LLM agents

    Stale GitHub, Ta0p1 106 ★MITUpdated 11 days ago

    git clone https://github.com/Ta0p1/ResolveLab.git
  13. trpc-agent-go

    Agents & frameworks

    A Go framework for building production agent systems with graph workflows, tools, memory, A2A, AG-UI, MCP, evaluation, and observability.

    Indexed GitHub, trpc-group 1,931 ★Apache-2.0Updated yesterday

    git clone https://github.com/trpc-group/trpc-agent-go.git
  14. intelligent-audit-system

    Agents & frameworks

    AuditPilot: auditable enterprise AI agents for evidence-grounded workflows, governed tools, evaluation harnesses, human review, and remediation delivery.

    Stale GitHub, Ricky-7-Yan 1,180 ★MITUpdated 11 days ago

    git clone https://github.com/Ricky-7-Yan/intelligent-audit-system.git
  15. nautilus-compass

    Datasets & benchmarks

    Open memory & reliability layer for AI agents + independent judging/verification (NACRE judge, caliber-bench meta-benchmark, preregistered criteria) — by Nautilus Platform

    Indexed GitHub, chunxiaoxx 1,258 ★Custom licence (see repository)Updated 2 days ago

    git clone https://github.com/chunxiaoxx/nautilus-compass.git
  16. ClawBench

    Datasets & benchmarks

    Open-source benchmark for browser AI agents on daily tasks.

    Stale GitHub, TIGER-AI-Lab 1,229 ★Apache-2.0Updated 11 days ago

    git clone https://github.com/TIGER-AI-Lab/ClawBench.git
  17. benchmarks

    Agents & frameworks

    Reproducible voice-AI benchmarking — TTS / STT / S2S latency and accuracy.

    Stale GitHub, coval-ai 104 ★Custom licence (see repository)Updated 24 days ago

    git clone https://github.com/coval-ai/benchmarks.git
  18. WebsiteBench

    Datasets & benchmarks

    Can AI agents rebuild websites through browser exploration?

    Indexed GitHub, TIGER-AI-Lab 300 ★Apache-2.0Updated 6 days ago

    git clone https://github.com/TIGER-AI-Lab/WebsiteBench.git
  19. ai-agents-tutorial

    Agents & frameworks

    Learn AI Agents step by step, from scratch - from function calling to agent loops to multi-agent systems, orchestration, and evaluation.

    Indexed GitHub, amitshekhariitbhu 212 ★Apache-2.0Updated 2 days ago

    git clone https://github.com/amitshekhariitbhu/ai-agents-tutorial.git
  20. future-agi

    Agents & frameworks

    Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

    Indexed GitHub, future-agi 2,267 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/future-agi/future-agi.git
  21. awesome-auditable-ai

    Agents & frameworks

    Auditing AI agents: a curated list of papers, tools, datasets, benchmarks, and standards covering reliability, monitoring, failure attribution, and decision records.

    Stale GitHub, yzhao062 154 ★CC0-1.0Updated 28 days ago

    git clone https://github.com/yzhao062/awesome-auditable-ai.git
  22. self-bench

    Datasets & benchmarks

    Benchmark coding agents and models on your own repository with private Harbor-formatted evals built from its merged pull requests.

    Indexed GitHub, mupt-ai 34 ★MITUpdated today

    git clone https://github.com/mupt-ai/self-bench.git
  23. DM-Code-Agent

    Agents & frameworks

    An inspectable coding agent. Trace changes, diagnose failed runs, and share test evidence. Local-first Python, no-key demo, standalone HTML reports.

    Indexed GitHub, hwfengcs 152 ★MITUpdated yesterday

    git clone https://github.com/hwfengcs/DM-Code-Agent.git
  24. xorcise

    Datasets & benchmarks

    Run cyber-AI agents against real missions in isolated environments. Record everything as OpenTelemetry evidence. Grade the evidence, not the claim.

    Stale GitHub, xorcise-ai 33 ★Custom licence (see repository)Updated 17 days ago

    git clone https://github.com/xorcise-ai/xorcise.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.