Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
Looks like a goal we have a starting path for: I want to build an AI agent
-
skill-up
SkillsEvaluate Agent Skills and environments. Evolve Skills with evidence.
git clone https://github.com/alibaba/skill-up.git -
North-Mini-Code-1.0
Modelstext generation model by CohereLabs · transformers
CohereLabs/North-Mini-Code-1.0 -
overmind
AI repositoriesThe platform for continuously improving AI agents.
git clone https://github.com/overmind-core/overmind.git -
agent-eval-loop
SkillsBuild evals from traces, code, and coding sessions, then measure and improve AI agent behavior, including your coding agents
git clone https://github.com/relai-ai/agent-eval-loop.git -
trulens
Agents & frameworksEvaluation and Tracking for LLM Experiments and AI Agents
git clone https://github.com/truera/trulens.git -
yao-meta-skill
Tools & appsYAO = Yielding AI Outcomes. A rigorous engineering, evaluation, governance, and portability system for reusable agent skills.
git clone https://github.com/yaojingang/yao-meta-skill.git -
railtracks
AI repositoriesAn agentic framework that helps developers build resilient agentic systems
git clone https://github.com/RailtownAI/railtracks.git -
LoopArena
Datasets & benchmarksBenchmarking models as runtime Controllers for Loop Engineering
git clone https://github.com/AMAP-ML/LoopArena.git -
SkillEvaluator
SkillsMulti-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior.
git clone https://github.com/NVIDIA/SkillEvaluator.git -
self-bench
Datasets & benchmarksBenchmark coding agents and models on your own repository with private Harbor-formatted evals built from its merged pull requests.
git clone https://github.com/mupt-ai/self-bench.git -
agent-skills-eval
SkillsA test runner for agentskills.io-style AI agent skills
git clone https://github.com/darkrishabh/agent-skills-eval.git -
giskard-oss
AI repositories🐢 Open-Source Evaluation & Testing library for LLM Agents
git clone https://github.com/Giskard-AI/giskard-oss.git -
Agent evaluation scorecard — Atom
MCP serversAgent evaluation scorecard, delivered per API call as an atom service on Conduit Atoms.
-
fable-method
SkillsThe Fable Workflow: how Claude Fable 5 worked, distilled into skills any model can run, with the eval that keeps it honest. Think / act / prove.
git clone https://github.com/Sahir619/fable-method.git -
coder_eval
SkillsPlaywright for coding agents. Test that your skills, MCP servers, and CLIs actually work when an agent uses them — sandboxed YAML suites, A/B experiments, CI gates.
git clone https://github.com/UiPath/coder_eval.git -
nemo-helix
Agents & frameworksNeMo Helix: Make the agents you ship faster, more accurate, and safer.
git clone https://github.com/NVIDIA-NeMo/nemo-helix.git -
agent-eval
MCP serversStatistical regression testing for LLM agents: p-value, effect size, and CI on behavior change.
agent-regress-cli@0.1.8 -
reforge-ai-evals
PromptsOpen-source AI evals toolkit: skills that guide AI coding agents to write eval rubrics, eval datasets (User Input Grid), trace codes, code evaluators and LLM-as-a-judge prompts. From the Reforge AI Evals course by Calibre.
git clone https://github.com/Calibre-Labs/reforge-ai-evals.git -
ResolveLab
Agents & frameworksFault-injected tool environments with side-effect grading for evaluating and post-training LLM agents
git clone https://github.com/Ta0p1/ResolveLab.git -
trpc-agent-go
Agents & frameworksA Go framework for building production agent systems with graph workflows, tools, memory, A2A, AG-UI, MCP, evaluation, and observability.
git clone https://github.com/trpc-group/trpc-agent-go.git -
intelligent-audit-system
Agents & frameworksAuditPilot: auditable enterprise AI agents for evidence-grounded workflows, governed tools, evaluation harnesses, human review, and remediation delivery.
git clone https://github.com/Ricky-7-Yan/intelligent-audit-system.git -
nautilus-compass
Datasets & benchmarksOpen memory & reliability layer for AI agents + independent judging/verification (NACRE judge, caliber-bench meta-benchmark, preregistered criteria) — by Nautilus Platform
git clone https://github.com/chunxiaoxx/nautilus-compass.git -
openbench
Datasets & benchmarksSame model, different wrapper: a from-scratch benchmark comparing coding-agent harnesses (codex, pi, opencode, cursor, devin) and open models on correctness, speed, and token cost
git clone https://github.com/minghinmatthewlam/openbench.git -
ClawBench
Datasets & benchmarksOpen-source benchmark for browser AI agents on daily tasks.
git clone https://github.com/TIGER-AI-Lab/ClawBench.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.