Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
Looks like a goal we have a starting path for: I want to build an AI agent
-
skill-up
SkillsEvaluate Agent Skills and environments. Evolve Skills with evidence.
git clone https://github.com/alibaba/skill-up.git -
trulens
Agents & frameworksEvaluation and Tracking for LLM Experiments and AI Agents
git clone https://github.com/truera/trulens.git -
railtracks
AI repositoriesAn agentic framework that helps developers build resilient agentic systems
git clone https://github.com/RailtownAI/railtracks.git -
yao-meta-skill
Tools & appsYAO = Yielding AI Outcomes. A rigorous engineering, evaluation, governance, and portability system for reusable agent skills.
git clone https://github.com/yaojingang/yao-meta-skill.git -
LoopArena
Datasets & benchmarksBenchmarking models as runtime Controllers for Loop Engineering
git clone https://github.com/AMAP-ML/LoopArena.git -
SkillEvaluator
SkillsMulti-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior.
git clone https://github.com/NVIDIA/SkillEvaluator.git -
giskard-oss
AI repositories🐢 Open-Source Evaluation & Testing library for LLM Agents
git clone https://github.com/Giskard-AI/giskard-oss.git -
Agent evaluation scorecard — Atom
MCP serversAgent evaluation scorecard, delivered per API call as an atom service on Conduit Atoms.
-
fable-method
SkillsThe Fable Workflow: how Claude Fable 5 worked, distilled into skills any model can run, with the eval that keeps it honest. Think / act / prove.
git clone https://github.com/Sahir619/fable-method.git -
coder_eval
SkillsPlaywright for coding agents. Test that your skills, MCP servers, and CLIs actually work when an agent uses them — sandboxed YAML suites, A/B experiments, CI gates.
git clone https://github.com/UiPath/coder_eval.git -
nemo-helix
Agents & frameworksNeMo Helix: Make the agents you ship faster, more accurate, and safer.
git clone https://github.com/NVIDIA-NeMo/nemo-helix.git -
ResolveLab
Agents & frameworksFault-injected tool environments with side-effect grading for evaluating and post-training LLM agents
git clone https://github.com/Ta0p1/ResolveLab.git -
trpc-agent-go
Agents & frameworksA Go framework for building production agent systems with graph workflows, tools, memory, A2A, AG-UI, MCP, evaluation, and observability.
git clone https://github.com/trpc-group/trpc-agent-go.git -
intelligent-audit-system
Agents & frameworksAuditPilot: auditable enterprise AI agents for evidence-grounded workflows, governed tools, evaluation harnesses, human review, and remediation delivery.
git clone https://github.com/Ricky-7-Yan/intelligent-audit-system.git -
nautilus-compass
Datasets & benchmarksOpen memory & reliability layer for AI agents + independent judging/verification (NACRE judge, caliber-bench meta-benchmark, preregistered criteria) — by Nautilus Platform
git clone https://github.com/chunxiaoxx/nautilus-compass.git -
ClawBench
Datasets & benchmarksOpen-source benchmark for browser AI agents on daily tasks.
git clone https://github.com/TIGER-AI-Lab/ClawBench.git -
benchmarks
Agents & frameworksReproducible voice-AI benchmarking — TTS / STT / S2S latency and accuracy.
git clone https://github.com/coval-ai/benchmarks.git -
WebsiteBench
Datasets & benchmarksCan AI agents rebuild websites through browser exploration?
git clone https://github.com/TIGER-AI-Lab/WebsiteBench.git -
ai-agents-tutorial
Agents & frameworksLearn AI Agents step by step, from scratch - from function calling to agent loops to multi-agent systems, orchestration, and evaluation.
git clone https://github.com/amitshekhariitbhu/ai-agents-tutorial.git -
future-agi
Agents & frameworksOpen-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.
git clone https://github.com/future-agi/future-agi.git -
awesome-auditable-ai
Agents & frameworksAuditing AI agents: a curated list of papers, tools, datasets, benchmarks, and standards covering reliability, monitoring, failure attribution, and decision records.
git clone https://github.com/yzhao062/awesome-auditable-ai.git -
self-bench
Datasets & benchmarksBenchmark coding agents and models on your own repository with private Harbor-formatted evals built from its merged pull requests.
git clone https://github.com/mupt-ai/self-bench.git -
DM-Code-Agent
Agents & frameworksAn inspectable coding agent. Trace changes, diagnose failed runs, and share test evidence. Local-first Python, no-key demo, standalone HTML reports.
git clone https://github.com/hwfengcs/DM-Code-Agent.git -
xorcise
Datasets & benchmarksRun cyber-AI agents against real missions in isolated environments. Record everything as OpenTelemetry evidence. Grade the evidence, not the claim.
git clone https://github.com/xorcise-ai/xorcise.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.