Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
Looks like a goal we have a starting path for: I want to build an AI agent
-
benchmarks
Agents & frameworksReproducible voice-AI benchmarking — TTS / STT / S2S latency and accuracy.
git clone https://github.com/coval-ai/benchmarks.git -
WebsiteBench
Datasets & benchmarksCan AI agents rebuild websites through browser exploration?
git clone https://github.com/TIGER-AI-Lab/WebsiteBench.git -
ai-agents-tutorial
Agents & frameworksLearn AI Agents step by step, from scratch - from function calling to agent loops to multi-agent systems, orchestration, and evaluation.
git clone https://github.com/amitshekhariitbhu/ai-agents-tutorial.git -
future-agi
Agents & frameworksOpen-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.
git clone https://github.com/future-agi/future-agi.git -
awesome-auditable-ai
Agents & frameworksAuditing AI agents: a curated list of papers, tools, datasets, benchmarks, and standards covering reliability, monitoring, failure attribution, and decision records.
git clone https://github.com/yzhao062/awesome-auditable-ai.git -
heym
MCP serversBuild agentic systems. Run them with confidence. Orchestrate agents, automate business processes, inspect every execution, and keep humans in control. Deploy Heym on your own infrastructure.
git clone https://github.com/heymrun/heym.git -
joyczl-agent
Agents & frameworksJoy — a local-first personal assistant. Rust core (loop / memory / tools / graph / evals), TypeScript gateways + dashboard, Python thin SDK.
git clone https://github.com/ChrisVip001/joyczl-agent.git -
DM-Code-Agent
Agents & frameworksAn inspectable coding agent. Trace changes, diagnose failed runs, and share test evidence. Local-first Python, no-key demo, standalone HTML reports.
git clone https://github.com/hwfengcs/DM-Code-Agent.git -
xorcise
Datasets & benchmarksRun cyber-AI agents against real missions in isolated environments. Record everything as OpenTelemetry evidence. Grade the evidence, not the claim.
git clone https://github.com/xorcise-ai/xorcise.git -
Awesome-CUA
Agents & frameworksOpen, source-backed catalog of computer-use agents: reviewed papers, GUI models, datasets, benchmarks, tools, and reusable JSONL/SQLite data.
git clone https://github.com/reacher-z/Awesome-CUA.git -
KADATH
Agents & frameworksEvolutionary multi-agent runtime that breeds, evaluates, and improves autonomous agents across reproducible epochs to converge on optimization of a goal.
git clone https://github.com/i3T4AN/KADATH.git -
fde-gym
Datasets & benchmarksThe online judge for the LLM era. Every case is a real customer delivery: you work it with a coding agent, and your system is judged once it is live.
git clone https://github.com/deeplethe/fde-gym.git -
agentenv-framework
MCP serversCreating realistic RL environments requires collaboration between researchers, engineers, and domain experts across many dimensions: artifacts, environments tools, dynamism of the environment, reproducibility, and more. There is no open source framework for building these environments effectively. Until now.
git clone https://github.com/scaleapi/agentenv-framework.git -
done-is-a-claim
SkillsYour coding agent says done. Show the receipt. Evidence-first workflows, practical skills, and plugins for Claude Code and Codex.
git clone https://github.com/Grit-77/done-is-a-claim.git -
langfuse-docs
Skills🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.
git clone https://github.com/langfuse/langfuse-docs.git -
measured-type
SkillsAgent skill for web typography: Bringhurst applied to modern CSS, with claims measured in the browser and a baseline eval suite
git clone https://github.com/PetriLahdelma/measured-type.git -
curated-claude-code
SkillsA small, vetted, self-evolving harness for Claude Code — curated, not dumped. Skills, safety guards, and a self-improvement loop.
git clone https://github.com/Sanexxxx777/curated-claude-code.git -
awesome-ai-agents
MCP serversCurated list of AI agent frameworks, coding and automation agents, MCP servers, and evaluation tools.
git clone https://github.com/frangelbarrera/awesome-ai-agents.git -
metaharness
Agents & frameworks🛠️ The meta-harness for AI agents — scaffold your own focused, branded agent harness with its own npx CLI, MCP server, memory, learning loop, and witness-signed releases. Works with Claude Code, Codex, pi.dev, Hermes, OpenClaw, and RVM (hardware-isolated sandbox).
git clone https://github.com/ruvnet/metaharness.git -
dokimi
SkillsDokimi (Greek δοκιμή, "test, proof") measures whether a skill, MCP doc source, agent profile or repository guidance actually helps a coding agent: paired on/off arm comparisons, novel-vs-known content analysis, and repository scans with graded agent runs.
git clone https://github.com/intel/dokimi.git -
coding.sh
MCP serversOpen-source, local-first observability and evals for AI agents: see what Claude Code, Codex, Cursor and others did and what it cost.
git clone https://github.com/jackulau/coding.sh.git -
bg3-agent-harness
MCP serversAn AI agent plays Baldur's Gate 3 on Linux through a Lua mod and an MCP server, seeing only what a player sees. Includes a model benchmark and a playthrough app.
git clone https://github.com/Bogzx/bg3-agent-harness.git -
nasde-toolkit
SkillsCLI for benchmarks & evals of AI coding agents — on tasks you already understand, using your Claude / Codex / Gemini individual subscriptions or API keys.
git clone https://github.com/NoesisVision/nasde-toolkit.git -
OpenART
SkillsOpenART is an open-source framework designed to evaluate the safety and robustness of autonomous AI agents in dynamic, long-horizon, and stateful environments. It stress-tests agent runtimes against multi-step state poisoning, privilege escalation, and tool-use vulnerabilities across 10,000+ benchmark scenarios.
git clone https://github.com/AI45Lab/OpenART.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.