Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
-
collaborative-gym
Agents & frameworksFramework and toolkits for building and evaluating collaborative agents that can work together with humans.
git clone https://github.com/SALT-NLP/collaborative-gym.git -
explicit-edit-benchmark
Datasets & benchmarksBenchmark coding agents and agent harnesses on 226 deterministic file-editing tasks with byte-exact verification and a public leaderboard.
git clone https://github.com/alexshpunt/explicit-edit-benchmark.git -
Sema
MCP serversMCP tools for Sema — eval, compile, build, format, and docs for a Lisp with LLM primitives.
https://github.com/sema-lisp/sema/releases/download/v2.0.0/sema.mcpb@2.0.0 -
pydantic-ai-skills
SkillsProduction-ready Claude Code skills for building AI agents with Pydantic AI. Includes dependency injection, tools, validators, streaming, multi-agent orchestration, and evaluation framework patterns.
git clone https://github.com/Fuenfgeld/pydantic-ai-skills.git -
metaharness
Agents & frameworks🛠️ The meta-harness for AI agents — scaffold your own focused, branded agent harness with its own npx CLI, MCP server, memory, learning loop, and witness-signed releases. Works with Claude Code, Codex, pi.dev, Hermes, OpenClaw, and RVM (hardware-isolated sandbox).
git clone https://github.com/ruvnet/metaharness.git -
llm-rl-environments-lil-course
Agents & frameworks🌱 A little course on Reinforcement Learning Environments for evaluating and training Language Models
git clone https://github.com/anakin87/llm-rl-environments-lil-course.git -
skills
SkillsNine eval-built agent workflows for planning, implementation, copy, and repository work.
git clone https://github.com/eliasstravik/skills.git -
adk-java
Agents & frameworksAn open-source, code-first Java toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and control.
git clone https://github.com/google/adk-java.git -
You are a senior physician with 20+ years of clinical experience in preventive medicine and laboratory interpretation. Analyze the attached health report comprehensively and clinically. Provide output in the following…
-
done-is-a-claim
SkillsYour coding agent says done. Show the receipt. Evidence-first workflows, practical skills, and plugins for Claude Code and Codex.
git clone https://github.com/Grit-77/done-is-a-claim.git -
solace-agent-mesh
Agents & frameworksPlatform for building and running AI agents across the full lifecycle — build, test, deploy, monitor, improve. Hosts your agents, runs their tools, and coordinates them over an event mesh, with sessions, artifacts, auth, evaluators, and observability built in.
git clone https://github.com/SolaceProducts/solace-agent-mesh.git -
nagi-bench
Datasets & benchmarksOne-shot LLM eval cases by NAGI STUDIO - same prompt, different agents (model + harness), runnable artifacts side by side.
git clone https://github.com/nagi-studio/nagi-bench.git -
git clone https://github.com/microsoft/frontiertour27-ILL224-see-how-far-one-agent-goes-in-copilot-studio.git
-
VerifyAX
MCP serversEvaluate, benchmark, and simulate AI agents on the VerifyAX agent-evaluation platform.
@verifyax/mcp-server@0.5.0 -
ROLE: Multi-Agent Fact-Checking System You will execute FOUR internal agents IN ORDER. Agents must not share prohibited information. Do not revise earlier outputs after moving to the next agent. AGENT ⊕ EXTRACTOR -…
-
LLM-Agents-Ecosystem-Handbook
MCP serversOne-stop handbook for building, deploying, and understanding LLM agents with 60+ skeletons, tutorials, ecosystem guides, and evaluation tools.
git clone https://github.com/oxbshw/LLM-Agents-Ecosystem-Handbook.git -
Kojen
MCP serversTrain, evaluate, red-team and deploy AI agents: prompt tuning, LLM-judged evals, katas.
-
riftcoach-agent
AI repositoriesA quality-gated League of Legends post-game coaching agent built on deterministic match data, RAG, and LLM evaluation.
git clone https://github.com/123Cx330Yrx/riftcoach-agent.git -
RAG-FiT
AI repositoriesFramework for enhancing LLMs for RAG tasks using fine-tuning.
git clone https://github.com/IntelLabs/RAG-FiT.git -
geminiupgradeqa-mcp
MCP serversRemote MCP for Gemini upgrade evals, prompt regressions, output diffs, and eval receipts.
-
rubrkit
MCP serversMCP-native AI evaluation: rubric audits, eval suites, and proof reports for AI/LLM output.
-
founder-pipeline
SkillsA gated 25-step pipeline for validating and launching a business idea with Claude Code. Evidence over assumption, a fresh-context critic and a human signature at every step, three gates that can kill the idea. 23 skills, 4 subagents, 2 workflows, an approval hook, evals and CI. MIT.
git clone https://github.com/marian-kamenistak/founder-pipeline.git -
Foundation-Models-Framework-Lab
AI repositoriesA practical lab for building, testing, and evaluating apps with Apple's Foundation Models framework.
git clone https://github.com/rudrankriyam/Foundation-Models-Framework-Lab.git -
scale-hr
MCP serversScale HR evaluation SaaS for Japanese SMBs. Manage users, evaluation sheets, periods and 1on1s.
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.