InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior.

    Indexed GitHub, NVIDIA 1,963 ★Apache-2.0Updated today

    git clone https://github.com/NVIDIA/SkillEvaluator.git
  2. A test runner for agentskills.io-style AI agent skills

    Stale GitHub, darkrishabh 802 ★MITUpdated 33 days ago

    git clone https://github.com/darkrishabh/agent-skills-eval.git
  3. skill-up

    Skills

    Evaluate Agent Skills and environments. Evolve Skills with evidence.

    Indexed GitHub, alibaba 1,476 ★Apache-2.0Updated today

    git clone https://github.com/alibaba/skill-up.git
  4. darwin-skill

    Skills

    达尔文.skill —— 一个让你的Skill无限进化的系统:评估→改进→测试→保留或回滚 | Autoresearch-inspired autonomous skill optimization for Claude Code. Evaluate, improve, test, keep or revert.

    Indexed GitHub, alchaincyf 6,935 ★MITUpdated 2 days ago

    git clone https://github.com/alchaincyf/darwin-skill.git
  5. OpenJudge

    Skills

    OpenJudge: A Unified Framework for Holistic Evaluation and Quality Rewards

    Indexed GitHub, agentscope-ai 1,108 ★Apache-2.0Updated today

    git clone https://github.com/agentscope-ai/OpenJudge.git
  6. fable-method

    Skills

    The Fable Workflow: how Claude Fable 5 worked, distilled into skills any model can run, with the eval that keeps it honest. Think / act / prove.

    Stale GitHub, Sahir619 2,300 ★MITUpdated 44 days ago

    git clone https://github.com/Sahir619/fable-method.git
  7. coder_eval

    Skills

    Playwright for coding agents. Test that your skills, MCP servers, and CLIs actually work when an agent uses them — sandboxed YAML suites, A/B experiments, CI gates.

    Indexed GitHub, UiPath 160 ★Apache-2.0Updated 2 days ago

    git clone https://github.com/UiPath/coder_eval.git
  8. eval-genius

    Skills

    Teach your agent to work with evals: WHEN you actually need an eval or benchmark, HOW to build one that holds up, and how to read what it tells you. Deterministic-first, tool-agnostic.

    Stale GitHub, alexgreensh 24 ★Apache-2.0Updated 11 days ago

    git clone https://github.com/alexgreensh/eval-genius.git
  9. SkillForge

    Skills

    A skill creator that proves its skills work. Evidence-driven skill creation for Claude Code and Codex: baseline-tested generation, per-skill regression evals, ecosystem doctor, cross-runtime compile, and an opt-in proactive advisor.

    Stale GitHub, tripleyak 909 ★MITUpdated 3 months ago

    git clone https://github.com/tripleyak/SkillForge.git
  10. Build evals from traces, code, and coding sessions, then measure and improve AI agent behavior, including your coding agents

    Indexed GitHub, relai-ai 14 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/relai-ai/agent-eval-loop.git
  11. Build tested agent skills and govern their lifecycle through a user-defined marketplace: evidence, discovery, updates, rollback, quarantine, and 17-platform distribution.

    Stale GitHub, FrancyJGLisboa 2,404 ★MITUpdated 2 months ago

    git clone https://github.com/FrancyJGLisboa/agent-skills-platform.git
  12. nasde-toolkit

    Skills

    CLI for benchmarks & evals of AI coding agents — on tasks you already understand, using your Claude / Codex / Gemini individual subscriptions or API keys.

    Stale GitHub, NoesisVision 14 ★MITUpdated 32 days ago

    git clone https://github.com/NoesisVision/nasde-toolkit.git
  13. SkillCorpus

    Skills

    Open-source infrastructure that turns scattered SKILL.md files into curated, retrieval-ready agent-skill corpora—with retrieval and evaluation tooling included.

    Stale GitHub, EverMind-AI 700 ★Apache-2.0Updated 7 days ago

    git clone https://github.com/EverMind-AI/SkillCorpus.git
  14. 把工作流变成可研究、可评测、可发布的乔木 Agent Skill | Turn workflows into researched, tested, release-ready agent skills.

    Stale GitHub, joeseesun 389 ★MITUpdated 12 days ago

    git clone https://github.com/joeseesun/qiaomu-meta-skill.git
  15. 50+ curated LLM observability tools PLUS 26 Agent Skills (several with runnable, unit-tested scripts) to build, evaluate, debug, secure & monitor reliable LLM apps. Tracing, evals, guardrails, LLMOps.

    Stale GitHub, ContextJet-ai 46 ★Custom licence (see repository)Updated 5 days ago

    git clone https://github.com/ContextJet-ai/awesome-llm-observability.git
  16. OpenART

    Skills

    OpenART is an open-source framework designed to evaluate the safety and robustness of autonomous AI agents in dynamic, long-horizon, and stateful environments. It stress-tests agent runtimes against multi-step state poisoning, privilege escalation, and tool-use vulnerabilities across 10,000+ benchmark scenarios.

    Stale GitHub, AI45Lab 263 ★AGPL-3.0Updated 15 days ago

    git clone https://github.com/AI45Lab/OpenART.git
  17. langfuse-docs

    Skills

    🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.

    Stale GitHub, langfuse 253 ★MITUpdated 4 days ago

    git clone https://github.com/langfuse/langfuse-docs.git
  18. skill-reach

    Skills

    An evaluation suite for AI agent skill triggering and collision detection

    Stale GitHub, google 13 ★Apache-2.0Updated 23 days ago

    git clone https://github.com/google/skill-reach.git
  19. dev-skills

    Skills

    Developer and product skills for Claude Code, Cursor and Codex: 1-file AI evals and Chrome extension store assets.

    Stale GitHub, Illyism 22 ★Updated 4 days ago

    git clone https://github.com/Illyism/dev-skills.git
  20. tweakidea

    Skills

    Evaluate your startup idea from 1 to 5

    Indexed GitHub, eph5xx 57 ★MITUpdated yesterday

    git clone https://github.com/eph5xx/tweakidea.git
  21. rashomon

    Skills

    Measure prompt and skill improvements with blind A/B comparison.

    Stale GitHub, shinpr 19 ★MITUpdated 25 days ago

    git clone https://github.com/shinpr/rashomon.git
  22. skill-harness

    Skills

    How do you KNOW if a 'skill' is any good - deterministically? This runs controlled skill-vs-no-skill experiments. It doesn't just ask, “Did the skill work?” It asks “Did we actually give the skill to the model, did the comparison remain fair, what changed, what did it cost, and do we have enough evidence to say that confidently?”

    Stale GitHub, MrBinnacle 16 ★MITUpdated 14 days ago

    git clone https://github.com/MrBinnacle/skill-harness.git
  23. dokimi

    Skills

    Dokimi (Greek δοκιμή, "test, proof") measures whether a skill, MCP doc source, agent profile or repository guidance actually helps a coding agent: paired on/off arm comparisons, novel-vs-known content analysis, and repository scans with graded agent runs.

    Indexed GitHub, intel 37 ★Apache-2.0Updated today

    git clone https://github.com/intel/dokimi.git
  24. Open-source skills for Claude Code and Codex, with an MCP server, a PyPI package and Suede Awesome Everything, a directory that scores AI agent skills 0 to 99. Created by Jason Colapietro, founder and CEO of Suede AI.

    Indexed GitHub, JasonColapietro 124 ★MITUpdated yesterday

    git clone https://github.com/JasonColapietro/suede-creator-skills.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.