Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
-
SkillCorpus
SkillsOpen-source infrastructure that turns scattered SKILL.md files into curated, retrieval-ready agent-skill corpora—with retrieval and evaluation tooling included.
git clone https://github.com/EverMind-AI/SkillCorpus.git -
uptrain
PromptsUpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.
git clone https://github.com/uptrain-ai/uptrain.git -
self-bench
Datasets & benchmarksBenchmark coding agents and models on your own repository with private Harbor-formatted evals built from its merged pull requests.
git clone https://github.com/mupt-ai/self-bench.git -
dxl-commerce-agent
Tools & appsOpenClaw + 大模型驱动的完整电商客服自动化系统:覆盖淘宝、拼多多、抖音、快手、小红书、视频号,包含浏览器/手机 Worker、订单物流与售后工具、记忆、回执、恢复和 Eval。--------------技术交流或者定制开发加微信:whichmen。
git clone https://github.com/whichmen/dxl-commerce-agent.git -
cs329z-chinese
Docs & tutorials斯坦福 Stanford CS329Z Engineering AI Agents 中文教程:面向 Python 开发者的 AI 智能体课程,19 讲与 4 项实践,涵盖 LLM、RAG、工具调用、记忆、多智能体、评测与安全。完整 Markdown、在线与离线 HTML。Chinese course notes.
git clone https://github.com/wanghao-SunSky/cs329z-chinese.git -
TrustLLM
Datasets & benchmarks[ICML 2024] TrustLLM: LLM trustworthiness evaluation across truthfulness, safety, fairness, robustness, privacy and ethics. Python/CLI toolkit for local models, compatible APIs and AI agent orchestration.
git clone https://github.com/HowieHwong/TrustLLM.git -
One-Eval
Datasets & benchmarksAutomated system for LLM evaluation via agents. Doc as below:
git clone https://github.com/OpenDCAI/One-Eval.git -
Awesome-Datasets-Hub
Datasets & benchmarksA curated collection of datasets for Large Language Models (LLMs), covering medical AI, NLP, multimodal learning, instruction tuning, reasoning, code generation, and evaluation benchmarks.
git clone https://github.com/ahammadmejbah/Awesome-Datasets-Hub.git -
KADATH
Agents & frameworksEvolutionary multi-agent runtime that breeds, evaluates, and improves autonomous agents across reproducible epochs to converge on optimization of a goal.
git clone https://github.com/i3T4AN/KADATH.git -
agentenv-framework
MCP serversCreating realistic RL environments requires collaboration between researchers, engineers, and domain experts across many dimensions: artifacts, environments tools, dynamism of the environment, reproducibility, and more. There is no open source framework for building these environments effectively. Until now.
git clone https://github.com/scaleapi/agentenv-framework.git -
seo-skill-bench
Datasets & benchmarksOpen benchmark for Claude Code SEO skills — real headless execution against fixture sites with planted-defect answer keys. Deterministic scoring, pre-registered rubric.
git clone https://github.com/aleclindz/seo-skill-bench.git -
exterminator
SkillsClaude Code + Codex skill that fixes bugs at the root cause, then hunts down every sibling of the same bug. Includes an eval lab.
git clone https://github.com/spider12223/exterminator.git -
wtfibought
Agents & frameworksA live arena where LLM agents trade real market data with virtual money — every thought, tool call, thesis and post-mortem is public. Bring your own model and key.
git clone https://github.com/mamawai/wtfibought.git -
ai-reliability-copilot
PromptsTurn a production incident into a structured 9-section LLM response (severity, root cause, mitigation, postmortem). Ships with a 5-scenario regression suite + LLM-as-judge eval pipeline.
git clone https://github.com/YanpengQi7/ai-reliability-copilot.git -
skills
SkillsEdge finds task-fit agent skills, shows available evidence, and loads pinned versions into AI agents.
git clone https://github.com/getedgehq/skills.git -
dev-skills
SkillsDeveloper and product skills for Claude Code, Cursor and Codex: 1-file AI evals and Chrome extension store assets.
git clone https://github.com/Illyism/dev-skills.git -
prism
Datasets & benchmarksОткрытый бенчмарк LLM: какая нейросеть лучше пишет код 1С:Предприятие (BSL). Объективная оценка LLM по методике SMOP с реальным исполнением в 1С — Claude, GPT, Gemini, DeepSeek, YandexGPT, GigaChat.
git clone https://github.com/genlab-1c/prism.git -
nagi-bench
Datasets & benchmarksOne-shot LLM eval cases by NAGI STUDIO - same prompt, different agents (model + harness), runnable artifacts side by side.
git clone https://github.com/nagi-studio/nagi-bench.git -
skill-evolution
SkillsImprove Claude Code and OpenAI Codex skills from real feedback, with evidence, regression checks, and human review.
git clone https://github.com/rwang23/skill-evolution.git -
riftcoach-agent
AI repositoriesA quality-gated League of Legends post-game coaching agent built on deterministic match data, RAG, and LLM evaluation.
git clone https://github.com/123Cx330Yrx/riftcoach-agent.git -
skillcheck
PromptsBlind A/B testing for AI agent skills, .cursorrules, CLAUDE.md, and system prompts. Detects placebo and harmful instructions.
git clone https://github.com/sx4im/skillcheck.git -
agentic-loop-engineering-course
Docs & tutorialsAn 18 notebook course that isolates and measures each component of agentic loop engineering on real, industry standard software datasets.
git clone https://github.com/FareedKhan-dev/agentic-loop-engineering-course.git -
dokimi
SkillsDokimi (Greek δοκιμή, "test, proof") measures whether a skill, MCP doc source, agent profile or repository guidance actually helps a coding agent: paired on/off arm comparisons, novel-vs-known content analysis, and repository scans with graded agent runs.
git clone https://github.com/intel/dokimi.git -
ai-rulez
SkillsAuthor, generate, validate and govern AI agent rules, skills, plugins and MCP configuration across 52 coding assistants. Review with verified model evidence, evaluate skills, lock and sign dependencies, and publish bundles. CLI, MCP server and Go API.
git clone https://github.com/Goldziher/ai-rulez.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.