InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. SkillCorpus

    Skills

    Open-source infrastructure that turns scattered SKILL.md files into curated, retrieval-ready agent-skill corpora—with retrieval and evaluation tooling included.

    Stale GitHub, EverMind-AI 700 ★Apache-2.0Updated 7 days ago

    git clone https://github.com/EverMind-AI/SkillCorpus.git
  2. uptrain

    Prompts

    UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.

    Stale GitHub, uptrain-ai 2,366 ★Apache-2.0Updated 2 years ago

    git clone https://github.com/uptrain-ai/uptrain.git
  3. self-bench

    Datasets & benchmarks

    Benchmark coding agents and models on your own repository with private Harbor-formatted evals built from its merged pull requests.

    Indexed GitHub, mupt-ai 34 ★MITUpdated today

    git clone https://github.com/mupt-ai/self-bench.git
  4. dxl-commerce-agent

    Tools & apps

    OpenClaw + 大模型驱动的完整电商客服自动化系统:覆盖淘宝、拼多多、抖音、快手、小红书、视频号,包含浏览器/手机 Worker、订单物流与售后工具、记忆、回执、恢复和 Eval。--------------技术交流或者定制开发加微信:whichmen。

    Indexed GitHub, whichmen 145 ★MITUpdated 2 days ago

    git clone https://github.com/whichmen/dxl-commerce-agent.git
  5. cs329z-chinese

    Docs & tutorials

    斯坦福 Stanford CS329Z Engineering AI Agents 中文教程:面向 Python 开发者的 AI 智能体课程,19 讲与 4 项实践,涵盖 LLM、RAG、工具调用、记忆、多智能体、评测与安全。完整 Markdown、在线与离线 HTML。Chinese course notes.

    Stale GitHub, wanghao-SunSky 512 ★Updated 10 days ago

    git clone https://github.com/wanghao-SunSky/cs329z-chinese.git
  6. TrustLLM

    Datasets & benchmarks

    [ICML 2024] TrustLLM: LLM trustworthiness evaluation across truthfulness, safety, fairness, robustness, privacy and ethics. Python/CLI toolkit for local models, compatible APIs and AI agent orchestration.

    Stale GitHub, HowieHwong 632 ★MITUpdated 43 days ago

    git clone https://github.com/HowieHwong/TrustLLM.git
  7. One-Eval

    Datasets & benchmarks

    Automated system for LLM evaluation via agents. Doc as below:

    Stale GitHub, OpenDCAI 165 ★Apache-2.0Updated 2 months ago

    git clone https://github.com/OpenDCAI/One-Eval.git
  8. Awesome-Datasets-Hub

    Datasets & benchmarks

    A curated collection of datasets for Large Language Models (LLMs), covering medical AI, NLP, multimodal learning, instruction tuning, reasoning, code generation, and evaluation benchmarks.

    Stale GitHub, ahammadmejbah 149 ★Updated 4 months ago

    git clone https://github.com/ahammadmejbah/Awesome-Datasets-Hub.git
  9. KADATH

    Agents & frameworks

    Evolutionary multi-agent runtime that breeds, evaluates, and improves autonomous agents across reproducible epochs to converge on optimization of a goal.

    Stale GitHub, i3T4AN 253 ★Apache-2.0Updated 23 days ago

    git clone https://github.com/i3T4AN/KADATH.git
  10. agentenv-framework

    MCP servers

    Creating realistic RL environments requires collaboration between researchers, engineers, and domain experts across many dimensions: artifacts, environments tools, dynamism of the environment, reproducibility, and more. There is no open source framework for building these environments effectively. Until now.

    Indexed GitHub, scaleapi 441 ★Apache-2.0Updated today

    git clone https://github.com/scaleapi/agentenv-framework.git
  11. seo-skill-bench

    Datasets & benchmarks

    Open benchmark for Claude Code SEO skills — real headless execution against fixture sites with planted-defect answer keys. Deterministic scoring, pre-registered rubric.

    Stale GitHub, aleclindz 51 ★MITUpdated 32 days ago

    git clone https://github.com/aleclindz/seo-skill-bench.git
  12. exterminator

    Skills

    Claude Code + Codex skill that fixes bugs at the root cause, then hunts down every sibling of the same bug. Includes an eval lab.

    Stale GitHub, spider12223 12 ★MITUpdated 12 days ago

    git clone https://github.com/spider12223/exterminator.git
  13. wtfibought

    Agents & frameworks

    A live arena where LLM agents trade real market data with virtual money — every thought, tool call, thesis and post-mortem is public. Bring your own model and key.

    Stale GitHub, mamawai 143 ★MITUpdated 18 days ago

    git clone https://github.com/mamawai/wtfibought.git
  14. Turn a production incident into a structured 9-section LLM response (severity, root cause, mitigation, postmortem). Ships with a 5-scenario regression suite + LLM-as-judge eval pipeline.

    Stale GitHub, YanpengQi7 83 ★Updated 29 days ago

    git clone https://github.com/YanpengQi7/ai-reliability-copilot.git
  15. skills

    Skills

    Edge finds task-fit agent skills, shows available evidence, and loads pinned versions into AI agents.

    Stale GitHub, getedgehq 5 ★Apache-2.0Updated 4 days ago

    git clone https://github.com/getedgehq/skills.git
  16. dev-skills

    Skills

    Developer and product skills for Claude Code, Cursor and Codex: 1-file AI evals and Chrome extension store assets.

    Stale GitHub, Illyism 22 ★Updated 4 days ago

    git clone https://github.com/Illyism/dev-skills.git
  17. prism

    Datasets & benchmarks

    Открытый бенчмарк LLM: какая нейросеть лучше пишет код 1С:Предприятие (BSL). Объективная оценка LLM по методике SMOP с реальным исполнением в 1С — Claude, GPT, Gemini, DeepSeek, YandexGPT, GigaChat.

    Stale GitHub, genlab-1c 55 ★MITUpdated 18 days ago

    git clone https://github.com/genlab-1c/prism.git
  18. nagi-bench

    Datasets & benchmarks

    One-shot LLM eval cases by NAGI STUDIO - same prompt, different agents (model + harness), runnable artifacts side by side.

    Indexed GitHub, nagi-studio 78 ★MITUpdated 4 days ago

    git clone https://github.com/nagi-studio/nagi-bench.git
  19. Improve Claude Code and OpenAI Codex skills from real feedback, with evidence, regression checks, and human review.

    Stale GitHub, rwang23 5 ★MITUpdated 16 days ago

    git clone https://github.com/rwang23/skill-evolution.git
  20. riftcoach-agent

    AI repositories

    A quality-gated League of Legends post-game coaching agent built on deterministic match data, RAG, and LLM evaluation.

    Stale GitHub, 123Cx330Yrx 101 ★MITUpdated 25 days ago

    git clone https://github.com/123Cx330Yrx/riftcoach-agent.git
  21. skillcheck

    Prompts

    Blind A/B testing for AI agent skills, .cursorrules, CLAUDE.md, and system prompts. Detects placebo and harmful instructions.

    Stale GitHub, sx4im 30 ★MITUpdated 13 days ago

    git clone https://github.com/sx4im/skillcheck.git
  22. An 18 notebook course that isolates and measures each component of agentic loop engineering on real, industry standard software datasets.

    Stale GitHub, FareedKhan-dev 59 ★MITUpdated 4 months ago

    git clone https://github.com/FareedKhan-dev/agentic-loop-engineering-course.git
  23. dokimi

    Skills

    Dokimi (Greek δοκιμή, "test, proof") measures whether a skill, MCP doc source, agent profile or repository guidance actually helps a coding agent: paired on/off arm comparisons, novel-vs-known content analysis, and repository scans with graded agent runs.

    Indexed GitHub, intel 37 ★Apache-2.0Updated today

    git clone https://github.com/intel/dokimi.git
  24. ai-rulez

    Skills

    Author, generate, validate and govern AI agent rules, skills, plugins and MCP configuration across 52 coding assistants. Review with verified model evidence, evaluate skills, lock and sign dependencies, and publish bundles. CLI, MCP server and Go API.

    Indexed GitHub, Goldziher 172 ★MITUpdated today

    git clone https://github.com/Goldziher/ai-rulez.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.