InnerVault

Library

85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.

Results

  1. Turns a company's website text into a short list of problems you can see evidence for, what each might cost, and the one fix worth raising first.

    Hand-checked InnerVault (hand-checked), InnerVault Free to use and adapt

  2. promptfoo

    Prompts

    Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

    Indexed GitHub, promptfoo 27.3k ★MITUpdated today

    git clone https://github.com/promptfoo/promptfoo.git
  3. langfuse

    Prompts

    🪢 Open source AI engineering platform: AI Gateway, agent observability, evals, and prompt/skill management, built on OpenTelemetry. One open platform for every AI call and every agent. Self-host or use Langfuse Cloud.

    Indexed GitHub, langfuse 37.5k ★Custom licence (see repository)Updated today

    git clone https://github.com/langfuse/langfuse.git
  4. opik

    Prompts

    Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

    Indexed GitHub, comet-ml 23.4k ★Apache-2.0Updated today

    git clone https://github.com/comet-ml/opik.git
  5. phoenix

    Prompts

    AI Observability & Evaluation

    Indexed GitHub, Arize-ai 12.3k ★Custom licence (see repository)Updated today

    git clone https://github.com/Arize-ai/phoenix.git
  6. evolver

    Prompts

    The GEP-powered self-evolving engine for AI agents. Auditable evolution with Genes, Capsules, and Events. | evomap.ai

    Indexed GitHub, EvoMap 8,743 ★GPL-3.0Updated 4 days ago

    git clone https://github.com/EvoMap/evolver.git
  7. mlflow

    Prompts

    The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

    Indexed GitHub, mlflow 28.8k ★Apache-2.0Updated today

    git clone https://github.com/mlflow/mlflow.git
  8. Kiln

    Prompts

    Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.

    Indexed GitHub, Kiln-AI 5,283 ★Custom licence (see repository)Updated 3 days ago

    git clone https://github.com/Kiln-AI/Kiln.git
  9. gepa

    Prompts

    Optimize prompts, code, and more with AI-powered Reflective Optimization

    Stale GitHub, gepa-ai 7,394 ★MITUpdated 7 days ago

    git clone https://github.com/gepa-ai/gepa.git
  10. helicone

    Prompts

    🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

    Indexed GitHub, Helicone 6,281 ★Apache-2.0Updated 4 days ago

    git clone https://github.com/Helicone/helicone.git
  11. langwatch

    Prompts

    Open-Source Agent Observability & Evals for AI Platform teams. Trace, test, route and govern every agent & coding assistant in the company.

    Indexed GitHub, langwatch 5,038 ★Apache-2.0Updated today

    git clone https://github.com/langwatch/langwatch.git
  12. Leaked system prompts of ChatGPT, Claude, Gemini and more. The hidden system prompt of every popular chatbot, in full, every version since May 2025. Also Anthropic Claude Code, OpenAI Codex, Google Antigravity, xAI Grok, Meta Muse, Moonshot Kimi, Alibaba Qwen, Z.ai GLM ZCode, MiniMax, Cursor, Perplexity, DeepSeek and 30+ others. Updated daily.

    Indexed GitHub, asgeirtj 71.5k ★CC0-1.0Updated yesterday

    git clone https://github.com/asgeirtj/system_prompts_leaks.git
  13. uptrain

    Prompts

    UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.

    Stale GitHub, uptrain-ai 2,366 ★Apache-2.0Updated 2 years ago

    git clone https://github.com/uptrain-ai/uptrain.git
  14. ChainForge

    Prompts

    An open-source visual programming environment for battle-testing prompts to LLMs.

    Stale GitHub, ianarawjo 3,040 ★MITUpdated 18 days ago

    git clone https://github.com/ianarawjo/ChainForge.git
  15. ragbits

    Prompts

    Building blocks for rapid development of GenAI applications

    Stale GitHub, deepsense-ai 1,677 ★MITUpdated 6 months ago

    git clone https://github.com/deepsense-ai/ragbits.git
  16. A curated list of AI Agent evolution, memory systems, multi-agent architectures, and self-improvement projects. | evomap.ai

    Indexed GitHub, EvoMap 241 ★Custom licence (see repository)Updated today

    git clone https://github.com/EvoMap/awesome-agent-evolution.git
  17. Evidence-backed use cases, prompts, integrations, evaluations, and safety notes for OpenAI GPT-6 Astra.

    Stale GitHub, Anil-matcha 1,147 ★MITUpdated 44 days ago

    git clone https://github.com/Anil-matcha/awesome-gpt-6-astra.git
  18. judgeval

    Prompts

    The Continuous-Improvement Stack for Agents. Our environment data and evals power agent improvement and monitoring.

    Indexed GitHub, JudgmentLabs 1,074 ★Apache-2.0Updated today

    git clone https://github.com/JudgmentLabs/judgeval.git
  19. evalstats

    Prompts

    Statistical inference for AI evaluations, from model comparisons to corrections for LLM judge bias, optimized for small sample sizes. All defaults battle-tested in Monte Carlo simulations.

    Indexed GitHub, ianarawjo 134 ★Custom licence (see repository)Updated yesterday

    git clone https://github.com/ianarawjo/evalstats.git
  20. promptpex

    Prompts

    Test Generation for Prompts

    Indexed GitHub, microsoft 165 ★CC-BY-4.0Updated 3 days ago

    git clone https://github.com/microsoft/promptpex.git
  21. 让 Agent 的工作方式可组合、可审查、可持续改进,最终实现 Agent Self Evoling。 DeepSeek Harness Web plugin with composable task controls and isolated, human-reviewed self-evolution.

    Stale GitHub, GraySilver 200 ★MITUpdated 11 days ago

    git clone https://github.com/GraySilver/dsh-evolve-modes.git
  22. Open-source AI evals toolkit: skills that guide AI coding agents to write eval rubrics, eval datasets (User Input Grid), trace codes, code evaluators and LLM-as-a-judge prompts. From the Reforge AI Evals course by Calibre.

    Stale GitHub, Calibre-Labs 95 ★MITUpdated 9 days ago

    git clone https://github.com/Calibre-Labs/reforge-ai-evals.git
  23. langtrace

    Prompts

    Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evaluations and metrics for popular LLMs, LLM frameworks, vectorDBs and more.. Integrate using Typescript, Python. 🚀💻📊

    Stale GitHub, Scale3-Labs 1,233 ★AGPL-3.0Updated 12 months ago

    git clone https://github.com/Scale3-Labs/langtrace.git
  24. awesome-chatgpt

    Prompts

    ⚡ Everything about ChatGPT

    Stale GitHub, OpenMindClub 1,951 ★CC0-1.0Updated 2 years ago

    git clone https://github.com/OpenMindClub/awesome-chatgpt.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.