Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
OpenPipe
PromptsTurn expensive prompts into cheap fine-tuned models
git clone https://github.com/OpenPipe/OpenPipe.git -
phoenix
PromptsAI Observability & Evaluation
git clone https://github.com/Arize-ai/phoenix.git -
ChainForge
PromptsAn open-source visual programming environment for battle-testing prompts to LLMs.
git clone https://github.com/ianarawjo/ChainForge.git -
pezzo
Prompts🕹️ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more.
git clone https://github.com/pezzolabs/pezzo.git -
opik
PromptsDebug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
git clone https://github.com/comet-ml/opik.git -
LLMstudio
PromptsFramework to bring LLM applications to production
git clone https://github.com/TensorOpsAI/LLMstudio.git -
llmflows
PromptsLLMFlows - Simple, Explicit and Transparent LLM Apps
git clone https://github.com/stoyan-stoyanov/llmflows.git -
langwatch
PromptsOpen-Source Agent Observability & Evals for AI Platform teams. Trace, test, route and govern every agent & coding assistant in the company.
git clone https://github.com/langwatch/langwatch.git -
bosquet
PromptsTooling to build LLM applications: prompt templating and composition, agents, LLM memory, and other instruments for builders of AI applications.
git clone https://github.com/zmedelis/bosquet.git -
helicone
Prompts🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓
git clone https://github.com/Helicone/helicone.git -
langfuse
Prompts🪢 Open source AI engineering platform: AI Gateway, agent observability, evals, and prompt/skill management, built on OpenTelemetry. One open platform for every AI call and every agent. Self-host or use Langfuse Cloud.
git clone https://github.com/langfuse/langfuse.git -
mlflow
PromptsThe open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
git clone https://github.com/mlflow/mlflow.git -
awesome-ai-engineering
Prompts🚀 A curated collection of AI engineering resources, roadmaps, tools, and projects covering LLMs, RAG, AI Agents, MCP, fine-tuning, evaluations, and production AI systems.
git clone https://github.com/dipakkr/awesome-ai-engineering.git -
gateway
PromptsThe only fully local production-grade Super SDK that provides a simple, unified, and powerful interface for calling more than 200+ LLMs.
git clone https://github.com/adaline/gateway.git -
promptfoo
PromptsTest your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
git clone https://github.com/promptfoo/promptfoo.git -
rebuff
PromptsLLM Prompt Injection Detector
git clone https://github.com/protectai/rebuff.git -
ai-engineer-notebooks
PromptsHands-on, framework-free Colab notebooks for the AI Engineer / Forward Deployed Engineer (FDE) skill set — model APIs, structured output, tool calling, RAG, evals-as-the-spine, agents (loop from scratch, tool design, guardrails, MCP, Skills), fine-tuning vs LoRA, prompt-injection/security, LLMOps, and customer craft. Runs on the free Groq API.
git clone https://github.com/calmrocks/ai-engineer-notebooks.git -
langfuse-java
Prompts🪢 Auto-generated Java Client for Langfuse API
git clone https://github.com/langfuse/langfuse-java.git -
sugarcane-ai
Promptsnpm like package ecosystem for Prompts 🤖
git clone https://github.com/sugarcane-ai/sugarcane-ai.git -
langtrace
PromptsLangtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evaluations and metrics for popular LLMs, LLM frameworks, vectorDBs and more.. Integrate using Typescript, Python. 🚀💻📊
git clone https://github.com/Scale3-Labs/langtrace.git -
llm-guard
PromptsThe Security Toolkit for LLM Interactions
git clone https://github.com/protectai/llm-guard.git -
promptdesk
PromptsPromptdesk is a tool designed for effectively creating, organizing, and evaluating prompts and large language models (LLMs).
git clone https://github.com/promptdesk/promptdesk.git -
uptrain
PromptsUpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.
git clone https://github.com/uptrain-ai/uptrain.git -
fable-skills
PromptsSix Claude Code skills that harden Opus 4.8 toward frontier behavior. Written by Fable 5, pressure-tested on the target model with transcripts included.
git clone https://github.com/DizzyMii/fable-skills.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.