InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. OpenPipe

    Prompts

    Turn expensive prompts into cheap fine-tuned models

    Stale GitHub, OpenPipe 2,834 ★Apache-2.0Updated 2 years ago

    git clone https://github.com/OpenPipe/OpenPipe.git
  2. phoenix

    Prompts

    AI Observability & Evaluation

    Indexed GitHub, Arize-ai 12.3k ★Custom licence (see repository)Updated today

    git clone https://github.com/Arize-ai/phoenix.git
  3. ChainForge

    Prompts

    An open-source visual programming environment for battle-testing prompts to LLMs.

    Stale GitHub, ianarawjo 3,040 ★MITUpdated 18 days ago

    git clone https://github.com/ianarawjo/ChainForge.git
  4. pezzo

    Prompts

    🕹️ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more.

    Stale GitHub, pezzolabs 3,280 ★Apache-2.0Updated 8 days ago

    git clone https://github.com/pezzolabs/pezzo.git
  5. opik

    Prompts

    Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

    Indexed GitHub, comet-ml 23.4k ★Apache-2.0Updated today

    git clone https://github.com/comet-ml/opik.git
  6. LLMstudio

    Prompts

    Framework to bring LLM applications to production

    Stale GitHub, TensorOpsAI 390 ★MPL-2.0Updated 3 months ago

    git clone https://github.com/TensorOpsAI/LLMstudio.git
  7. llmflows

    Prompts

    LLMFlows - Simple, Explicit and Transparent LLM Apps

    Stale GitHub, stoyan-stoyanov 708 ★MITUpdated 21 months ago

    git clone https://github.com/stoyan-stoyanov/llmflows.git
  8. langwatch

    Prompts

    Open-Source Agent Observability & Evals for AI Platform teams. Trace, test, route and govern every agent & coding assistant in the company.

    Indexed GitHub, langwatch 5,038 ★Apache-2.0Updated today

    git clone https://github.com/langwatch/langwatch.git
  9. bosquet

    Prompts

    Tooling to build LLM applications: prompt templating and composition, agents, LLM memory, and other instruments for builders of AI applications.

    Stale GitHub, zmedelis 381 ★EPL-1.0Updated 47 days ago

    git clone https://github.com/zmedelis/bosquet.git
  10. helicone

    Prompts

    🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

    Indexed GitHub, Helicone 6,281 ★Apache-2.0Updated 4 days ago

    git clone https://github.com/Helicone/helicone.git
  11. langfuse

    Prompts

    🪢 Open source AI engineering platform: AI Gateway, agent observability, evals, and prompt/skill management, built on OpenTelemetry. One open platform for every AI call and every agent. Self-host or use Langfuse Cloud.

    Indexed GitHub, langfuse 37.5k ★Custom licence (see repository)Updated today

    git clone https://github.com/langfuse/langfuse.git
  12. mlflow

    Prompts

    The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

    Indexed GitHub, mlflow 28.8k ★Apache-2.0Updated today

    git clone https://github.com/mlflow/mlflow.git
  13. 🚀 A curated collection of AI engineering resources, roadmaps, tools, and projects covering LLMs, RAG, AI Agents, MCP, fine-tuning, evaluations, and production AI systems.

    Stale GitHub, dipakkr 22.5k ★MITUpdated 26 days ago

    git clone https://github.com/dipakkr/awesome-ai-engineering.git
  14. gateway

    Prompts

    The only fully local production-grade Super SDK that provides a simple, unified, and powerful interface for calling more than 200+ LLMs.

    Stale GitHub, adaline 607 ★MITUpdated 3 months ago

    git clone https://github.com/adaline/gateway.git
  15. promptfoo

    Prompts

    Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

    Indexed GitHub, promptfoo 27.3k ★MITUpdated today

    git clone https://github.com/promptfoo/promptfoo.git
  16. rebuff

    Prompts

    LLM Prompt Injection Detector

    Stale Archived GitHub, protectai 1,529 ★Apache-2.0Updated 2 years ago 1 note

    git clone https://github.com/protectai/rebuff.git
  17. Hands-on, framework-free Colab notebooks for the AI Engineer / Forward Deployed Engineer (FDE) skill set — model APIs, structured output, tool calling, RAG, evals-as-the-spine, agents (loop from scratch, tool design, guardrails, MCP, Skills), fine-tuning vs LoRA, prompt-injection/security, LLMOps, and customer craft. Runs on the free Groq API.

    Stale GitHub, calmrocks 743 ★MITUpdated 9 days ago

    git clone https://github.com/calmrocks/ai-engineer-notebooks.git
  18. langfuse-java

    Prompts

    🪢 Auto-generated Java Client for Langfuse API

    Indexed GitHub, langfuse 74 ★MITUpdated 3 days ago

    git clone https://github.com/langfuse/langfuse-java.git
  19. sugarcane-ai

    Prompts

    npm like package ecosystem for Prompts 🤖

    Stale GitHub, sugarcane-ai 52 ★Apache-2.0Updated 21 months ago

    git clone https://github.com/sugarcane-ai/sugarcane-ai.git
  20. langtrace

    Prompts

    Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evaluations and metrics for popular LLMs, LLM frameworks, vectorDBs and more.. Integrate using Typescript, Python. 🚀💻📊

    Stale GitHub, Scale3-Labs 1,233 ★AGPL-3.0Updated 12 months ago

    git clone https://github.com/Scale3-Labs/langtrace.git
  21. llm-guard

    Prompts

    The Security Toolkit for LLM Interactions

    Stale Archived GitHub, protectai 3,217 ★MITUpdated 4 months ago 1 note

    git clone https://github.com/protectai/llm-guard.git
  22. promptdesk

    Prompts

    Promptdesk is a tool designed for effectively creating, organizing, and evaluating prompts and large language models (LLMs).

    Stale GitHub, promptdesk 99 ★AGPL-3.0Updated 14 months ago

    git clone https://github.com/promptdesk/promptdesk.git
  23. uptrain

    Prompts

    UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.

    Stale GitHub, uptrain-ai 2,366 ★Apache-2.0Updated 2 years ago

    git clone https://github.com/uptrain-ai/uptrain.git
  24. fable-skills

    Prompts

    Six Claude Code skills that harden Opus 4.8 toward frontier behavior. Written by Fable 5, pressure-tested on the target model with transcripts included.

    Stale GitHub, DizzyMii 55 ★MITUpdated 41 days ago

    git clone https://github.com/DizzyMii/fable-skills.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.