Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
helicone
Prompts🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓
git clone https://github.com/Helicone/helicone.git -
opensre
AI repositoriesThe open-source agent for CI/CD reliability.
git clone https://github.com/Tracer-Cloud/opensre.git -
opik
PromptsDebug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
git clone https://github.com/comet-ml/opik.git -
voltagent
AI repositoriesAI Agent Engineering Platform built on an Open Source TypeScript AI Agent Framework
git clone https://github.com/VoltAgent/voltagent.git -
railtracks
AI repositoriesAn agentic framework that helps developers build resilient agentic systems
git clone https://github.com/RailtownAI/railtracks.git -
llm-observability-orchestration
MCP serversLLM Observability & Orchestration Agent
-
llm-observability-orchestration-agent-langchain
MCP serversLLM Observability & Orchestration Agent (Langchain)
-
awesome-llm-observability
Skills50+ curated LLM observability tools PLUS 26 Agent Skills (several with runnable, unit-tested scripts) to build, evaluate, debug, secure & monitor reliable LLM apps. Tracing, evals, guardrails, LLMOps.
git clone https://github.com/ContextJet-ai/awesome-llm-observability.git -
LLM Observability & Orchestration Agent (LangChain Community)
-
lmnr
Tools & appsLaminar - open-source observability platform purpose-built for AI agents. YC S24.
git clone https://github.com/lmnr-ai/lmnr.git -
failproofai
AI repositoriesObservability and enforcement for AI agent harnesses. Capture every run and runtime reliability with policy enforcement.
git clone https://github.com/FailproofAI/failproofai.git -
llmgateway
AI repositoriesRoute, manage, and analyze your LLM requests across multiple providers with a unified API interface.
git clone https://github.com/theopenco/llmgateway.git -
judgeval
PromptsThe Continuous-Improvement Stack for Agents. Our environment data and evals power agent improvement and monitoring.
git clone https://github.com/JudgmentLabs/judgeval.git -
Aegis
Agents & frameworksRuntime policy enforcement for AI agents. Cryptographic audit trail, human-in-the-loop approvals, kill switch. Zero code changes.
git clone https://github.com/Justin0504/Aegis.git -
langfuse
Prompts🪢 Open source AI engineering platform: AI Gateway, agent observability, evals, and prompt/skill management, built on OpenTelemetry. One open platform for every AI call and every agent. Self-host or use Langfuse Cloud.
git clone https://github.com/langfuse/langfuse.git -
palico-ai
Agents & frameworksBuild, Improve Performance, and Productionize your AI Application
git clone https://github.com/palico-ai/palico-ai.git -
llm-observability-orchestration
MCP serversRun a prompt through a LangChain (system + human) chain over Gemini on Vertex AI; optional LangSmith
-
mas-lab
Agents & frameworksSpecification-driven multi-agent systems with OpenTelemetry observability, agent traces, benchmarking, MCP, and A2A.
git clone https://github.com/ioc-project/mas-lab.git -
databuff
Agents & frameworksDataBuff is an AI-native APM built on Opentelemetry,with multi-agent troubleshooting out of the box.
git clone https://github.com/databufflabs/databuff.git -
agentplay
Agents & frameworksReplay your coding agent sessions as a map and a timeline
git clone https://github.com/Entelligence-AI/agentplay.git -
langfuse-java
Prompts🪢 Auto-generated Java Client for Langfuse API
git clone https://github.com/langfuse/langfuse-java.git -
trinity
Agents & frameworksSelf-hosted AI Agents Platform for AI Native companies. Claude Code, Codex, Gemini, OpenCode agents. Apache 2.0.
git clone https://github.com/Abilityai/trinity.git -
Tracely-ai
AI repositoriesTrace-native CI/CD for AI agents — production failures become regression tests that block the PR. Auto-detect, cluster, freeze into hermetic cases, replay in CI for $0.
git clone https://github.com/Jwuthri/Tracely-ai.git -
future-agi
Agents & frameworksOpen-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.
git clone https://github.com/future-agi/future-agi.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.