InnerVault

Library

85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.

Results

  1. helicone

    Prompts

    🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

    Indexed GitHub, Helicone 6,281 ★Apache-2.0Updated 4 days ago

    git clone https://github.com/Helicone/helicone.git
  2. opensre

    AI repositories

    The open-source agent for CI/CD reliability.

    Indexed GitHub, Tracer-Cloud 12.8k ★Apache-2.0Updated yesterday

    git clone https://github.com/Tracer-Cloud/opensre.git
  3. opik

    Prompts

    Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

    Indexed GitHub, comet-ml 23.4k ★Apache-2.0Updated today

    git clone https://github.com/comet-ml/opik.git
  4. voltagent

    AI repositories

    AI Agent Engineering Platform built on an Open Source TypeScript AI Agent Framework

    Stale GitHub, VoltAgent 10.9k ★MITUpdated 10 days ago

    git clone https://github.com/VoltAgent/voltagent.git
  5. railtracks

    AI repositories

    An agentic framework that helps developers build resilient agentic systems

    Indexed GitHub, RailtownAI 235 ★MITUpdated 3 days ago

    git clone https://github.com/RailtownAI/railtracks.git
  6. LLM Observability & Orchestration Agent

    Stale Official MCP Registry, ai.getvda Updated 2 months ago 1 note

  7. LLM Observability & Orchestration Agent (Langchain)

    Stale Official MCP Registry, ai.getvda Updated 2 months ago 1 note

  8. 50+ curated LLM observability tools PLUS 26 Agent Skills (several with runnable, unit-tested scripts) to build, evaluate, debug, secure & monitor reliable LLM apps. Tracing, evals, guardrails, LLMOps.

    Stale GitHub, ContextJet-ai 46 ★Custom licence (see repository)Updated 5 days ago

    git clone https://github.com/ContextJet-ai/awesome-llm-observability.git
  9. LLM Observability & Orchestration Agent (LangChain Community)

    Stale Official MCP Registry, ai.getvda Updated 2 months ago 1 note

  10. lmnr

    Tools & apps

    Laminar - open-source observability platform purpose-built for AI agents. YC S24.

    Indexed GitHub, lmnr-ai 3,492 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/lmnr-ai/lmnr.git
  11. failproofai

    AI repositories

    Observability and enforcement for AI agent harnesses. Capture every run and runtime reliability with policy enforcement.

    Stale GitHub, FailproofAI 6,226 ★Custom licence (see repository)Updated 22 days ago

    git clone https://github.com/FailproofAI/failproofai.git
  12. llmgateway

    AI repositories

    Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.

    Indexed GitHub, theopenco 1,743 ★Custom licence (see repository)Updated today

    git clone https://github.com/theopenco/llmgateway.git
  13. judgeval

    Prompts

    The Continuous-Improvement Stack for Agents. Our environment data and evals power agent improvement and monitoring.

    Indexed GitHub, JudgmentLabs 1,074 ★Apache-2.0Updated today

    git clone https://github.com/JudgmentLabs/judgeval.git
  14. Aegis

    Agents & frameworks

    Runtime policy enforcement for AI agents. Cryptographic audit trail, human-in-the-loop approvals, kill switch. Zero code changes.

    Stale GitHub, Justin0504 525 ★MITUpdated 16 days ago

    git clone https://github.com/Justin0504/Aegis.git
  15. langfuse

    Prompts

    🪢 Open source AI engineering platform: AI Gateway, agent observability, evals, and prompt/skill management, built on OpenTelemetry. One open platform for every AI call and every agent. Self-host or use Langfuse Cloud.

    Indexed GitHub, langfuse 37.5k ★Custom licence (see repository)Updated today

    git clone https://github.com/langfuse/langfuse.git
  16. palico-ai

    Agents & frameworks

    Build, Improve Performance, and Productionize your AI Application

    Stale GitHub, palico-ai 343 ★MITUpdated 24 months ago

    git clone https://github.com/palico-ai/palico-ai.git
  17. Run a prompt through a LangChain (system + human) chain over Gemini on Vertex AI; optional LangSmith

    Stale Official MCP Registry, io.github.mikerawsonnz Updated 5 months ago 1 note

  18. mas-lab

    Agents & frameworks

    Specification-driven multi-agent systems with OpenTelemetry observability, agent traces, benchmarking, MCP, and A2A.

    Indexed GitHub, ioc-project 65 ★Apache-2.0Updated yesterday

    git clone https://github.com/ioc-project/mas-lab.git
  19. databuff

    Agents & frameworks

    DataBuff is an AI-native APM built on Opentelemetry,with multi-agent troubleshooting out of the box.

    Stale GitHub, databufflabs 704 ★AGPL-3.0Updated 41 days ago

    git clone https://github.com/databufflabs/databuff.git
  20. agentplay

    Agents & frameworks

    Replay your coding agent sessions as a map and a timeline

    Stale GitHub, Entelligence-AI 298 ★Apache-2.0Updated 23 days ago

    git clone https://github.com/Entelligence-AI/agentplay.git
  21. langfuse-java

    Prompts

    🪢 Auto-generated Java Client for Langfuse API

    Indexed GitHub, langfuse 74 ★MITUpdated 3 days ago

    git clone https://github.com/langfuse/langfuse-java.git
  22. trinity

    Agents & frameworks

    Self-hosted AI Agents Platform for AI Native companies. Claude Code, Codex, Gemini, OpenCode agents. Apache 2.0.

    Indexed GitHub, Abilityai 777 ★Apache-2.0Updated yesterday

    git clone https://github.com/Abilityai/trinity.git
  23. Tracely-ai

    AI repositories

    Trace-native CI/CD for AI agents — production failures become regression tests that block the PR. Auto-detect, cluster, freeze into hermetic cases, replay in CI for $0.

    Stale GitHub, Jwuthri 1,311 ★MITUpdated 8 days ago

    git clone https://github.com/Jwuthri/Tracely-ai.git
  24. future-agi

    Agents & frameworks

    Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

    Indexed GitHub, future-agi 2,267 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/future-agi/future-agi.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.