Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
phoenix
PromptsAI Observability & Evaluation
git clone https://github.com/Arize-ai/phoenix.git -
trulens
Agents & frameworksEvaluation and Tracking for LLM Experiments and AI Agents
git clone https://github.com/truera/trulens.git -
lmnr
Tools & appsLaminar - open-source observability platform purpose-built for AI agents. YC S24.
git clone https://github.com/lmnr-ai/lmnr.git -
Kottos AI Observatory
MCP serversLLM list prices by venue and tier, plus time to first token from a once-a-minute probe
-
arize-skills
SkillsAgent skills for Arize — datasets, experiments, and traces via the ax CLI
git clone https://github.com/Arize-ai/arize-skills.git -
trinity
Agents & frameworksSelf-hosted AI Agents Platform for AI Native companies. Claude Code, Codex, Gemini, OpenCode agents. Apache 2.0.
git clone https://github.com/Abilityai/trinity.git -
future-agi
Agents & frameworksOpen-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.
git clone https://github.com/future-agi/future-agi.git -
awesome-llm-observability
Skills50+ curated LLM observability tools PLUS 26 Agent Skills (several with runnable, unit-tested scripts) to build, evaluate, debug, secure & monitor reliable LLM apps. Tracing, evals, guardrails, LLMOps.
git clone https://github.com/ContextJet-ai/awesome-llm-observability.git -
WhiteBoxXAI
MCP serversAI observability, explainability and governance: drift, fairness, ISO 42001, risk register.
whiteboxxai-mcp@0.3.2 -
cockpit-agent
MCP servers面向智能座舱的云边协同 AI Agent:端侧毫秒级车控,云端声明式 Multi-Agent 与 Skill/DAG 编排,支持 S2S 实时语音、声纹多用户、HMI和Android双端;LLM 只负责理解与规划,VAL 负责确定性安全执行。
git clone https://github.com/SuperdeMan/cockpit-agent.git -
spring-ai-playground
AI repositoriesSafe local execution layer for AI agent tools. Build and test-run MCP tools (no pass, no run), serve them from a built-in MCP server, and use them in Agentic Chat with RAG, human-in-the-loop approval, and built-in observability. Cross-platform desktop app powered by Spring AI.
git clone https://github.com/spring-ai-community/spring-ai-playground.git -
Monte Carlo
MCP serversData + AI observability — monitor and troubleshoot production-grade agents and the context they use.
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.