Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
-
xorcise
Datasets & benchmarksRun cyber-AI agents against real missions in isolated environments. Record everything as OpenTelemetry evidence. Grade the evidence, not the claim.
git clone https://github.com/xorcise-ai/xorcise.git -
1flowbase
MCP serversBuild for agents — from the AI Gateway to the entire application stack.
git clone https://github.com/taichuy/1flowbase.git -
clawmetry
Agents & frameworksSee your agent think. Zero-config observability & governance for 30 AI agent runtimes: Claude Code, OpenAI Codex, Hermes, OpenClaw & 26 more. Live token costs, sessions, tool calls, crons.
git clone https://github.com/vivekchand/clawmetry.git -
inferock-bench
Datasets & benchmarksLocal LLM cost-tracking proxy for OpenAI, Anthropic, Gemini, and pinned OpenRouter calls with token usage, failure, and billing-integrity receipts.
git clone https://github.com/inferock/inferock-bench.git -
tma1
Agents & frameworksLocal-first observability your agent reads back. TMA1 records every LLM call, then routes what it sees into the agent's next turn via hooks and MCP.
git clone https://github.com/tma1-ai/tma1.git -
bifrost
MCP serversOpen-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.
git clone https://github.com/maximhq/bifrost.git -
claude-flightdeck
Agents & frameworksA Claude Code mod that puts a live agent dashboard in your terminal: context and cost, advisor timeline, every permission check, subagent cards and swimlanes.
git clone https://github.com/scasella/claude-flightdeck.git -
nudgebee
AI repositoriesOpen-source agentic ops platform for cloud, SRE, DevOps, support and FinOps teams. AI agents investigate incidents, cut cloud and Kubernetes waste and run approval-gated runbooks across Kubernetes, AWS, Azure, GCP and your databases. Self-hosted, bring your own models.
git clone https://github.com/nudgebee/nudgebee.git -
nudge
MCP serversA typed, replayable, budget-aware programming language for LLM agents. Compiles to Python & TypeScript.
git clone https://github.com/NekomyaDev/nudge.git -
evidently
AI repositoriesEvidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
git clone https://github.com/evidentlyai/evidently.git -
langfuse
MCP serversMCP server for Langfuse LLM observability — trace and observation analysis.
langfuse-observability-mcp-server@0.1.3 -
Agent-Blackbox
Tools & appsLocal-first flight recorder for coding agents : replay every run as a live session map, score the context bill, and write the fix back into AGENTS.md — no API key, one npx command.
git clone https://github.com/TaewoooPark/Agent-Blackbox.git -
coding.sh
MCP serversOpen-source, local-first observability and evals for AI agents: see what Claude Code, Codex, Cursor and others did and what it cost.
git clone https://github.com/jackulau/coding.sh.git -
awesome-ai-tokenomics
Docs & tutorialsA curated list on AI token economics: what tokens cost, where they get wasted, and how to cut the bill. Tools, benchmarks, papers, and copy-paste configs for the token economy of LLMs and coding agents.
git clone https://github.com/QuesmaOrg/awesome-ai-tokenomics.git -
langkit
Prompts🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text quality, relevance metrics, & sentiment analysis. 📊 A comprehensive tool for LLM observability. 👀
git clone https://github.com/whylabs/langkit.git -
olivares
MCP serversGround truth for enterprise AI: your AI coding tools, your accounts and every session on your own server, from one web console, CLI or API. Self-hosted, open source.
git clone https://github.com/olivaresai/olivares.git -
console
MCP serversOpen-source, self-hosted AI gateway and control plane: OpenAI-compatible LLM routing, RAG, an MCP hub, guardrails and agent tracing for multi-tenant teams.
git clone https://github.com/Cognipeer/console.git -
mcp-server
MCP serversQuery Spanlens LLM observability from Cursor, Claude Desktop, or Continue via MCP.
@spanlens/mcp-server@0.3.0 -
skills
SkillsClaude Code plugin marketplace — 77 installable reference skills across vLLM/SGLang inference, Kubernetes & Harvester, GPU host bring-up, observability, security, and agent workflows.
git clone https://github.com/air-gapped/skills.git -
Local LLM Guard for Ollama / llama.cpp
MCP serversGoverned local-LLM observability: model policy, prompt scanner, capture proxy, 21 tools.
ai-guardian-aiops@0.14.1
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.