InnerVault

Library

85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.

Results

  1. xorcise

    Datasets & benchmarks

    Run cyber-AI agents against real missions in isolated environments. Record everything as OpenTelemetry evidence. Grade the evidence, not the claim.

    Stale GitHub, xorcise-ai 33 ★Custom licence (see repository)Updated 17 days ago

    git clone https://github.com/xorcise-ai/xorcise.git
  2. 1flowbase

    MCP servers

    Build for agents — from the AI Gateway to the entire application stack.

    Stale GitHub, taichuy 287 ★Apache-2.0Updated 11 days ago

    git clone https://github.com/taichuy/1flowbase.git
  3. clawmetry

    Agents & frameworks

    See your agent think. Zero-config observability & governance for 30 AI agent runtimes: Claude Code, OpenAI Codex, Hermes, OpenClaw & 26 more. Live token costs, sessions, tool calls, crons.

    Indexed GitHub, vivekchand 438 ★MITUpdated yesterday

    git clone https://github.com/vivekchand/clawmetry.git
  4. inferock-bench

    Datasets & benchmarks

    Local LLM cost-tracking proxy for OpenAI, Anthropic, Gemini, and pinned OpenRouter calls with token usage, failure, and billing-integrity receipts.

    Stale GitHub, inferock 107 ★Custom licence (see repository)Updated 3 months ago

    git clone https://github.com/inferock/inferock-bench.git
  5. tma1

    Agents & frameworks

    Local-first observability your agent reads back. TMA1 records every LLM call, then routes what it sees into the agent's next turn via hooks and MCP.

    Stale GitHub, tma1-ai 122 ★Apache-2.0Updated 17 days ago

    git clone https://github.com/tma1-ai/tma1.git
  6. bifrost

    MCP servers

    Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.

    Indexed GitHub, maximhq 9,577 ★Apache-2.0Updated today

    git clone https://github.com/maximhq/bifrost.git
  7. claude-flightdeck

    Agents & frameworks

    A Claude Code mod that puts a live agent dashboard in your terminal: context and cost, advisor timeline, every permission check, subagent cards and swimlanes.

    Stale GitHub, scasella 247 ★MITUpdated 9 days ago

    git clone https://github.com/scasella/claude-flightdeck.git
  8. nudgebee

    AI repositories

    Open-source agentic ops platform for cloud, SRE, DevOps, support and FinOps teams. AI agents investigate incidents, cut cloud and Kubernetes waste and run approval-gated runbooks across Kubernetes, AWS, Azure, GCP and your databases. Self-hosted, bring your own models.

    Stale GitHub, nudgebee 521 ★Custom licence (see repository)Updated 4 days ago

    git clone https://github.com/nudgebee/nudgebee.git
  9. nudge

    MCP servers

    A typed, replayable, budget-aware programming language for LLM agents. Compiles to Python & TypeScript.

    Stale GitHub, NekomyaDev 20 ★Apache-2.0Updated 11 days ago

    git clone https://github.com/NekomyaDev/nudge.git
  10. evidently

    AI repositories

    Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

    Stale GitHub, evidentlyai 7,988 ★Apache-2.0Updated 48 days ago

    git clone https://github.com/evidentlyai/evidently.git
  11. langfuse

    MCP servers

    MCP server for Langfuse LLM observability — trace and observation analysis.

    Stale Official MCP Registry, com.pulsemcp Updated 5 months ago 2 notes

    langfuse-observability-mcp-server@0.1.3
  12. Agent-Blackbox

    Tools & apps

    Local-first flight recorder for coding agents : replay every run as a live session map, score the context bill, and write the fix back into AGENTS.md — no API key, one npx command.

    Stale GitHub, TaewoooPark 83 ★MITUpdated 14 days ago

    git clone https://github.com/TaewoooPark/Agent-Blackbox.git
  13. coding.sh

    MCP servers

    Open-source, local-first observability and evals for AI agents: see what Claude Code, Codex, Cursor and others did and what it cost.

    Indexed GitHub, jackulau 30 ★MITUpdated today

    git clone https://github.com/jackulau/coding.sh.git
  14. awesome-ai-tokenomics

    Docs & tutorials

    A curated list on AI token economics: what tokens cost, where they get wasted, and how to cut the bill. Tools, benchmarks, papers, and copy-paste configs for the token economy of LLMs and coding agents.

    Indexed GitHub, QuesmaOrg 219 ★CC0-1.0Updated 3 days ago

    git clone https://github.com/QuesmaOrg/awesome-ai-tokenomics.git
  15. langkit

    Prompts

    🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text quality, relevance metrics, & sentiment analysis. 📊 A comprehensive tool for LLM observability. 👀

    Stale GitHub, whylabs 1,000 ★Apache-2.0Updated 24 months ago

    git clone https://github.com/whylabs/langkit.git
  16. olivares

    MCP servers

    Ground truth for enterprise AI: your AI coding tools, your accounts and every session on your own server, from one web console, CLI or API. Self-hosted, open source.

    Stale GitHub, olivaresai 20 ★AGPL-3.0Updated 9 days ago

    git clone https://github.com/olivaresai/olivares.git
  17. console

    MCP servers

    Open-source, self-hosted AI gateway and control plane: OpenAI-compatible LLM routing, RAG, an MCP hub, guardrails and agent tracing for multi-tenant teams.

    Indexed GitHub, Cognipeer 27 ★AGPL-3.0Updated 4 days ago

    git clone https://github.com/Cognipeer/console.git
  18. mcp-server

    MCP servers

    Query Spanlens LLM observability from Cursor, Claude Desktop, or Continue via MCP.

    Stale Official MCP Registry, io.github.spanlens Updated 49 days ago 2 notes

    @spanlens/mcp-server@0.3.0
  19. skills

    Skills

    Claude Code plugin marketplace — 77 installable reference skills across vLLM/SGLang inference, Kubernetes & Harvester, GPU host bring-up, observability, security, and agent workflows.

    Stale GitHub, air-gapped 6 ★MITUpdated 6 days ago

    git clone https://github.com/air-gapped/skills.git
  20. Governed local-LLM observability: model policy, prompt scanner, capture proxy, 21 tools.

    Stale Official MCP Registry, io.github.AIops-tools Updated 8 days ago 1 note

    ai-guardian-aiops@0.14.1

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.