Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
traced-llm-proxy
MCP serversTraced LLM Proxy
-
traced-multi-llm-proxy
MCP serversTraced Multi-LLM Proxy
-
traced-llm-proxy
MCP serversProxy Gemini (Vertex AI) completions wrapped in OpenTelemetry trace spans; returns the answer plus t
-
respan-gateway
MCP serversOpen-source LLM gateway in Rust. One endpoint for OpenAI, Anthropic, Gemini and every other vendor. Any SDK, any model, any tool.
git clone https://github.com/respanai/respan-gateway.git -
bifrost
MCP serversOpen-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.
git clone https://github.com/maximhq/bifrost.git -
awesome-ai-gateways
MCP serversAwesome AI gateways: open source and commercial LLM gateways, MCP gateways, agent (A2A) gateways, model routers, specs, and guides.
git clone https://github.com/ai-gateways/awesome-ai-gateways.git -
deltallm
MCP serversSelf-hosted LLM gateway with SSO, audit logs, client access controls, routing, and usage tracking. OpenAI-compatible and MIT licensed.
git clone https://github.com/deltawi/deltallm.git -
vibops-mcp
MCP servers117 MCP tools for GPU infrastructure + Agent FinOps — deploy LLMs, manage VMs (Proxmox/XO/vSphere), track cost per agent, enforce budgets and model policies. Works with Claude, Cursor, n8n, LangChain
git clone https://github.com/VibOpsai/vibops-mcp.git -
SmartGate
MCP serversHosted MCP: search, fetch, compress, dedup, budget, memory, pipelines. Not an LLM proxy.
-
foundrynet-inference
MCP serversx402 LLM proxy + data-enriched analysis (17 sources) + TimesFM predictive IoT intelligence.
-
skgate
MCP serversSelf-hosted MCP gateway and LLM proxy: OAuth 2.1, model aliases, Grok subscription as an API.
ghcr.io/helv-io/skgate:0.28.1
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.