Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
AI-Gateway
MCP serversLabs to explore AI Models, MCP servers, and Agents with the AI Gateway powered by Azure API Management and Microsoft Foundry 🚀
git clone https://github.com/Azure-Samples/AI-Gateway.git -
gateway
AI repositoriesA blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
git clone https://github.com/Portkey-AI/gateway.git -
litellm
AI repositoriesThe fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
git clone https://github.com/BerriAI/litellm.git -
tyk
MCP serversOpen Source API and AI Gateway supporting REST, GraphQL, TCP, gRPC and MCP (Model Context Protocol)
git clone https://github.com/TykTechnologies/tyk.git -
plano
AI repositoriesPlano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.
git clone https://github.com/katanemo/plano.git -
langfuse
Prompts🪢 Open source AI engineering platform: AI Gateway, agent observability, evals, and prompt/skill management, built on OpenTelemetry. One open platform for every AI call and every agent. Self-host or use Langfuse Cloud.
git clone https://github.com/langfuse/langfuse.git -
gpt-load
AI repositoriesSelf-hosted AI gateway for multi-channel, multi-credential setups — API keys and subscription accounts, scheduling, failover, request logs and usage. 自托管 AI 网关:多渠道多凭据统一接入,含密钥与订阅账号、调度容错、日志与用量。
git clone https://github.com/tbphp/gpt-load.git -
semantic-router
AI repositoriesAn open, programmable decision layer for models and compute.
git clone https://github.com/vllm-project/semantic-router.git -
agent-router
AI repositoriesManages Unified Access to Generative AI Services built on Envoy Gateway
git clone https://github.com/theagentrouter/agent-router.git -
awesome-ai-gateway
Datasets & benchmarks⚡ Awesome AI Gateway — pick an AI gateway from 240+ (LiteLLM, OpenRouter, Portkey, Kong, Higress, new-api, Bifrost) by cost, security & compliance, see what consolidated in 2026, learn how they actually work from an 8-chapter handbook, and verify every number yourself. Reproducible benchmarks, bilingual; stars & releases refreshed daily.
git clone https://github.com/cuihuan/awesome-ai-gateway.git -
OmniRoute
Agents & frameworksNever stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot. Quota-aware auto-fallback, RTK+Caveman compression saves 15-95% tokens, MCP/A2A, Desktop/PWA. Built by 900+ contributors
git clone https://github.com/cheaper-inference/OmniRoute.git -
awesome-ai-gateways
MCP serversAwesome AI gateways: open source and commercial LLM gateways, MCP gateways, agent (A2A) gateways, model routers, specs, and guides.
git clone https://github.com/ai-gateways/awesome-ai-gateways.git -
aisix
Agents & frameworksOpen-source AI gateway for LLMs & AI agents, built in Rust. One OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bedrock & more — routing, guardrails, caching, rate limits, observability.
git clone https://github.com/api7/aisix.git -
CliRelay
AI repositoriesSelf-hosted AI gateway for coding CLIs — one OpenAI/Claude/Gemini/Codex-compatible endpoint, with a multi-tenant web console, request logs, and spend quotas.
git clone https://github.com/kittors/CliRelay.git -
otari
AI repositoriesOpen-source AI gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.
git clone https://github.com/mozilla-ai/otari.git -
vllora
MCP serversDebug your AI agents
git clone https://github.com/vllora/vllora.git -
opencodex
AI repositoriesUniversal provider proxy for OpenAI Codex & Claude Code — use any LLM (Claude, Gemini, Grok, DeepSeek, Ollama…) with Codex CLI, App, SDK, and Claude Code
git clone https://github.com/lidge-jun/opencodex.git -
ai-gateway
MCP serversCloudflare Workers MCP server: ai-gateway
-
orbit
AI repositoriesSelf-hosted AI gateway for private RAG, natural-language data access, and tool-calling agents.
git clone https://github.com/schmitech/orbit.git -
9router
AI repositoriesUnlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RTK -40% tokens, never hit limits.
git clone https://github.com/decolua/9router.git -
ai-gateway-mcp
MCP serversAi Gateway MCP Server by MEOK AI Labs
ai-gateway-mcp@1.0.11 -
1flowbase
MCP serversBuild for agents — from the AI Gateway to the entire application stack.
git clone https://github.com/taichuy/1flowbase.git -
llmgateway
AI repositoriesRoute, manage, and analyze your LLM requests across multiple providers with a unified API interface.
git clone https://github.com/theopenco/llmgateway.git -
bifrost
MCP serversOpen-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.
git clone https://github.com/maximhq/bifrost.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.