Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
gateway
AI repositoriesA blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
git clone https://github.com/Portkey-AI/gateway.git -
mcp-llm-gateway
MCP serversMCP-compatible LLM gateway that proxies completion requests.
mcp-llm-gateway@0.1.0 -
vllora
MCP serversDebug your AI agents
git clone https://github.com/vllora/vllora.git -
respan-gateway
MCP serversOpen-source LLM gateway in Rust. One endpoint for OpenAI, Anthropic, Gemini and every other vendor. Any SDK, any model, any tool.
git clone https://github.com/respanai/respan-gateway.git -
tyk
MCP serversOpen Source API and AI Gateway supporting REST, GraphQL, TCP, gRPC and MCP (Model Context Protocol)
git clone https://github.com/TykTechnologies/tyk.git -
litellm
AI repositoriesThe fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
git clone https://github.com/BerriAI/litellm.git -
9router
AI repositoriesUnlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RTK -40% tokens, never hit limits.
git clone https://github.com/decolua/9router.git -
antirion
AI repositories🕷️ The fastest open-source AI Gateway and LLM Gateway — one binary with built-in console to route, secure, budget and observe every LLM call across OpenAI, Anthropic, Gemini, Bedrock and more.
git clone https://github.com/eliasbiondo/antirion.git -
llmgateway
AI repositoriesRoute, manage, and analyze your LLM requests across multiple providers with a unified API interface.
git clone https://github.com/theopenco/llmgateway.git -
bifrost
MCP serversOpen-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.
git clone https://github.com/maximhq/bifrost.git -
awesome-ai-api-proxy
Docs & tutorialsOne key. Every model. Anywhere. — A curated map of AI API relay stations & LLM gateways.
git clone https://github.com/howardpen9/awesome-ai-api-proxy.git -
gpt-load
AI repositoriesSelf-hosted AI gateway for multi-channel, multi-credential setups — API keys and subscription accounts, scheduling, failover, request logs and usage. 自托管 AI 网关:多渠道多凭据统一接入,含密钥与订阅账号、调度容错、日志与用量。
git clone https://github.com/tbphp/gpt-load.git -
Routara LLM Gateway
MCP serversOpenAI-compatible LLM, image and video APIs via Routara (api.routara.ai).
routara-mcp@1.0.1 -
langfuse
Prompts🪢 Open source AI engineering platform: AI Gateway, agent observability, evals, and prompt/skill management, built on OpenTelemetry. One open platform for every AI call and every agent. Self-host or use Langfuse Cloud.
git clone https://github.com/langfuse/langfuse.git -
plano
AI repositoriesPlano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.
git clone https://github.com/katanemo/plano.git -
OmniRoute
Agents & frameworksNever stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot. Quota-aware auto-fallback, RTK+Caveman compression saves 15-95% tokens, MCP/A2A, Desktop/PWA. Built by 900+ contributors
git clone https://github.com/cheaper-inference/OmniRoute.git -
awesome-ai-gateways
MCP serversAwesome AI gateways: open source and commercial LLM gateways, MCP gateways, agent (A2A) gateways, model routers, specs, and guides.
git clone https://github.com/ai-gateways/awesome-ai-gateways.git -
deltallm
MCP serversSelf-hosted LLM gateway with SSO, audit logs, client access controls, routing, and usage tracking. OpenAI-compatible and MIT licensed.
git clone https://github.com/deltawi/deltallm.git -
otari
AI repositoriesOpen-source AI gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.
git clone https://github.com/mozilla-ai/otari.git -
Lynkr
Tools & appsStreamline your workflow with Lynkr, a CLI tool that acts as an HTTP proxy for efficient code interactions using Claude Code CLI.
git clone https://github.com/Fast-Editor/Lynkr.git -
HiRoute
Agents & frameworksMake Codex and Claude Code subscriptions go further: a local model router that gives routine agent work to economical models and keeps your strongest model for the hard parts.
git clone https://github.com/higress-group/HiRoute.git -
1flowbase
MCP serversBuild for agents — from the AI Gateway to the entire application stack.
git clone https://github.com/taichuy/1flowbase.git -
9routerx
MCP servers9RouterX (9R Next Go Generation): Single-binary Go AI router, LLM gateway & 20-40% token saver. Route Claude Code, Cursor & Codex across 155 providers, 28 OAuth & 248 free models (24 keyless) — OpenAI, Claude, Gemini, DeepSeek, Groq, Ollama & MCP.
git clone https://github.com/yanstd888/9routerx.git -
aisix
Agents & frameworksOpen-source AI gateway for LLMs & AI agents, built in Rust. One OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bedrock & more — routing, guardrails, caching, rate limits, observability.
git clone https://github.com/api7/aisix.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.