Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
-
litellm
AI repositoriesThe fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
git clone https://github.com/BerriAI/litellm.git -
gateway
AI repositoriesA blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
git clone https://github.com/Portkey-AI/gateway.git -
tyk
MCP serversOpen Source API and AI Gateway supporting REST, GraphQL, TCP, gRPC and MCP (Model Context Protocol)
git clone https://github.com/TykTechnologies/tyk.git -
bifrost
MCP serversOpen-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.
git clone https://github.com/maximhq/bifrost.git -
langfuse
Prompts🪢 Open source AI engineering platform: AI Gateway, agent observability, evals, and prompt/skill management, built on OpenTelemetry. One open platform for every AI call and every agent. Self-host or use Langfuse Cloud.
git clone https://github.com/langfuse/langfuse.git -
plano
AI repositoriesPlano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.
git clone https://github.com/katanemo/plano.git -
gpt-load
AI repositoriesSelf-hosted AI gateway for multi-channel, multi-credential setups — API keys and subscription accounts, scheduling, failover, request logs and usage. 自托管 AI 网关:多渠道多凭据统一接入,含密钥与订阅账号、调度容错、日志与用量。
git clone https://github.com/tbphp/gpt-load.git -
OmniRoute
Agents & frameworksNever stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot. Quota-aware auto-fallback, RTK+Caveman compression saves 15-95% tokens, MCP/A2A, Desktop/PWA. Built by 900+ contributors
git clone https://github.com/cheaper-inference/OmniRoute.git -
agent-router
AI repositoriesManages Unified Access to Generative AI Services built on Envoy Gateway
git clone https://github.com/theagentrouter/agent-router.git -
9router
AI repositoriesUnlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RTK -40% tokens, never hit limits.
git clone https://github.com/decolua/9router.git -
casdoor
AI repositoriesAn open-source Agent-first Identity and Access Management (IAM) /LLM MCP & agent gateway and auth server with web UI supporting OpenClaw, MCP, OAuth, OIDC, SAML, CAS, LDAP, SCIM, WebAuthn, TOTP, MFA, Face ID, Google Workspace, Azure AD
git clone https://github.com/casdoor/casdoor.git -
textbee
MCP serversOpen-source SMS gateway. Turn your Android phone into an SMS API: send and receive SMS from your apps over REST and webhooks. Self-hostable, with a free hosted plan.
git clone https://github.com/textbee/textbee.git -
respan-gateway
MCP serversOpen-source LLM gateway in Rust. One endpoint for OpenAI, Anthropic, Gemini and every other vendor. Any SDK, any model, any tool.
git clone https://github.com/respanai/respan-gateway.git -
mcphub
MCP serversSelf-hosted MCP gateway and control plane for connecting, controlling, and operating MCP servers.
git clone https://github.com/samanhappy/mcphub.git -
nasiko
Agents & frameworksThe Open Runtime for AI Agents
git clone https://github.com/Nasiko-Labs/nasiko.git -
otari
AI repositoriesOpen-source AI gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.
git clone https://github.com/mozilla-ai/otari.git -
antirion
AI repositories🕷️ The fastest open-source AI Gateway and LLM Gateway — one binary with built-in console to route, secure, budget and observe every LLM call across OpenAI, Anthropic, Gemini, Bedrock and more.
git clone https://github.com/eliasbiondo/antirion.git -
mcp-context-forge
PromptsAn AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or REST/gRPC APIs, exposing a unified endpoint with centralized discovery, guardrails and management. Optimizes Agent & Tool calling, and supports plugins.
git clone https://github.com/IBM/mcp-context-forge.git -
AI-Gateway
MCP serversLabs to explore AI Models, MCP servers, and Agents with the AI Gateway powered by Azure API Management and Microsoft Foundry 🚀
git clone https://github.com/Azure-Samples/AI-Gateway.git -
mcp-gateway
MCP serversA plugin-based gateway that orchestrates other MCPs and allows developers to build upon it enterprise-grade agents.
git clone https://github.com/lasso-security/mcp-gateway.git -
Unla
MCP servers🧩 MCP Gateway - A lightweight gateway service that instantly transforms existing MCP Servers and APIs into MCP servers with zero code changes. Features Docker deployment and management UI, requiring no infrastructure modifications.
git clone https://github.com/AmoyLab/Unla.git -
archestra
MCP serversEnterprise AI Platform with guardrails, MCP registry, gateway & orchestrator
git clone https://github.com/archestra-ai/archestra.git -
CliRelay
AI repositoriesSelf-hosted AI gateway for coding CLIs — one OpenAI/Claude/Gemini/Codex-compatible endpoint, with a multi-tenant web console, request logs, and spend quotas.
git clone https://github.com/kittors/CliRelay.git -
aisix
Agents & frameworksOpen-source AI gateway for LLMs & AI agents, built in Rust. One OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bedrock & more — routing, guardrails, caching, rate limits, observability.
git clone https://github.com/api7/aisix.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.