Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
paddler
AI repositoriesOpen-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
git clone https://github.com/intentee/paddler.git -
Execute cargo-load-balancer-mcp
MCP serversPremium agentic endpoint for cargo-load-balancer-mcp.
-
Execute api-key-load-balancer-mcp
MCP serversPremium agentic endpoint for api-key-load-balancer-mcp.
-
Elastic Load Balancing
Public APIsElastic Load Balancing A load balancer can distribute incoming traffic across your EC2 instances. This enables you to increase the availability of your application. The load balancer also monitors the health of its registered instances and ensures that it routes traffic only to healthy instances. You configure your load balancer to accept incoming traffic by specifying one or more listeners…
-
Elastic Load Balancing
Public APIsElastic Load Balancing A load balancer distributes incoming traffic across targets, such as your EC2 instances. This enables you to increase the availability of your application. The load balancer also monitors the health of its registered targets and ensures that it routes traffic only to healthy targets. You configure your load balancer to accept incoming traffic by specifying one or more…
-
bifrost
MCP serversOpen-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.
git clone https://github.com/maximhq/bifrost.git -
gpt-load
AI repositoriesSelf-hosted AI gateway for multi-channel, multi-credential setups — API keys and subscription accounts, scheduling, failover, request logs and usage. 自托管 AI 网关:多渠道多凭据统一接入,含密钥与订阅账号、调度容错、日志与用量。
git clone https://github.com/tbphp/gpt-load.git -
axonhub
AI repositories⚡️ Open-source AI Gateway — Use any SDK to call 100+ LLMs. Built-in failover, load balancing, cost control & end-to-end tracing.
git clone https://github.com/looplj/axonhub.git -
LLM-API-Key-Proxy
AI repositoriesUniversal LLM Gateway: One API, every LLM. OpenAI/Anthropic-compatible endpoints with multi-provider translation and intelligent load-balancing.
git clone https://github.com/Mirrowel/LLM-API-Key-Proxy.git -
NetworkAdminManagementClient
Public APIsLoad balancer admin operation endpoints and objects.
-
FabricAdminClient
Public APIsSoftware load balancer multiplexer operation endpoints and objects.
-
litellm
AI repositoriesThe fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
git clone https://github.com/BerriAI/litellm.git -
FFxF
MCP serversCreate and manage VMs, managed databases, firewalls and load balancers in Montréal, Canada.
-
VMware AVI
MCP serversVMware AVI (NSX ALB) load balancer plus AKO Kubernetes ops — 28 MCP tools.
vmware-avi@2.5.2 -
Hetzner Cloud MCP by usefulapi
MCP serversServers, volumes, networks, firewalls, load balancers, pricing and safe power operations.
-
TatNet — apps and cloud infrastructure
MCP serversDeploy websites; manage apps, persistent app volumes, VMs, S3, NAT gateways and load balancers.
-
GenPark Weighted Round Robin Balancer
MCP serversNginx-style smooth weighted round-robin load balancer with dynamic weight adjustment for multi-LLM r
https://github.com/Alpha-Park/genpark-weighted-round-robin-balancer-skill/releases/download/v1.0.1/genpark-weighted-round-robin-balancer-skill-v1.0.1.mcpb -
Amazon Route 53 Resolver
Public APIsWhen you create a VPC using Amazon VPC, you automatically get DNS resolution within the VPC from Route 53 Resolver. By default, Resolver answers DNS queries for VPC domain names such as domain names for EC2 instances or Elastic Load Balancing load balancers. Resolver performs recursive lookups against public name servers for all other domain names. You can also configure DNS resolution between…
-
fulcra-tools
SkillsLong-running AI agents coordinating over their human's own Fulcra account — shared bus, cross-model reviews, session continuity, load balancing. Unofficial, MIT.
git clone https://github.com/ashfulcra/fulcra-tools.git -
MCP-OpenStack-Ops
MCP servers100+ OpenStack tools for AI agents via MCP: compute, network, storage, identity, Heat, Octavia load balancing and Gnocchi telemetry. Read-only and project-scoped by default. Works with Claude Desktop (.mcpb), Open WebUI and any MCP client. Available on PyPI and Docker Hub.
git clone https://github.com/call518/MCP-OpenStack-Ops.git -
AWS CloudFormation
Public APIsCloudFormation CloudFormation allows you to create and manage Amazon Web Services infrastructure deployments predictably and repeatedly. You can use CloudFormation to leverage Amazon Web Services products, such as Amazon Elastic Compute Cloud, Amazon Elastic Block Store, Amazon Simple Notification Service, Elastic Load Balancing, and Auto Scaling to build highly reliable, highly scalable…
-
Amazon Lightsail
Public APIsAmazon Lightsail is the easiest way to get started with Amazon Web Services (Amazon Web Services) for developers who need to build websites or web applications. It includes everything you need to launch your project quickly - instances (virtual private servers), container services, storage buckets, managed databases, SSD-based block storage, static IP addresses, load balancers, content delivery…
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.