Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
paddler
AI repositoriesOpen-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
git clone https://github.com/intentee/paddler.git -
gpt-load
AI repositoriesSelf-hosted AI gateway for multi-channel, multi-credential setups — API keys and subscription accounts, scheduling, failover, request logs and usage. 自托管 AI 网关:多渠道多凭据统一接入,含密钥与订阅账号、调度容错、日志与用量。
git clone https://github.com/tbphp/gpt-load.git -
axonhub
AI repositories⚡️ Open-source AI Gateway — Use any SDK to call 100+ LLMs. Built-in failover, load balancing, cost control & end-to-end tracing.
git clone https://github.com/looplj/axonhub.git -
LLM-API-Key-Proxy
AI repositoriesUniversal LLM Gateway: One API, every LLM. OpenAI/Anthropic-compatible endpoints with multi-provider translation and intelligent load-balancing.
git clone https://github.com/Mirrowel/LLM-API-Key-Proxy.git -
litellm
AI repositoriesThe fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
git clone https://github.com/BerriAI/litellm.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.