InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

5 results with any of your words Clear search and filters
  1. paddler

    AI repositories

    Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

    Stale GitHub, intentee 1,690 ★Apache-2.0Updated 9 days ago

    git clone https://github.com/intentee/paddler.git
  2. gpt-load

    AI repositories

    Self-hosted AI gateway for multi-channel, multi-credential setups — API keys and subscription accounts, scheduling, failover, request logs and usage. 自托管 AI 网关:多渠道多凭据统一接入,含密钥与订阅账号、调度容错、日志与用量。

    Stale GitHub, tbphp 7,199 ★MITUpdated 8 days ago

    git clone https://github.com/tbphp/gpt-load.git
  3. axonhub

    AI repositories

    ⚡️ Open-source AI Gateway — Use any SDK to call 100+ LLMs. Built-in failover, load balancing, cost control & end-to-end tracing.

    Indexed GitHub, looplj 5,457 ★Apache-2.0Updated yesterday

    git clone https://github.com/looplj/axonhub.git
  4. LLM-API-Key-Proxy

    AI repositories

    Universal LLM Gateway: One API, every LLM. OpenAI/Anthropic-compatible endpoints with multi-provider translation and intelligent load-balancing.

    Stale GitHub, Mirrowel 559 ★Custom licence (see repository)Updated 14 days ago

    git clone https://github.com/Mirrowel/LLM-API-Key-Proxy.git
  5. litellm

    AI repositories

    The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

    Indexed GitHub, BerriAI 63.3k ★Custom licence (see repository)Updated today

    git clone https://github.com/BerriAI/litellm.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.