InnerVault

litellm

IndexedGitHub, BerriAI

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

Open the source (opens github.com) https://github.com/berriai/litellm

What it is

AI repositories from BerriAI.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/BerriAI/litellm.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. antirion

    AI repositories

    🕷️ The fastest open-source AI Gateway and LLM Gateway — one binary with built-in console to route, secure, budget and observe every LLM call across OpenAI, Anthropic, Gemini, Bedrock and more.

    Stale GitHub, eliasbiondo 501 ★Apache-2.0Updated 17 days ago

    git clone https://github.com/eliasbiondo/antirion.git
  2. slide-deck-ai

    AI repositories

    Co-create PowerPoint slide decks with AI

    Stale GitHub, barun-saha 377 ★MITUpdated 21 days ago

    git clone https://github.com/barun-saha/slide-deck-ai.git
  3. tools

    AI repositories

    A set of tools that gives agents powerful capabilities.

    Stale GitHub, strands-agents 1,336 ★Apache-2.0Updated 24 days ago

    git clone https://github.com/strands-agents/tools.git
  4. otari

    AI repositories

    Open-source AI gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.

    Indexed GitHub, mozilla-ai 927 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/mozilla-ai/otari.git
  5. agent-squad

    AI repositories

    Flexible and powerful framework for managing multiple AI agents and handling complex conversations

    Indexed GitHub, 2FastLabs 7,805 ★Apache-2.0Updated 5 days ago

    git clone https://github.com/2FastLabs/agent-squad.git
  6. gpt-load

    AI repositories

    Self-hosted AI gateway for multi-channel, multi-credential setups — API keys and subscription accounts, scheduling, failover, request logs and usage. 自托管 AI 网关:多渠道多凭据统一接入,含密钥与订阅账号、调度容错、日志与用量。

    Stale GitHub, tbphp 7,199 ★MITUpdated 8 days ago

    git clone https://github.com/tbphp/gpt-load.git