litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
Open the source (opens github.com) https://github.com/berriai/litellm
What it is
AI repositories from BerriAI.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Get the code
git clone https://github.com/BerriAI/litellm.git
Standard git access to a public repository
Setup steps: not provided by the source. Follow the instructions on the source.
Related
-
antirion
AI repositories🕷️ The fastest open-source AI Gateway and LLM Gateway — one binary with built-in console to route, secure, budget and observe every LLM call across OpenAI, Anthropic, Gemini, Bedrock and more.
git clone https://github.com/eliasbiondo/antirion.git -
slide-deck-ai
AI repositoriesCo-create PowerPoint slide decks with AI
git clone https://github.com/barun-saha/slide-deck-ai.git -
tools
AI repositoriesA set of tools that gives agents powerful capabilities.
git clone https://github.com/strands-agents/tools.git -
otari
AI repositoriesOpen-source AI gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.
git clone https://github.com/mozilla-ai/otari.git -
agent-squad
AI repositoriesFlexible and powerful framework for managing multiple AI agents and handling complex conversations
git clone https://github.com/2FastLabs/agent-squad.git -
gpt-load
AI repositoriesSelf-hosted AI gateway for multi-channel, multi-credential setups — API keys and subscription accounts, scheduling, failover, request logs and usage. 自托管 AI 网关:多渠道多凭据统一接入,含密钥与订阅账号、调度容错、日志与用量。
git clone https://github.com/tbphp/gpt-load.git