semantic-router
An open, programmable decision layer for models and compute.
Open the source (opens github.com) https://github.com/vllm-project/semantic-router
What it is
AI repositories from vllm-project.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Get the code
git clone https://github.com/vllm-project/semantic-router.git
Standard git access to a public repository
Setup steps: not provided by the source. Follow the instructions on the source.
Related
-
agent-router
AI repositoriesManages Unified Access to Generative AI Services built on Envoy Gateway
git clone https://github.com/theagentrouter/agent-router.git -
llmgateway
AI repositoriesRoute, manage, and analyze your LLM requests across multiple providers with a unified API interface.
git clone https://github.com/theopenco/llmgateway.git -
plano
AI repositoriesPlano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.
git clone https://github.com/katanemo/plano.git -
gateway
AI repositoriesA blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
git clone https://github.com/Portkey-AI/gateway.git -
llm-d
AI repositoriesState of the art inference performance with modern accelerators on Kubernetes
git clone https://github.com/llm-d/llm-d.git -
litellm
AI repositoriesThe fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
git clone https://github.com/BerriAI/litellm.git