InnerVault

semantic-router

IndexedGitHub, vllm-project

An open, programmable decision layer for models and compute.

Open the source (opens github.com) https://github.com/vllm-project/semantic-router

What it is

AI repositories from vllm-project.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/vllm-project/semantic-router.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. agent-router

    AI repositories

    Manages Unified Access to Generative AI Services built on Envoy Gateway

    Stale GitHub, theagentrouter 2,353 ★Apache-2.0Updated 11 days ago

    git clone https://github.com/theagentrouter/agent-router.git
  2. llmgateway

    AI repositories

    Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.

    Indexed GitHub, theopenco 1,743 ★Custom licence (see repository)Updated today

    git clone https://github.com/theopenco/llmgateway.git
  3. plano

    AI repositories

    Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.

    Stale GitHub, katanemo 7,099 ★Apache-2.0Updated 23 days ago

    git clone https://github.com/katanemo/plano.git
  4. gateway

    AI repositories

    A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

    Stale GitHub, Portkey-AI 13.2k ★MITUpdated 5 months ago

    git clone https://github.com/Portkey-AI/gateway.git
  5. llm-d

    AI repositories

    State of the art inference performance with modern accelerators on Kubernetes

    Indexed GitHub, llm-d 5,274 ★Apache-2.0Updated today

    git clone https://github.com/llm-d/llm-d.git
  6. litellm

    AI repositories

    The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

    Indexed GitHub, BerriAI 63.3k ★Custom licence (see repository)Updated today

    git clone https://github.com/BerriAI/litellm.git