sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
Open the source (opens github.com) https://github.com/sgl-project/sglang
What it is
AI repositories from sgl-project.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Get the code
git clone https://github.com/sgl-project/sglang.git
Standard git access to a public repository
Setup steps: not provided by the source. Follow the instructions on the source.
Related
-
vllm
AI repositoriesA high-throughput and memory-efficient inference and serving engine for LLMs
git clone https://github.com/vllm-project/vllm.git -
gpustack
AI repositoriesA GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
git clone https://github.com/gpustack/gpustack.git -
pegainfer
AI repositoriesPure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
git clone https://github.com/pegainfer-project/pegainfer.git -
tokenspeed
AI repositoriesTokenSpeed is a speed-of-light LLM inference engine.
git clone https://github.com/lightseekorg/tokenspeed.git -
ome
AI repositoriesOpen Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton
git clone https://github.com/ome-projects/ome.git -
tt-metal
AI repositories:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.
git clone https://github.com/tenstorrent/tt-metal.git