ome
Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton
Open the source (opens github.com) https://github.com/ome-projects/ome
What it is
AI repositories from ome-projects.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Get the code
git clone https://github.com/ome-projects/ome.git
Standard git access to a public repository
Setup steps: not provided by the source. Follow the instructions on the source.
Related
-
all-in-rag
AI repositories🔍大模型应用开发实战一:RAG 技术全栈指南,在线阅读地址:https://datawhalechina.github.io/all-in-rag/
git clone https://github.com/datawhalechina/all-in-rag.git -
llm-architecture-from-scratch
AI repositoriesImplementing LLM architectures from scratch in PyTorch
git clone https://github.com/YeonwooSung/llm-architecture-from-scratch.git -
xtuner
AI repositoriesA Next-Generation Training Engine Built for Ultra-Large MoE Models
git clone https://github.com/InternLM/xtuner.git -
pegainfer
AI repositoriesPure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
git clone https://github.com/pegainfer-project/pegainfer.git -
vllm
AI repositoriesA high-throughput and memory-efficient inference and serving engine for LLMs
git clone https://github.com/vllm-project/vllm.git -
OmAgent
AI repositories[EMNLP-2024] Build multimodal language agents for fast prototype and production
git clone https://github.com/om-ai-lab/OmAgent.git