InnerVault

ome

Stale GitHub, ome-projects

Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton

Open the source (opens github.com) https://github.com/ome-projects/ome

What it is

AI repositories from ome-projects.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/ome-projects/ome.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. all-in-rag

    AI repositories

    🔍大模型应用开发实战一:RAG 技术全栈指南,在线阅读地址:https://datawhalechina.github.io/all-in-rag/

    Stale GitHub, datawhalechina 12.1k ★Updated 47 days ago

    git clone https://github.com/datawhalechina/all-in-rag.git
  2. Implementing LLM architectures from scratch in PyTorch

    Stale GitHub, YeonwooSung 856 ★BSD-3-ClauseUpdated 5 days ago

    git clone https://github.com/YeonwooSung/llm-architecture-from-scratch.git
  3. xtuner

    AI repositories

    A Next-Generation Training Engine Built for Ultra-Large MoE Models

    Stale GitHub, InternLM 5,221 ★Apache-2.0Updated 4 days ago

    git clone https://github.com/InternLM/xtuner.git
  4. pegainfer

    AI repositories

    Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

    Stale GitHub, pegainfer-project 729 ★Apache-2.0Updated 18 days ago

    git clone https://github.com/pegainfer-project/pegainfer.git
  5. vllm

    AI repositories

    A high-throughput and memory-efficient inference and serving engine for LLMs

    Indexed GitHub, vllm-project 97.0k ★Apache-2.0Updated today

    git clone https://github.com/vllm-project/vllm.git
  6. OmAgent

    AI repositories

    [EMNLP-2024] Build multimodal language agents for fast prototype and production

    Stale GitHub, om-ai-lab 2,669 ★Apache-2.0Updated 31 days ago

    git clone https://github.com/om-ai-lab/OmAgent.git