InnerVault

kvcached

Stale GitHub, ovg-project

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

Open the source (opens github.com) https://github.com/ovg-project/kvcached

What it is

AI repositories from ovg-project.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/ovg-project/kvcached.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. Mooncake

    AI repositories

    Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

    Indexed GitHub, kvcache-ai 7,047 ★Apache-2.0Updated today

    git clone https://github.com/kvcache-ai/Mooncake.git
  2. R-KV

    AI repositories

    [Neurips 2025] R-KV: Redundancy-aware KV Cache Compression for Reasoning Models

    Stale GitHub, Zefan-Cai 1,217 ★Updated 29 days ago

    git clone https://github.com/Zefan-Cai/R-KV.git
  3. uccl

    AI repositories

    UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)

    Indexed GitHub, uccl-project 1,585 ★Apache-2.0Updated yesterday

    git clone https://github.com/uccl-project/uccl.git
  4. web-llm

    AI repositories

    High-performance In-browser LLM Inference Engine

    Stale GitHub, mlc-ai 19.3k ★Apache-2.0Updated 36 days ago

    git clone https://github.com/mlc-ai/web-llm.git
  5. pegainfer

    AI repositories

    Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

    Stale GitHub, pegainfer-project 729 ★Apache-2.0Updated 18 days ago

    git clone https://github.com/pegainfer-project/pegainfer.git
  6. Halfrost-Field

    AI repositories

    ✍🏻 Source Code Deep Dives, System Design & Engineering Blogs | Halfrost-Field 冰霜之地:源码解析、系统设计与工程实践笔记

    Stale GitHub, halfrost 13.2k ★CC-BY-SA-4.0Updated 47 days ago

    git clone https://github.com/halfrost/Halfrost-Field.git