kvcached
Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond
Open the source (opens github.com) https://github.com/ovg-project/kvcached
What it is
AI repositories from ovg-project.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Get the code
git clone https://github.com/ovg-project/kvcached.git
Standard git access to a public repository
Setup steps: not provided by the source. Follow the instructions on the source.
Related
-
Mooncake
AI repositoriesMooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
git clone https://github.com/kvcache-ai/Mooncake.git -
R-KV
AI repositories[Neurips 2025] R-KV: Redundancy-aware KV Cache Compression for Reasoning Models
git clone https://github.com/Zefan-Cai/R-KV.git -
uccl
AI repositoriesUCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)
git clone https://github.com/uccl-project/uccl.git -
web-llm
AI repositoriesHigh-performance In-browser LLM Inference Engine
git clone https://github.com/mlc-ai/web-llm.git -
pegainfer
AI repositoriesPure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
git clone https://github.com/pegainfer-project/pegainfer.git -
Halfrost-Field
AI repositories✍🏻 Source Code Deep Dives, System Design & Engineering Blogs | Halfrost-Field 冰霜之地:源码解析、系统设计与工程实践笔记
git clone https://github.com/halfrost/Halfrost-Field.git