Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
kvcached
AI repositoriesVirtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond
git clone https://github.com/ovg-project/kvcached.git -
vmlx
MCP serversvMLX - Use MLX models easily - JANGQ (GGUF for MLX) - Not dependant on mlx_vlm
git clone https://github.com/jjang-ai/vmlx.git -
Mooncake
AI repositoriesMooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
git clone https://github.com/kvcache-ai/Mooncake.git -
R-KV
AI repositories[Neurips 2025] R-KV: Redundancy-aware KV Cache Compression for Reasoning Models
git clone https://github.com/Zefan-Cai/R-KV.git -
uccl
AI repositoriesUCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)
git clone https://github.com/uccl-project/uccl.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.