Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
LMCache
AI repositoriesLMCache: Supercharge Your LLM with the Fastest KV Cache Layer
git clone https://github.com/LMCache/LMCache.git -
C2C
Agents & frameworks[ICLR'26] The official code implementation for "Cache-to-Cache: Direct Semantic Communication Between Large Language Models"
git clone https://github.com/thu-nics/C2C.git -
copilot-cache-scout
Agents & frameworksMulti-Agent Code Review Cost Benchmark 2026: Librarian vs Prompt Cache
git clone https://github.com/PROrunner926/copilot-cache-scout.git -
cachebeat
Tools & appsA tiny Claude Code skill that keeps your prompt cache warm during idle sessions, so your next message reads from cache instead of paying full price.
git clone https://github.com/ARahim3/cachebeat.git -
morphik-core
AI repositoriesOpen-source multimodal retrieval engine (Morphik Core)
git clone https://github.com/morphik-org/morphik-core.git -
Flide
Agents & frameworks🔥🔥 The extremely fast inference engine for decision model
git clone https://github.com/OmniJev/Flide.git -
CAG
AI repositoriesCache-Augmented Generation: A Simple, Efficient Alternative to RAG
git clone https://github.com/hhhuang/CAG.git -
curvine
AI repositoriesAI-native, cloud-native file system in Rust. Full POSIX on object storage with a multi-tier distributed cache, for AI training, inference, and agents. CNCF Sandbox project.
git clone https://github.com/CurvineIO/curvine.git -
ai-infra-book
AI repositories《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
git clone https://github.com/bojieli/ai-infra-book.git -
omlx
AI repositoriesLLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
git clone https://github.com/jundot/omlx.git -
automatic speech recognition model by nvidia · nemo
nvidia/nemotron-3.5-asr-streaming-0.6b -
bifrost
MCP serversOpen-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.
git clone https://github.com/maximhq/bifrost.git -
magic-context
Agents & frameworksUnbounded context. Memory that manages itself. One session, for life. The hippocampus for coding agents, part of CortexKit.
git clone https://github.com/cortexkit/magic-context.git -
stim
Agents & frameworksFast, isolated, local React Native and Expo environments for coding agents. Shared build caches, parallel worktrees, owned devices, and safe cleanup.
git clone https://github.com/appandflow/stim.git -
awesome-llm-token-optimization
PromptsA curated list of strategies, tools, papers, and resources for reducing LLM token costs and improving efficiency in production.
git clone https://github.com/pleasedodisturb/awesome-llm-token-optimization.git -
CacheBoost
MCP serversWarm CDN and reverse-proxy caches: manage sites, run warms, read cache-hit stats.
-
token-optimizer-mcp
MCP servers91.5% fewer tokens on tool output on Headroom's own benchmark, where Headroom removes 61.4%. Separately, the same SWE-bench tasks resolved at 0.71x the cost of plain Claude Code. Plus memory across sessions and subscription quota pacing. Claude Code, Codex, Copilot, Gemini and 12 more. Local, MIT.
git clone https://github.com/ooples/token-optimizer-mcp.git -
R-KV
AI repositories[Neurips 2025] R-KV: Redundancy-aware KV Cache Compression for Reasoning Models
git clone https://github.com/Zefan-Cai/R-KV.git -
cache
MCP serversCache headers, CDN, LRU simulation for AI agents
@rog0x/mcp-cache-tools@1.0.2 -
Fresh cache hint
MCP serversFresh cache hint
-
soul
Agents & frameworksSoul: The Persistent Memory Layer for Multi-Agent Systems. High-performance session orchestration with SQLite-based KV-Cache for MCP. Give your AI agents a soul that never forgets.
git clone https://github.com/choihyunsus/soul.git -
automatic speech recognition model by nvidia · nemo
nvidia/nemotron-speech-streaming-en-0.6b -
cache-proxy
MCP serversLLM caching proxy (x402 USDC on Base) - exact + semantic cache. Free health.
-
Prompt-cache prefix guardian
MCP serversCache-bust forensics + TTL-fit verdicts: names the field that busts your prompt cache.
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.