InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. LMCache

    AI repositories

    LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

    Indexed GitHub, LMCache 12.4k ★Apache-2.0Updated 2 days ago

    git clone https://github.com/LMCache/LMCache.git
  2. C2C

    Agents & frameworks

    [ICLR'26] The official code implementation for "Cache-to-Cache: Direct Semantic Communication Between Large Language Models"

    Stale GitHub, thu-nics 757 ★Apache-2.0Updated 19 days ago

    git clone https://github.com/thu-nics/C2C.git
  3. copilot-cache-scout

    Agents & frameworks

    Multi-Agent Code Review Cost Benchmark 2026: Librarian vs Prompt Cache

    Indexed GitHub, PROrunner926 114 ★Updated today

    git clone https://github.com/PROrunner926/copilot-cache-scout.git
  4. cachebeat

    Tools & apps

    A tiny Claude Code skill that keeps your prompt cache warm during idle sessions, so your next message reads from cache instead of paying full price.

    Stale GitHub, ARahim3 71 ★MITUpdated 34 days ago

    git clone https://github.com/ARahim3/cachebeat.git
  5. morphik-core

    AI repositories

    Open-source multimodal retrieval engine (Morphik Core)

    Stale GitHub, morphik-org 3,719 ★Custom licence (see repository)Updated 21 days ago

    git clone https://github.com/morphik-org/morphik-core.git
  6. Flide

    Agents & frameworks

    🔥🔥 The extremely fast inference engine for decision model

    Stale GitHub, OmniJev 396 ★Apache-2.0Updated 5 days ago

    git clone https://github.com/OmniJev/Flide.git
  7. CAG

    AI repositories

    Cache-Augmented Generation: A Simple, Efficient Alternative to RAG

    Stale GitHub, hhhuang 1,605 ★MITUpdated 17 months ago

    git clone https://github.com/hhhuang/CAG.git
  8. curvine

    AI repositories

    AI-native, cloud-native file system in Rust. Full POSIX on object storage with a multi-tier distributed cache, for AI training, inference, and agents. CNCF Sandbox project.

    Indexed GitHub, CurvineIO 1,068 ★Apache-2.0Updated yesterday

    git clone https://github.com/CurvineIO/curvine.git
  9. ai-infra-book

    AI repositories

    《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验

    Stale GitHub, bojieli 6,489 ★Apache-2.0Updated 46 days ago

    git clone https://github.com/bojieli/ai-infra-book.git
  10. omlx

    AI repositories

    LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

    Indexed GitHub, jundot 23.7k ★Apache-2.0Updated today

    git clone https://github.com/jundot/omlx.git
  11. automatic speech recognition model by nvidia · nemo

    Stale Hugging Face Hub, nvidia 1,262 ♥otherUpdated 2 months ago

    nvidia/nemotron-3.5-asr-streaming-0.6b
  12. bifrost

    MCP servers

    Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.

    Indexed GitHub, maximhq 9,577 ★Apache-2.0Updated today

    git clone https://github.com/maximhq/bifrost.git
  13. magic-context

    Agents & frameworks

    Unbounded context. Memory that manages itself. One session, for life. The hippocampus for coding agents, part of CortexKit.

    Indexed GitHub, cortexkit 2,522 ★MITUpdated today

    git clone https://github.com/cortexkit/magic-context.git
  14. stim

    Agents & frameworks

    Fast, isolated, local React Native and Expo environments for coding agents. Shared build caches, parallel worktrees, owned devices, and safe cleanup.

    Indexed GitHub, appandflow 101 ★MITUpdated today

    git clone https://github.com/appandflow/stim.git
  15. A curated list of strategies, tools, papers, and resources for reducing LLM token costs and improving efficiency in production.

    Indexed GitHub, pleasedodisturb 123 ★Custom licence (see repository)Updated yesterday

    git clone https://github.com/pleasedodisturb/awesome-llm-token-optimization.git
  16. CacheBoost

    MCP servers

    Warm CDN and reverse-proxy caches: manage sites, run warms, read cache-hit stats.

    Stale Official MCP Registry, com.cache-boost Updated 2 months ago 1 note

  17. token-optimizer-mcp

    MCP servers

    91.5% fewer tokens on tool output on Headroom's own benchmark, where Headroom removes 61.4%. Separately, the same SWE-bench tasks resolved at 0.71x the cost of plain Claude Code. Plus memory across sessions and subscription quota pacing. Claude Code, Codex, Copilot, Gemini and 12 more. Local, MIT.

    Indexed GitHub, ooples 583 ★MITUpdated today

    git clone https://github.com/ooples/token-optimizer-mcp.git
  18. R-KV

    AI repositories

    [Neurips 2025] R-KV: Redundancy-aware KV Cache Compression for Reasoning Models

    Stale GitHub, Zefan-Cai 1,217 ★Updated 29 days ago

    git clone https://github.com/Zefan-Cai/R-KV.git
  19. cache

    MCP servers

    Cache headers, CDN, LRU simulation for AI agents

    Stale Official MCP Registry, io.github.rog0x Updated 7 months ago 1 note

    @rog0x/mcp-cache-tools@1.0.2
  20. Fresh cache hint

    MCP servers

    Fresh cache hint

    Stale Official MCP Registry, io.github.sadri-dridi Updated 2 months ago 1 note

  21. soul

    Agents & frameworks

    Soul: The Persistent Memory Layer for Multi-Agent Systems. High-performance session orchestration with SQLite-based KV-Cache for MCP. Give your AI agents a soul that never forgets.

    Stale GitHub, choihyunsus 68 ★Custom licence (see repository)Updated 8 days ago

    git clone https://github.com/choihyunsus/soul.git
  22. automatic speech recognition model by nvidia · nemo

    Stale Hugging Face Hub, nvidia 639 ♥otherUpdated 3 months ago

    nvidia/nemotron-speech-streaming-en-0.6b
  23. cache-proxy

    MCP servers

    LLM caching proxy (x402 USDC on Base) - exact + semantic cache. Free health.

    Stale Official MCP Registry, io.github.Ainode-tech Updated 6 months ago 1 note

  24. Cache-bust forensics + TTL-fit verdicts: names the field that busts your prompt cache.

    Stale Official MCP Registry, com.textforagents Updated 25 days ago 1 note

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.