InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. LMCache

    AI repositories

    LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

    Indexed GitHub, LMCache 12.4k ★Apache-2.0Updated 2 days ago

    git clone https://github.com/LMCache/LMCache.git
  2. morphik-core

    AI repositories

    Open-source multimodal retrieval engine (Morphik Core)

    Stale GitHub, morphik-org 3,719 ★Custom licence (see repository)Updated 21 days ago

    git clone https://github.com/morphik-org/morphik-core.git
  3. CAG

    AI repositories

    Cache-Augmented Generation: A Simple, Efficient Alternative to RAG

    Stale GitHub, hhhuang 1,605 ★MITUpdated 17 months ago

    git clone https://github.com/hhhuang/CAG.git
  4. curvine

    AI repositories

    AI-native, cloud-native file system in Rust. Full POSIX on object storage with a multi-tier distributed cache, for AI training, inference, and agents. CNCF Sandbox project.

    Indexed GitHub, CurvineIO 1,068 ★Apache-2.0Updated yesterday

    git clone https://github.com/CurvineIO/curvine.git
  5. ai-infra-book

    AI repositories

    《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验

    Stale GitHub, bojieli 6,489 ★Apache-2.0Updated 46 days ago

    git clone https://github.com/bojieli/ai-infra-book.git
  6. omlx

    AI repositories

    LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

    Indexed GitHub, jundot 23.7k ★Apache-2.0Updated today

    git clone https://github.com/jundot/omlx.git
  7. R-KV

    AI repositories

    [Neurips 2025] R-KV: Redundancy-aware KV Cache Compression for Reasoning Models

    Stale GitHub, Zefan-Cai 1,217 ★Updated 29 days ago

    git clone https://github.com/Zefan-Cai/R-KV.git
  8. pegainfer

    AI repositories

    Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

    Stale GitHub, pegainfer-project 729 ★Apache-2.0Updated 18 days ago

    git clone https://github.com/pegainfer-project/pegainfer.git
  9. GPTCache

    AI repositories

    Semantic cache for LLMs. Fully integrated with LangChain and llama_index.

    Stale GitHub, zilliztech 8,211 ★MITUpdated 55 days ago

    git clone https://github.com/zilliztech/GPTCache.git
  10. ai-agent-platform

    AI repositories

    企业级 AI Agent 平台 | Spring Boot 3 + LangChain4j | ReAct 推理 + 多路召回 RAG + 语义缓存 + 多智能体协作

    Stale GitHub, 888newstep 121 ★Custom licence (see repository)Updated 13 days ago

    git clone https://github.com/888newstep/ai-agent-platform.git
  11. smg

    AI repositories

    Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

    Indexed GitHub, smg-project 723 ★Apache-2.0Updated today

    git clone https://github.com/smg-project/smg.git
  12. 安卓AI聊天端:开箱即聊,无损导入酒馆卡,专属RP模式,高定制主题,创造模式,RAG记忆,缓存强省用量,防空回,主动信息,前端卡支持,QQbot,AI群聊,插件系统,强兼容中转站。手机移动端原生支持,求 Star 收藏⭐Android AI Chatbox: lossless SillyTavern card import, aggressive cache optimization, Jev decisions, multi-dimensional memory, anti-blank-reply, proactive messages, AI group chat, SillyTavern themes, plugin system, Native mobile.RikkaHub

    Indexed GitHub, MiaoWuNYA 208 ★AGPL-3.0Updated today

    git clone https://github.com/MiaoWuNYA/rikkahub-sillytavern-android.git
  13. Wax

    AI repositories

    Shared Single-file memory layer for all your agents, sub mili-second RAG over text, photo and video on Apple Silicon.. No Server. No API. One File. Pure Swift

    Indexed GitHub, christopherkarani 810 ★Apache-2.0Updated yesterday

    git clone https://github.com/christopherkarani/Wax.git
  14. kvcached

    AI repositories

    Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

    Stale GitHub, ovg-project 2,033 ★Apache-2.0Updated 8 days ago

    git clone https://github.com/ovg-project/kvcached.git
  15. uccl

    AI repositories

    UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)

    Indexed GitHub, uccl-project 1,585 ★Apache-2.0Updated yesterday

    git clone https://github.com/uccl-project/uccl.git
  16. gufo

    AI repositories

    The open-source AI engine for AMD Strix Halo. Text, embeddings, speech, image and video models in one binary, with OpenAI-compatible APIs, caching for coding agents and model extensions. Linux and Windows.

    Indexed GitHub, gufo-org 1,167 ★MITUpdated 2 days ago

    git clone https://github.com/gufo-org/gufo.git
  17. SwiftLM

    AI repositories

    ⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.

    Indexed GitHub, SharpAI 799 ★MITUpdated today

    git clone https://github.com/SharpAI/SwiftLM.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.