InnerVault

Library

85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.

Results

  1. AngelSlim

    AI repositories

    Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.

    Stale GitHub, Tencent 1,779 ★Custom licence (see repository)Updated 16 days ago

    git clone https://github.com/Tencent/AngelSlim.git
  2. nncf

    AI repositories

    Neural Network Compression Framework for enhanced OpenVINO™ inference

    Stale GitHub, openvinotoolkit 1,217 ★Apache-2.0Updated 12 days ago

    git clone https://github.com/openvinotoolkit/nncf.git
  3. picollm

    AI repositories

    On-device LLM Inference Powered by X-Bit Quantization

    Indexed GitHub, Picovoice 320 ★Apache-2.0Updated 4 days ago

    git clone https://github.com/Picovoice/picollm.git
  4. SimpleMem

    AI repositories

    [ICML'26] SimpleMem: Efficient Lifelong Memory for LLM Agents — Text & Multimodal

    Stale GitHub, aiming-lab 3,832 ★MITUpdated 3 months ago

    git clone https://github.com/aiming-lab/SimpleMem.git
  5. PaddleNLP

    AI repositories

    Easy-to-use and powerful LLM and SLM library with awesome model zoo.

    Stale GitHub, PaddlePaddle 13.0k ★Apache-2.0Updated 5 months ago

    git clone https://github.com/PaddlePaddle/PaddleNLP.git
  6. intro_dgm

    AI repositories

    "Deep Generative Modeling": Introductory Examples

    Stale GitHub, jmtomczak 1,344 ★MITUpdated 6 months ago

    git clone https://github.com/jmtomczak/intro_dgm.git
  7. lmdeploy

    AI repositories

    LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

    Stale GitHub, InternLM 8,136 ★Apache-2.0Updated 6 days ago

    git clone https://github.com/InternLM/lmdeploy.git
  8. R-KV

    AI repositories

    [Neurips 2025] R-KV: Redundancy-aware KV Cache Compression for Reasoning Models

    Stale GitHub, Zefan-Cai 1,217 ★Updated 29 days ago

    git clone https://github.com/Zefan-Cai/R-KV.git
  9. SwiftLM

    AI repositories

    ⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.

    Indexed GitHub, SharpAI 799 ★MITUpdated today

    git clone https://github.com/SharpAI/SwiftLM.git
  10. ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

    Stale Archived GitHub, intel 2,169 ★Apache-2.0Updated 2 years ago 1 note

    git clone https://github.com/intel/intel-extension-for-transformers.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.