Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
AngelSlim
AI repositoriesModel compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.
git clone https://github.com/Tencent/AngelSlim.git -
nncf
AI repositoriesNeural Network Compression Framework for enhanced OpenVINO™ inference
git clone https://github.com/openvinotoolkit/nncf.git -
picollm
AI repositoriesOn-device LLM Inference Powered by X-Bit Quantization
git clone https://github.com/Picovoice/picollm.git -
SimpleMem
AI repositories[ICML'26] SimpleMem: Efficient Lifelong Memory for LLM Agents — Text & Multimodal
git clone https://github.com/aiming-lab/SimpleMem.git -
PaddleNLP
AI repositoriesEasy-to-use and powerful LLM and SLM library with awesome model zoo.
git clone https://github.com/PaddlePaddle/PaddleNLP.git -
intro_dgm
AI repositories"Deep Generative Modeling": Introductory Examples
git clone https://github.com/jmtomczak/intro_dgm.git -
lmdeploy
AI repositoriesLMDeploy is a toolkit for compressing, deploying, and serving LLMs.
git clone https://github.com/InternLM/lmdeploy.git -
R-KV
AI repositories[Neurips 2025] R-KV: Redundancy-aware KV Cache Compression for Reasoning Models
git clone https://github.com/Zefan-Cai/R-KV.git -
SwiftLM
AI repositories⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.
git clone https://github.com/SharpAI/SwiftLM.git -
intel-extension-for-transformers
AI repositories⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡
git clone https://github.com/intel/intel-extension-for-transformers.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.