Library
85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
peft
AI repositories🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
git clone https://github.com/huggingface/peft.git -
Efficient-LLMs-Survey
AI repositories[TMLR 2024] Efficient Large Language Models: A Survey
git clone https://github.com/AIoT-MLSys-Lab/Efficient-LLMs-Survey.git -
clawcodex
AI repositoriesToken efficient Claude Code full Python rebuild. AI Coding Agent in 310K LoC Python.
git clone https://github.com/agentforce314/clawcodex.git -
CAG
AI repositoriesCache-Augmented Generation: A Simple, Efficient Alternative to RAG
git clone https://github.com/hhhuang/CAG.git -
dsh-see-now
AI repositories让 AI 实时看见你的屏幕:按变化量筛选帧、多帧拼进一张图,静止画面几乎不花 token
git clone https://github.com/SAOS-3624/dsh-see-now.git -
LlamaFactory
AI repositoriesUnified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
git clone https://github.com/hiyouga/LlamaFactory.git -
vllm
AI repositoriesA high-throughput and memory-efficient inference and serving engine for LLMs
git clone https://github.com/vllm-project/vllm.git -
EasyR1
AI repositoriesEasyR1: An Efficient, Scalable, Multi-Modality RL Training Framework based on veRL
git clone https://github.com/hiyouga/EasyR1.git -
evalscope
AI repositoriesA streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.
git clone https://github.com/modelscope/evalscope.git -
chitu
AI repositoriesHigh-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.
git clone https://github.com/thu-pacman/chitu.git -
kimi-k3-in-c
AI repositoriesA 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
git clone https://github.com/FareedKhan-dev/kimi-k3-in-c.git -
LLamaSharp
AI repositoriesA C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
git clone https://github.com/SciSharp/LLamaSharp.git -
AngelSlim
AI repositoriesModel compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.
git clone https://github.com/Tencent/AngelSlim.git -
genai-processors
AI repositoriesGenAI Processors is a lightweight Python library that enables efficient, parallel content processing.
git clone https://github.com/google-gemini/genai-processors.git -
openlake
AI repositoriesOpenLake is a high performance storage engine for efficient LLM inference and GPU Training
git clone https://github.com/openlake-project/openlake.git -
SimpleMem
AI repositories[ICML'26] SimpleMem: Efficient Lifelong Memory for LLM Agents — Text & Multimodal
git clone https://github.com/aiming-lab/SimpleMem.git -
picollm
AI repositoriesOn-device LLM Inference Powered by X-Bit Quantization
git clone https://github.com/Picovoice/picollm.git -
chonkie
AI repositories🦛 CHONK docs with Chonkie ✨ — The lightweight ingestion library for fast, efficient and robust RAG pipelines
git clone https://github.com/feyninc/chonkie.git -
datasets
AI repositories🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools
git clone https://github.com/huggingface/datasets.git -
shell_gpt
AI repositoriesA command-line productivity tool powered by AI large language models like GPT-5, will help you accomplish your tasks faster and more efficiently.
git clone https://github.com/TheR1D/shell_gpt.git -
LightMem
AI repositories[ICLR 2026] LightMem: Lightweight and Efficient Memory-Augmented Generation
git clone https://github.com/zjunlp/LightMem.git -
pruna
AI repositoriesPruna is a model optimization framework built for developers, enabling you to deliver faster, more efficient models with minimal overhead.
git clone https://github.com/PrunaAI/pruna.git -
extractous
AI repositoriesFast and efficient unstructured data extraction. Written in Rust with bindings for many languages.
git clone https://github.com/yobix-ai/extractous.git -
uccl
AI repositoriesUCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)
git clone https://github.com/uccl-project/uccl.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.