InnerVault

Library

85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. peft

    AI repositories

    🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

    Indexed GitHub, huggingface 21.9k ★Apache-2.0Updated 2 days ago

    git clone https://github.com/huggingface/peft.git
  2. Efficient-LLMs-Survey

    AI repositories

    [TMLR 2024] Efficient Large Language Models: A Survey

    Stale GitHub, AIoT-MLSys-Lab 1,259 ★Updated 18 days ago

    git clone https://github.com/AIoT-MLSys-Lab/Efficient-LLMs-Survey.git
  3. clawcodex

    AI repositories

    Token efficient Claude Code full Python rebuild. AI Coding Agent in 310K LoC Python.

    Stale GitHub, agentforce314 924 ★MITUpdated 16 days ago

    git clone https://github.com/agentforce314/clawcodex.git
  4. CAG

    AI repositories

    Cache-Augmented Generation: A Simple, Efficient Alternative to RAG

    Stale GitHub, hhhuang 1,605 ★MITUpdated 18 months ago

    git clone https://github.com/hhhuang/CAG.git
  5. dsh-see-now

    AI repositories

    让 AI 实时看见你的屏幕:按变化量筛选帧、多帧拼进一张图,静止画面几乎不花 token

    Stale GitHub, SAOS-3624 534 ★Apache-2.0Updated 7 days ago

    git clone https://github.com/SAOS-3624/dsh-see-now.git
  6. LlamaFactory

    AI repositories

    Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

    Indexed GitHub, hiyouga 76.1k ★Apache-2.0Updated yesterday

    git clone https://github.com/hiyouga/LlamaFactory.git
  7. vllm

    AI repositories

    A high-throughput and memory-efficient inference and serving engine for LLMs

    Indexed GitHub, vllm-project 97.0k ★Apache-2.0Updated yesterday

    git clone https://github.com/vllm-project/vllm.git
  8. EasyR1

    AI repositories

    EasyR1: An Efficient, Scalable, Multi-Modality RL Training Framework based on veRL

    Stale GitHub, hiyouga 5,190 ★Apache-2.0Updated 59 days ago

    git clone https://github.com/hiyouga/EasyR1.git
  9. evalscope

    AI repositories

    A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.

    Indexed GitHub, modelscope 3,697 ★Apache-2.0Updated yesterday

    git clone https://github.com/modelscope/evalscope.git
  10. chitu

    AI repositories

    High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.

    Stale GitHub, thu-pacman 2,998 ★Apache-2.0Updated 12 days ago

    git clone https://github.com/thu-pacman/chitu.git
  11. kimi-k3-in-c

    AI repositories

    A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.

    Stale GitHub, FareedKhan-dev 9,049 ★Apache-2.0Updated 46 days ago

    git clone https://github.com/FareedKhan-dev/kimi-k3-in-c.git
  12. LLamaSharp

    AI repositories

    A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

    Stale GitHub, SciSharp 3,810 ★MITUpdated 31 days ago

    git clone https://github.com/SciSharp/LLamaSharp.git
  13. AngelSlim

    AI repositories

    Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.

    Stale GitHub, Tencent 1,779 ★Custom licence (see repository)Updated 17 days ago

    git clone https://github.com/Tencent/AngelSlim.git
  14. genai-processors

    AI repositories

    GenAI Processors is a lightweight Python library that enables efficient, parallel content processing.

    Indexed GitHub, google-gemini 2,121 ★Apache-2.0Updated 7 days ago

    git clone https://github.com/google-gemini/genai-processors.git
  15. openlake

    AI repositories

    OpenLake is a high performance storage engine for efficient LLM inference and GPU Training

    Stale GitHub, openlake-project 2,851 ★Apache-2.0Updated 8 days ago

    git clone https://github.com/openlake-project/openlake.git
  16. SimpleMem

    AI repositories

    [ICML'26] SimpleMem: Efficient Lifelong Memory for LLM Agents — Text & Multimodal

    Stale GitHub, aiming-lab 3,832 ★MITUpdated 3 months ago

    git clone https://github.com/aiming-lab/SimpleMem.git
  17. picollm

    AI repositories

    On-device LLM Inference Powered by X-Bit Quantization

    Indexed GitHub, Picovoice 320 ★Apache-2.0Updated 5 days ago

    git clone https://github.com/Picovoice/picollm.git
  18. chonkie

    AI repositories

    🦛 CHONK docs with Chonkie ✨ — The lightweight ingestion library for fast, efficient and robust RAG pipelines

    Indexed GitHub, feyninc 4,833 ★MITUpdated 4 days ago

    git clone https://github.com/feyninc/chonkie.git
  19. datasets

    AI repositories

    🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

    Stale GitHub, huggingface 22.1k ★Apache-2.0Updated 35 days ago

    git clone https://github.com/huggingface/datasets.git
  20. shell_gpt

    AI repositories

    A command-line productivity tool powered by AI large language models like GPT-5, will help you accomplish your tasks faster and more efficiently.

    Stale GitHub, TheR1D 12.3k ★MITUpdated 4 months ago

    git clone https://github.com/TheR1D/shell_gpt.git
  21. LightMem

    AI repositories

    [ICLR 2026] LightMem: Lightweight and Efficient Memory-Augmented Generation

    Stale GitHub, zjunlp 1,211 ★MITUpdated 11 days ago

    git clone https://github.com/zjunlp/LightMem.git
  22. pruna

    AI repositories

    Pruna is a model optimization framework built for developers, enabling you to deliver faster, more efficient models with minimal overhead.

    Stale GitHub, PrunaAI 1,365 ★Apache-2.0Updated 9 days ago

    git clone https://github.com/PrunaAI/pruna.git
  23. extractous

    AI repositories

    Fast and efficient unstructured data extraction. Written in Rust with bindings for many languages.

    Stale GitHub, yobix-ai 1,782 ★Apache-2.0Updated 23 months ago

    git clone https://github.com/yobix-ai/extractous.git
  24. uccl

    AI repositories

    UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)

    Indexed GitHub, uccl-project 1,585 ★Apache-2.0Updated 2 days ago

    git clone https://github.com/uccl-project/uccl.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.