InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. bitsandbytes

    AI repositories

    Accessible large language models via k-bit quantization for PyTorch.

    Stale GitHub, bitsandbytes-foundation 8,527 ★MITUpdated 2 months ago

    git clone https://github.com/bitsandbytes-foundation/bitsandbytes.git
  2. LlamaFactory

    AI repositories

    Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

    Indexed GitHub, hiyouga 76.1k ★Apache-2.0Updated today

    git clone https://github.com/hiyouga/LlamaFactory.git
  3. nncf

    AI repositories

    Neural Network Compression Framework for enhanced OpenVINO™ inference

    Stale GitHub, openvinotoolkit 1,217 ★Apache-2.0Updated 12 days ago

    git clone https://github.com/openvinotoolkit/nncf.git
  4. Chinese-LLaMA-Alpaca

    AI repositories

    中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

    Stale GitHub, ymcui 18.9k ★Apache-2.0Updated 7 months ago

    git clone https://github.com/ymcui/Chinese-LLaMA-Alpaca.git
  5. turbovec

    AI repositories

    A vector index built on TurboQuant, written in Rust with Python bindings

    Stale GitHub, RyanCodrai 17.4k ★MITUpdated 40 days ago

    git clone https://github.com/RyanCodrai/turbovec.git
  6. rag-time

    AI repositories

    RAG Time: A 5-week Learning Journey to Mastering RAG

    Stale GitHub, microsoft 911 ★MITUpdated 17 months ago

    git clone https://github.com/microsoft/rag-time.git
  7. AngelSlim

    AI repositories

    Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.

    Stale GitHub, Tencent 1,779 ★Custom licence (see repository)Updated 16 days ago

    git clone https://github.com/Tencent/AngelSlim.git
  8. engine

    AI repositories

    2bit quants, kernels and runtime for consumer devices.

    Stale GitHub, cactus-compute 6,181 ★Custom licence (see repository)Updated 11 days ago

    git clone https://github.com/cactus-compute/engine.git
  9. picollm

    AI repositories

    On-device LLM Inference Powered by X-Bit Quantization

    Indexed GitHub, Picovoice 320 ★Apache-2.0Updated 4 days ago

    git clone https://github.com/Picovoice/picollm.git
  10. Your Cheat Sheet for AI Engineering Interview – Questions and Answers.

    Indexed GitHub, amitshekhariitbhu 3,659 ★Apache-2.0Updated today

    git clone https://github.com/amitshekhariitbhu/ai-engineering-interview-questions.git
  11. kimi-k3-in-c

    AI repositories

    A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.

    Stale GitHub, FareedKhan-dev 9,049 ★Apache-2.0Updated 45 days ago

    git clone https://github.com/FareedKhan-dev/kimi-k3-in-c.git
  12. xTuring

    AI repositories

    Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

    Stale GitHub, stochasticai 2,679 ★Apache-2.0Updated 11 days ago

    git clone https://github.com/stochasticai/xTuring.git
  13. project-maya

    AI repositories

    Project Maya - run GLM-5.3-Flash (321B MoE), DeepSeek-V4.1-Flash-1017 (748B MoE) and MiniMax-M3.1-Flash (428B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools.

    Stale GitHub, mw00 2,482 ★MITUpdated 12 days ago

    git clone https://github.com/mw00/project-maya.git
  14. janas

    AI repositories

    37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.

    Indexed GitHub, prabanta-dev 717 ★GPL-3.0Updated today

    git clone https://github.com/prabanta-dev/janas.git
  15. ARIS-in-AI-Offer

    AI repositories

    Bilingual (中文+EN) ML / LLM / diffusion / agent interview cheat sheets for AI 秋招 — generated by ARIS /interview-cheatsheet, rendered by /render-html into single-file HTML, reads anywhere — plus a CV→DBLP-fact-checked academic homepage generator and hand-authored long-form blogs 🌱

    Stale GitHub, wanshuiyin 640 ★MITUpdated 10 days ago

    git clone https://github.com/wanshuiyin/ARIS-in-AI-Offer.git
  16. BigMoeOnEdge

    AI repositories

    Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.

    Indexed GitHub, Helldez 924 ★Apache-2.0Updated today

    git clone https://github.com/Helldez/BigMoeOnEdge.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.