InnerVault

Library

85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

29 results with any of your words Clear search and filters
  1. xtuner

    AI repositories

    A Next-Generation Training Engine Built for Ultra-Large MoE Models

    Stale GitHub, InternLM 5,221 ★Apache-2.0Updated 5 days ago

    git clone https://github.com/InternLM/xtuner.git
  2. ms-swift

    AI repositories

    Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).

    Indexed GitHub, modelscope 16.1k ★Apache-2.0Updated 4 days ago

    git clone https://github.com/modelscope/ms-swift.git
  3. vllm

    AI repositories

    A high-throughput and memory-efficient inference and serving engine for LLMs

    Indexed GitHub, vllm-project 97.0k ★Apache-2.0Updated yesterday

    git clone https://github.com/vllm-project/vllm.git
  4. Implementing LLM architectures from scratch in PyTorch

    Stale GitHub, YeonwooSung 856 ★BSD-3-ClauseUpdated 6 days ago

    git clone https://github.com/YeonwooSung/llm-architecture-from-scratch.git
  5. pegainfer

    AI repositories

    Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

    Stale GitHub, pegainfer-project 729 ★Apache-2.0Updated 19 days ago

    git clone https://github.com/pegainfer-project/pegainfer.git
  6. janas

    AI repositories

    37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.

    Indexed GitHub, prabanta-dev 717 ★GPL-3.0Updated yesterday

    git clone https://github.com/prabanta-dev/janas.git
  7. slotstream

    AI repositories

    Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.

    Indexed GitHub, carloslfu 673 ★MITUpdated yesterday

    git clone https://github.com/carloslfu/slotstream.git
  8. LlamaFactory

    AI repositories

    Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

    Indexed GitHub, hiyouga 76.1k ★Apache-2.0Updated yesterday

    git clone https://github.com/hiyouga/LlamaFactory.git
  9. GLM-4.5

    AI repositories

    GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models

    Stale GitHub, zai-org 4,425 ★Apache-2.0Updated 9 months ago

    git clone https://github.com/zai-org/GLM-4.5.git
  10. sglang

    AI repositories

    SGLang is a high-performance serving framework for large language models and multimodal models.

    Indexed GitHub, sgl-project 38.9k ★Apache-2.0Updated yesterday

    git clone https://github.com/sgl-project/sglang.git
  11. project-maya

    AI repositories

    Project Maya - run GLM-5.3-Flash (321B MoE), DeepSeek-V4.1-Flash-1017 (748B MoE) and MiniMax-M3.1-Flash (428B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools.

    Stale GitHub, mw00 2,482 ★MITUpdated 13 days ago

    git clone https://github.com/mw00/project-maya.git
  12. WhisperJAV

    AI repositories

    ASR/STT subtitle generator. Uses Qwen3-ASR, local LLM, Whisper, TEN-VAD. Noise-robust for JAV

    Stale GitHub, meizhong986 2,394 ★MITUpdated 18 days ago

    git clone https://github.com/meizhong986/WhisperJAV.git
  13. BigMoeOnEdge

    AI repositories

    Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.

    Indexed GitHub, Helldez 924 ★Apache-2.0Updated yesterday

    git clone https://github.com/Helldez/BigMoeOnEdge.git
  14. SwiftLM

    AI repositories

    ⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.

    Indexed GitHub, SharpAI 799 ★MITUpdated yesterday

    git clone https://github.com/SharpAI/SwiftLM.git
  15. LLM-TPU

    AI repositories

    Run generative AI models in sophgo BM1684X/BM1688

    Stale GitHub, sophgo 321 ★Custom licence (see repository)Updated 8 days ago

    git clone https://github.com/sophgo/LLM-TPU.git
  16. MaxKB

    AI repositories

    🔥 MaxKB is an open-source platform for building enterprise-grade agents. 强大易用的开源企业级智能体平台。

    Indexed GitHub, 1Panel-dev 23.2k ★GPL-3.0Updated 3 days ago

    git clone https://github.com/1Panel-dev/MaxKB.git
  17. diy-llm

    AI repositories

    Covers pre-training data, Tokenizer, Transformer, MoE,distributed training, Scaling Laws, inference & alignment .6 progressive code assignments for full-stack LLM learning | 涵盖预训练数据、分词器、Transformer、MoE、分布式训练、缩放定律、推理与对齐,6 项渐进代码作业,掌握 LLM 全栈知识

    Stale GitHub, datawhalechina 2,648 ★Updated 15 days ago

    git clone https://github.com/datawhalechina/diy-llm.git
  18. Automodel

    AI repositories

    🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

    Indexed GitHub, NVIDIA-NeMo 1,082 ★Apache-2.0Updated 2 days ago

    git clone https://github.com/NVIDIA-NeMo/Automodel.git
  19. LLaVA-OneVision-2

    AI repositories

    Fully Open Framework for Democratized Multimodal Training

    Stale GitHub, EvolvingLMMs-Lab 1,232 ★Apache-2.0Updated 8 days ago

    git clone https://github.com/EvolvingLMMs-Lab/LLaVA-OneVision-2.git
  20. uccl

    AI repositories

    UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)

    Indexed GitHub, uccl-project 1,585 ★Apache-2.0Updated 2 days ago

    git clone https://github.com/uccl-project/uccl.git
  21. deep-searcher

    AI repositories

    Open Source Deep Research Alternative to Reason and Search on Private Data. Written in Python.

    Stale GitHub, zilliztech 8,330 ★Apache-2.0Updated 56 days ago

    git clone https://github.com/zilliztech/deep-searcher.git
  22. GenieX

    AI repositories

    Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code

    Stale GitHub, qualcomm 8,494 ★BSD-3-ClauseUpdated 12 days ago

    git clone https://github.com/qualcomm/GenieX.git
  23. kimi-k3-in-c

    AI repositories

    A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.

    Stale GitHub, FareedKhan-dev 9,049 ★Apache-2.0Updated 46 days ago

    git clone https://github.com/FareedKhan-dev/kimi-k3-in-c.git
  24. halogen-flash-server

    AI repositories

    Local inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models, over the OpenAI and Anthropic APIs on one port.

    Stale GitHub, peonist-ai 1,258 ★Custom licence (see repository)Updated 9 days ago

    git clone https://github.com/peonist-ai/halogen-flash-server.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.