Library
85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
xtuner
AI repositoriesA Next-Generation Training Engine Built for Ultra-Large MoE Models
git clone https://github.com/InternLM/xtuner.git -
Automodel
AI repositories🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support
git clone https://github.com/NVIDIA-NeMo/Automodel.git -
halogen-flash-server
AI repositoriesLocal inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models, over the OpenAI and Anthropic APIs on one port.
git clone https://github.com/peonist-ai/halogen-flash-server.git -
janas
AI repositories37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.
git clone https://github.com/prabanta-dev/janas.git -
slotstream
AI repositoriesRun a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.
git clone https://github.com/carloslfu/slotstream.git -
PolyStrata
AI repositoriesRun large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and MiniCPM-V on a second engine written for PolyStrata. One-click install for Windows and Linux, OpenAI/Anthropic API on localhost.
git clone https://github.com/VecSzn/PolyStrata.git -
ms-swift
AI repositoriesUse PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).
git clone https://github.com/modelscope/ms-swift.git -
WhisperJAV
AI repositoriesASR/STT subtitle generator. Uses Qwen3-ASR, local LLM, Whisper, TEN-VAD. Noise-robust for JAV
git clone https://github.com/meizhong986/WhisperJAV.git -
vllm
AI repositoriesA high-throughput and memory-efficient inference and serving engine for LLMs
git clone https://github.com/vllm-project/vllm.git -
LLM-TPU
AI repositoriesRun generative AI models in sophgo BM1684X/BM1688
git clone https://github.com/sophgo/LLM-TPU.git -
MaxKB
AI repositories🔥 MaxKB is an open-source platform for building enterprise-grade agents. 强大易用的开源企业级智能体平台。
git clone https://github.com/1Panel-dev/MaxKB.git -
QOwnNotes
AI repositoriesQOwnNotes is a plain-text file notepad and todo-list manager with Markdown support and Nextcloud / ownCloud integration.
git clone https://github.com/pbek/QOwnNotes.git -
ai
AI repositoriesThe AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered applications and agents
git clone https://github.com/vercel/ai.git -
mastra
AI repositoriesMastra is the modern TypeScript framework for AI-powered applications and agents.
git clone https://github.com/mastra-ai/mastra.git -
fragments
AI repositoriesOpen-source Next.js template for building apps that are fully generated by AI. By E2B.
git clone https://github.com/e2b-dev/fragments.git -
LLaVA-OneVision-2
AI repositoriesFully Open Framework for Democratized Multimodal Training
git clone https://github.com/EvolvingLMMs-Lab/LLaVA-OneVision-2.git -
ui
AI repositoriesComposable, accessible components with thoughtful defaults. Build your own component library with code you can customize, extend, and make your own.
git clone https://github.com/shadcn-ui/ui.git -
deep-searcher
AI repositoriesOpen Source Deep Research Alternative to Reason and Search on Private Data. Written in Python.
git clone https://github.com/zilliztech/deep-searcher.git -
morphic
AI repositoriesAn AI-powered search engine with a generative UI
git clone https://github.com/miurla/morphic.git -
onyx
AI repositoriesOpen Source AI Platform - AI Chat with advanced features that works with every LLM
git clone https://github.com/onyx-dot-app/onyx.git -
llm-architecture-from-scratch
AI repositoriesImplementing LLM architectures from scratch in PyTorch
git clone https://github.com/YeonwooSung/llm-architecture-from-scratch.git -
GenieX
AI repositoriesRun frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code
git clone https://github.com/qualcomm/GenieX.git -
LLM4AD_Next
AI repositoriesA next-generation automatic algorithm design platform, making automated algorithm design more accessible and easier to use
git clone https://github.com/Optima-CityU/LLM4AD_Next.git -
pegainfer
AI repositoriesPure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
git clone https://github.com/pegainfer-project/pegainfer.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.