Library
85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
LlamaFactory
AI repositoriesUnified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
git clone https://github.com/hiyouga/LlamaFactory.git -
vllm
AI repositoriesA high-throughput and memory-efficient inference and serving engine for LLMs
git clone https://github.com/vllm-project/vllm.git -
sglang
AI repositoriesSGLang is a high-performance serving framework for large language models and multimodal models.
git clone https://github.com/sgl-project/sglang.git -
BigMoeOnEdge
AI repositoriesRun MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.
git clone https://github.com/Helldez/BigMoeOnEdge.git -
inferssd
AI repositoriesRun models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.
git clone https://github.com/wici-ai/inferssd.git -
janas
AI repositories37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.
git clone https://github.com/prabanta-dev/janas.git -
Chinese-LLaMA-Alpaca
AI repositories中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
git clone https://github.com/ymcui/Chinese-LLaMA-Alpaca.git -
llama_index
AI repositoriesLlamaIndex is the document processing platform for AI
git clone https://github.com/run-llama/llama_index.git -
Llama-Chinese
AI repositoriesLlama中文社区,实时汇总最新Llama学习资料,构建最好的中文Llama大模型开源生态,完全开源可商用
git clone https://github.com/LlamaChinese/Llama-Chinese.git -
llama-gpt
AI repositoriesA self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
git clone https://github.com/getumbrel/llama-gpt.git -
llama-cookbook
AI repositoriesWelcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services
git clone https://github.com/meta-llama/llama-cookbook.git -
xtuner
AI repositoriesA Next-Generation Training Engine Built for Ultra-Large MoE Models
git clone https://github.com/InternLM/xtuner.git -
Chinese-LLaMA-Alpaca-2
AI repositories中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)
git clone https://github.com/ymcui/Chinese-LLaMA-Alpaca-2.git -
dalai
AI repositoriesThe simplest way to run LLaMA on your local machine
git clone https://github.com/cocktailpeanut/dalai.git -
llama-swap
AI repositoriesReliable model swapping for any local AI server. Chosen by thousands of users. Batteries included. If we don't have it, you probably don't need it.
git clone https://github.com/mostlygeek/llama-swap.git -
llama.rn
AI repositoriesReact Native binding of llama.cpp
git clone https://github.com/mybigday/llama.rn.git -
GPTCache
AI repositoriesSemantic cache for LLMs. Fully integrated with LangChain and llama_index.
git clone https://github.com/zilliztech/GPTCache.git -
GLM-4.5
AI repositoriesGLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models
git clone https://github.com/zai-org/GLM-4.5.git -
Huatuo-Llama-Med-Chinese
AI repositoriesRepo for BenCao [original name: HuaTuo (华驼)], Instruction-tuning Large Language Models with Chinese Medical Knowledge. 本草(原名:华驼)模型仓库,基于中文医学知识的大语言模型指令微调
git clone https://github.com/SCIR-HI/Huatuo-Llama-Med-Chinese.git -
llama.vscode
AI repositoriesVS Code extension for LLM-assisted code/text completion
git clone https://github.com/ggml-org/llama.vscode.git -
project-maya
AI repositoriesProject Maya - run GLM-5.3-Flash (321B MoE), DeepSeek-V4.1-Flash-1017 (748B MoE) and MiniMax-M3.1-Flash (428B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools.
git clone https://github.com/mw00/project-maya.git -
Awesome-Chinese-LLM
AI repositories整理开源的中文大语言模型,以规模较小、可私有化部署、训练成本较低的模型为主,包括底座模型,垂直领域微调及应用,数据集与教程等。
git clone https://github.com/AiHubCN/Awesome-Chinese-LLM.git -
Langchain-Chatchat
AI repositoriesLangchain-Chatchat(原Langchain-ChatGLM)基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Llama) RAG and Agent app with langchain
git clone https://github.com/chatchat-space/Langchain-Chatchat.git -
LLamaSharp
AI repositoriesA C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
git clone https://github.com/SciSharp/LLamaSharp.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.