InnerVault

Library

85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

114 results with any of your words Clear search and filters
  1. LlamaFactory

    AI repositories

    Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

    Indexed GitHub, hiyouga 76.1k ★Apache-2.0Updated yesterday

    git clone https://github.com/hiyouga/LlamaFactory.git
  2. vllm

    AI repositories

    A high-throughput and memory-efficient inference and serving engine for LLMs

    Indexed GitHub, vllm-project 97.0k ★Apache-2.0Updated yesterday

    git clone https://github.com/vllm-project/vllm.git
  3. sglang

    AI repositories

    SGLang is a high-performance serving framework for large language models and multimodal models.

    Indexed GitHub, sgl-project 38.9k ★Apache-2.0Updated yesterday

    git clone https://github.com/sgl-project/sglang.git
  4. BigMoeOnEdge

    AI repositories

    Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.

    Indexed GitHub, Helldez 924 ★Apache-2.0Updated yesterday

    git clone https://github.com/Helldez/BigMoeOnEdge.git
  5. inferssd

    AI repositories

    Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.

    Indexed GitHub, wici-ai 1,025 ★Apache-2.0Updated 4 days ago

    git clone https://github.com/wici-ai/inferssd.git
  6. janas

    AI repositories

    37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.

    Indexed GitHub, prabanta-dev 717 ★GPL-3.0Updated yesterday

    git clone https://github.com/prabanta-dev/janas.git
  7. Chinese-LLaMA-Alpaca

    AI repositories

    中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

    Stale GitHub, ymcui 18.9k ★Apache-2.0Updated 7 months ago

    git clone https://github.com/ymcui/Chinese-LLaMA-Alpaca.git
  8. llama_index

    AI repositories

    LlamaIndex is the document processing platform for AI

    Indexed GitHub, run-llama 52.9k ★MITUpdated 3 days ago

    git clone https://github.com/run-llama/llama_index.git
  9. Llama-Chinese

    AI repositories

    Llama中文社区,实时汇总最新Llama学习资料,构建最好的中文Llama大模型开源生态,完全开源可商用

    Stale GitHub, LlamaChinese 14.8k ★Updated 19 months ago

    git clone https://github.com/LlamaChinese/Llama-Chinese.git
  10. llama-gpt

    AI repositories

    A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

    Stale GitHub, getumbrel 10.9k ★MITUpdated 2 years ago

    git clone https://github.com/getumbrel/llama-gpt.git
  11. llama-cookbook

    AI repositories

    Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services

    Stale GitHub, meta-llama 18.6k ★MITUpdated 6 months ago

    git clone https://github.com/meta-llama/llama-cookbook.git
  12. xtuner

    AI repositories

    A Next-Generation Training Engine Built for Ultra-Large MoE Models

    Stale GitHub, InternLM 5,221 ★Apache-2.0Updated 5 days ago

    git clone https://github.com/InternLM/xtuner.git
  13. Chinese-LLaMA-Alpaca-2

    AI repositories

    中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)

    Stale GitHub, ymcui 7,104 ★Apache-2.0Updated 7 months ago

    git clone https://github.com/ymcui/Chinese-LLaMA-Alpaca-2.git
  14. dalai

    AI repositories

    The simplest way to run LLaMA on your local machine

    Stale GitHub, cocktailpeanut 12.9k ★Updated 2 years ago

    git clone https://github.com/cocktailpeanut/dalai.git
  15. llama-swap

    AI repositories

    Reliable model swapping for any local AI server. Chosen by thousands of users. Batteries included. If we don't have it, you probably don't need it.

    Indexed GitHub, mostlygeek 6,247 ★MITUpdated 3 days ago

    git clone https://github.com/mostlygeek/llama-swap.git
  16. llama.rn

    AI repositories

    React Native binding of llama.cpp

    Stale GitHub, mybigday 1,073 ★MITUpdated 5 days ago

    git clone https://github.com/mybigday/llama.rn.git
  17. GPTCache

    AI repositories

    Semantic cache for LLMs. Fully integrated with LangChain and llama_index.

    Stale GitHub, zilliztech 8,211 ★MITUpdated 56 days ago

    git clone https://github.com/zilliztech/GPTCache.git
  18. GLM-4.5

    AI repositories

    GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models

    Stale GitHub, zai-org 4,425 ★Apache-2.0Updated 9 months ago

    git clone https://github.com/zai-org/GLM-4.5.git
  19. Huatuo-Llama-Med-Chinese

    AI repositories

    Repo for BenCao [original name: HuaTuo (华驼)], Instruction-tuning Large Language Models with Chinese Medical Knowledge. 本草(原名:华驼)模型仓库,基于中文医学知识的大语言模型指令微调

    Stale GitHub, SCIR-HI 4,999 ★Apache-2.0Updated 4 months ago

    git clone https://github.com/SCIR-HI/Huatuo-Llama-Med-Chinese.git
  20. llama.vscode

    AI repositories

    VS Code extension for LLM-assisted code/text completion

    Stale GitHub, ggml-org 1,547 ★MITUpdated 26 days ago

    git clone https://github.com/ggml-org/llama.vscode.git
  21. project-maya

    AI repositories

    Project Maya - run GLM-5.3-Flash (321B MoE), DeepSeek-V4.1-Flash-1017 (748B MoE) and MiniMax-M3.1-Flash (428B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools.

    Stale GitHub, mw00 2,482 ★MITUpdated 13 days ago

    git clone https://github.com/mw00/project-maya.git
  22. Awesome-Chinese-LLM

    AI repositories

    整理开源的中文大语言模型,以规模较小、可私有化部署、训练成本较低的模型为主,包括底座模型,垂直领域微调及应用,数据集与教程等。

    Stale GitHub, AiHubCN 22.8k ★Updated 6 months ago

    git clone https://github.com/AiHubCN/Awesome-Chinese-LLM.git
  23. Langchain-Chatchat

    AI repositories

    Langchain-Chatchat(原Langchain-ChatGLM)基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Llama) RAG and Agent app with langchain

    Stale GitHub, chatchat-space 38.7k ★Apache-2.0Updated 12 months ago

    git clone https://github.com/chatchat-space/Langchain-Chatchat.git
  24. LLamaSharp

    AI repositories

    A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

    Stale GitHub, SciSharp 3,810 ★MITUpdated 31 days ago

    git clone https://github.com/SciSharp/LLamaSharp.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.