Library
85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
PS5LM
AI repositoriesllama.cpp on a jailbroken PS5: run any GGUF model natively on the console, starting with Qwen 3.8
git clone https://github.com/cobanov/PS5LM.git -
atomic-agent
AI repositoriesAtomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.
git clone https://github.com/AtomicBot-ai/atomic-agent.git -
unsloth
AI repositoriesLocal UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.
git clone https://github.com/unslothai/unsloth.git -
ms-swift
AI repositoriesUse PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).
git clone https://github.com/modelscope/ms-swift.git -
uccl
AI repositoriesUCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)
git clone https://github.com/uccl-project/uccl.git -
FastFlowLM
AI repositoriesRun LLMs on AMD Ryzen™ AI NPUs in minutes; purpose-built and deeply optimized for the AMD NPUs.
git clone https://github.com/ROCm/FastFlowLM.git -
kalosm
AI repositoriesInstant, controllable, local pre-trained AI models in Rust
git clone https://github.com/floneum/kalosm.git -
RAG_Techniques
AI repositoriesThis repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. Each technique has a detailed notebook tutorial.
git clone https://github.com/NirDiamant/RAG_Techniques.git -
rtp-llm
AI repositoriesRTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.
git clone https://github.com/alibaba/rtp-llm.git -
higgsfield
AI repositoriesFault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters
git clone https://github.com/higgsfield-ai/higgsfield.git -
enchanted
AI repositoriesEnchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama.
git clone https://github.com/gluonfield/enchanted.git -
PaddleNLP
AI repositoriesEasy-to-use and powerful LLM and SLM library with awesome model zoo.
git clone https://github.com/PaddlePaddle/PaddleNLP.git -
Risuai
AI repositoriesMake your own story. User-friendly software for LLM roleplaying
git clone https://github.com/kwaroran/Risuai.git -
END-TO-END-GENERATIVE-AI-PROJECTS
AI repositoriesEnd to End Generative AI Industry Projects on LLM Models with Deployment_Awesome LLM Projects
git clone https://github.com/GURPREETKAURJETHRA/END-TO-END-GENERATIVE-AI-PROJECTS.git -
LightLLM
AI repositoriesLightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
git clone https://github.com/ModelTC/LightLLM.git -
awesome-LLM-resources
AI repositories🧑🚀 全世界最好的LLM资料总结(多模态生成、Agent、辅助编程、AI审稿、数据处理、模型训练、模型推理、o1 模型、MCP、小语言模型、视觉语言模型) | Summary of the world's best LLM resources.
git clone https://github.com/WangRongsheng/awesome-LLM-resources.git -
kimi-k3-in-c
AI repositoriesA 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
git clone https://github.com/FareedKhan-dev/kimi-k3-in-c.git -
h2o-llmstudio
AI repositoriesH2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/
git clone https://github.com/h2oai/h2o-llmstudio.git -
shell_gpt
AI repositoriesA command-line productivity tool powered by AI large language models like GPT-5, will help you accomplish your tasks faster and more efficiently.
git clone https://github.com/TheR1D/shell_gpt.git -
ludwig
AI repositoriesLow-code framework for building custom LLMs, neural networks, and other AI models
git clone https://github.com/ludwig-ai/ludwig.git -
forge
AI repositoriesA Python framework for self-hosted LLM tool-calling and multi-step agentic workflows
git clone https://github.com/antoinezambelli/forge.git -
llmman
AI repositoriesRun any agent on any model, models stored as OCI images
git clone https://github.com/llmmanorg/llmman.git -
yzma
AI repositoriesGo with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.
git clone https://github.com/hybridgroup/yzma.git -
Llamatik
AI repositoriesTrue on-device AI SDK for Kotlin Multiplatform (Android, iOS, Desktop, JVM, WASM). LLM inference, Speech-to-Text, Image Generation, Agent Framework and RAG — powered by llama.cpp, whisper.cpp and stable-diffusion.cpp.
git clone https://github.com/llamatik/Llamatik.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.