Library
85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
engine
AI repositories2bit quants, kernels and runtime for consumer devices.
git clone https://github.com/cactus-compute/engine.git -
PaddleNLP
AI repositoriesEasy-to-use and powerful LLM and SLM library with awesome model zoo.
git clone https://github.com/PaddlePaddle/PaddleNLP.git -
XRAG
AI repositoriesXRAG: eXamining the Core - Benchmarking Foundational Component Modules in Advanced Retrieval-Augmented Generation
git clone https://github.com/DocAILab/XRAG.git -
Risuai
AI repositoriesMake your own story. User-friendly software for LLM roleplaying
git clone https://github.com/kwaroran/Risuai.git -
deep-searcher
AI repositoriesOpen Source Deep Research Alternative to Reason and Search on Private Data. Written in Python.
git clone https://github.com/zilliztech/deep-searcher.git -
GenieX
AI repositoriesRun frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code
git clone https://github.com/qualcomm/GenieX.git -
llm-architecture-from-scratch
AI repositoriesImplementing LLM architectures from scratch in PyTorch
git clone https://github.com/YeonwooSung/llm-architecture-from-scratch.git -
LightLLM
AI repositoriesLightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
git clone https://github.com/ModelTC/LightLLM.git -
awesome-LLM-resources
AI repositories🧑🚀 全世界最好的LLM资料总结(多模态生成、Agent、辅助编程、AI审稿、数据处理、模型训练、模型推理、o1 模型、MCP、小语言模型、视觉语言模型) | Summary of the world's best LLM resources.
git clone https://github.com/WangRongsheng/awesome-LLM-resources.git -
Dot
AI repositoriesText-To-Speech, RAG, and LLMs. All local!
git clone https://github.com/alexpinel/Dot.git -
shell_gpt
AI repositoriesA command-line productivity tool powered by AI large language models like GPT-5, will help you accomplish your tasks faster and more efficiently.
git clone https://github.com/TheR1D/shell_gpt.git -
LLPhant
AI repositoriesLLPhant - A comprehensive PHP Generative AI Framework using OpenAI GPT 4. Inspired by Langchain
git clone https://github.com/LLPhant/LLPhant.git -
llmman
AI repositoriesRun any agent on any model, models stored as OCI images
git clone https://github.com/llmmanorg/llmman.git -
surogate
AI repositoriesTrain and serve LLMs at extreme speed and massive throughput.
git clone https://github.com/invergent-ai/surogate.git -
gpustack
AI repositoriesA GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
git clone https://github.com/gpustack/gpustack.git -
tt-metal
AI repositories:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.
git clone https://github.com/tenstorrent/tt-metal.git -
oumi
AI repositoriesEasily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!
git clone https://github.com/oumi-ai/oumi.git -
hax
AI repositoriesA minimalist, terminal-native coding agent written in C.
git clone https://github.com/OleksandrChekhovskyi/hax.git -
BigMoeOnEdge
AI repositoriesRun MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.
git clone https://github.com/Helldez/BigMoeOnEdge.git -
restai
AI repositoriesRESTai is an AIaaS (AI as a Service) open-source platform. Supports many public and local LLM suported by Ollama/vLLM/etc. Precise embeddings usage, tuning, analytics etc. Built-in image/audio generation with dynamic loading generators. Live chat deployment. Built-in block based graphical language. Prompt versioning and much more...
git clone https://github.com/apocas/restai.git -
OmAgent
AI repositories[EMNLP-2024] Build multimodal language agents for fast prototype and production
git clone https://github.com/om-ai-lab/OmAgent.git -
LEANN
AI repositories[MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.
git clone https://github.com/StarTrail-org/LEANN.git -
tools
AI repositoriesA set of tools that gives agents powerful capabilities.
git clone https://github.com/strands-agents/tools.git -
reor
AI repositoriesPrivate & local AI personal knowledge management app for high entropy people.
git clone https://github.com/reorproject/reor.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.