Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
chatllm.cpp
AI repositoriesPure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)
git clone https://github.com/foldl/chatllm.cpp.git -
llama.rn
AI repositoriesReact Native binding of llama.cpp
git clone https://github.com/mybigday/llama.rn.git -
infinity
AI repositoriesThe AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text.
git clone https://github.com/infiniflow/infinity.git -
BigMoeOnEdge
AI repositoriesRun MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.
git clone https://github.com/Helldez/BigMoeOnEdge.git -
PS5LM
AI repositoriesllama.cpp on a jailbroken PS5: run any GGUF model natively on the console, starting with Qwen 3.8
git clone https://github.com/cobanov/PS5LM.git -
inferssd
AI repositoriesRun models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.
git clone https://github.com/wici-ai/inferssd.git -
atomic-agent
AI repositoriesAtomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.
git clone https://github.com/AtomicBot-ai/atomic-agent.git -
runanywhere-sdks
AI repositoriesProduction ready toolkit to run AI locally
git clone https://github.com/RunanywhereAI/runanywhere-sdks.git -
LLamaSharp
AI repositoriesA C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
git clone https://github.com/SciSharp/LLamaSharp.git -
Llamatik
AI repositoriesTrue on-device AI SDK for Kotlin Multiplatform (Android, iOS, Desktop, JVM, WASM). LLM inference, Speech-to-Text, Image Generation, Agent Framework and RAG — powered by llama.cpp, whisper.cpp and stable-diffusion.cpp.
git clone https://github.com/llamatik/Llamatik.git -
LLMUnity
AI repositoriesCreate characters in Unity with LLMs!
git clone https://github.com/undreamai/LLMUnity.git -
Dot
AI repositoriesText-To-Speech, RAG, and LLMs. All local!
git clone https://github.com/alexpinel/Dot.git -
llmman
AI repositoriesRun any agent on any model, models stored as OCI images
git clone https://github.com/llmmanorg/llmman.git -
forge
AI repositoriesA Python framework for self-hosted LLM tool-calling and multi-step agentic workflows
git clone https://github.com/antoinezambelli/forge.git -
llama-gpt
AI repositoriesA self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
git clone https://github.com/getumbrel/llama-gpt.git -
hax
AI repositoriesA minimalist, terminal-native coding agent written in C.
git clone https://github.com/OleksandrChekhovskyi/hax.git -
wllama
AI repositoriesWebAssembly binding for llama.cpp - Enabling on-browser LLM inference
git clone https://github.com/ngxson/wllama.git -
LLM-Hub
AI repositoriesLocal LLM, image&video&music generator
git clone https://github.com/timmyy123/LLM-Hub.git -
TinyLLM
AI repositoriesSetup and run a local LLM and Chatbot using consumer grade hardware.
git clone https://github.com/jasonacox/TinyLLM.git -
biniou
AI repositoriesa self-hosted webui for 30+ generative ai
git clone https://github.com/Woolverine94/biniou.git -
meetily
AI repositoriesPrivacy-first AI meeting note taker for Windows and macOS. Free, open source (MIT). On-device Whisper/Parakeet transcription and speaker diarization, no meeting bot. Open-source alternative to Granola, Otter and Fireflies. https://meetily.ai
git clone https://github.com/Zackriya-Solutions/meetily.git -
SiliconScope
AI repositoriesSudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking
git clone https://github.com/kennss/SiliconScope.git -
HilbertRaum
AI repositoriesAI, fully local on your computer.
git clone https://github.com/HilbertraumAI/HilbertRaum.git -
oneDNN
AI repositoriesOpen-source library of optimized deep learning operations (matmul, convolution, attention) for CPUs (x64, AArch64, RISC-V) and Intel GPUs. Used by PyTorch, TensorFlow, OpenVINO, and ONNX Runtime.
git clone https://github.com/uxlfoundation/oneDNN.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.