Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
llama.rn
AI repositoriesReact Native binding of llama.cpp
git clone https://github.com/mybigday/llama.rn.git -
PS5LM
AI repositoriesllama.cpp on a jailbroken PS5: run any GGUF model natively on the console, starting with Qwen 3.8
git clone https://github.com/cobanov/PS5LM.git -
inferssd
AI repositoriesRun models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.
git clone https://github.com/wici-ai/inferssd.git -
atomic-agent
AI repositoriesAtomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.
git clone https://github.com/AtomicBot-ai/atomic-agent.git -
LLamaSharp
AI repositoriesA C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
git clone https://github.com/SciSharp/LLamaSharp.git -
LLMUnity
AI repositoriesCreate characters in Unity with LLMs!
git clone https://github.com/undreamai/LLMUnity.git -
llmman
AI repositoriesRun any agent on any model, models stored as OCI images
git clone https://github.com/llmmanorg/llmman.git -
forge
AI repositoriesA Python framework for self-hosted LLM tool-calling and multi-step agentic workflows
git clone https://github.com/antoinezambelli/forge.git -
llama-gpt
AI repositoriesA self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
git clone https://github.com/getumbrel/llama-gpt.git -
hax
AI repositoriesA minimalist, terminal-native coding agent written in C.
git clone https://github.com/OleksandrChekhovskyi/hax.git -
BigMoeOnEdge
AI repositoriesRun MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.
git clone https://github.com/Helldez/BigMoeOnEdge.git -
wllama
AI repositoriesWebAssembly binding for llama.cpp - Enabling on-browser LLM inference
git clone https://github.com/ngxson/wllama.git -
LLM-Hub
AI repositoriesLocal LLM, image&video&music generator
git clone https://github.com/timmyy123/LLM-Hub.git -
TinyLLM
AI repositoriesSetup and run a local LLM and Chatbot using consumer grade hardware.
git clone https://github.com/jasonacox/TinyLLM.git -
biniou
AI repositoriesa self-hosted webui for 30+ generative ai
git clone https://github.com/Woolverine94/biniou.git -
SiliconScope
AI repositoriesSudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking
git clone https://github.com/kennss/SiliconScope.git -
HilbertRaum
AI repositoriesAI, fully local on your computer.
git clone https://github.com/HilbertraumAI/HilbertRaum.git -
ETOS-LLM-Studio
AI repositoriesA native LLM client for iOS & Apple Watch. Run local GGUF models offline via llama.cpp, or connect to OpenAI/Claude/Gemini. Features local RAG, Model Context Protocol (MCP) tools, Siri Shortcuts, and cross-device sync. Built with Swift.
git clone https://github.com/Eric-Terminal/ETOS-LLM-Studio.git -
inference
AI repositoriesOpen-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.
git clone https://github.com/xorbitsai/inference.git -
Llamatik
AI repositoriesTrue on-device AI SDK for Kotlin Multiplatform (Android, iOS, Desktop, JVM, WASM). LLM inference, Speech-to-Text, Image Generation, Agent Framework and RAG — powered by llama.cpp, whisper.cpp and stable-diffusion.cpp.
git clone https://github.com/llamatik/Llamatik.git -
jev
AI repositoriesjevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.
git clone https://github.com/feder-cr/jev.git -
janas
AI repositories37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.
git clone https://github.com/prabanta-dev/janas.git -
ClawMem
AI repositoriesOn-device memory layer for AI agents. Claude Code, OpenClaw and Hermes. Hooks + MCP server + hybrid RAG search.
git clone https://github.com/yoloshii/ClawMem.git -
graphrag-rs
AI repositoriesGraphRAG-rs is a high-performance, state-of-the-art Rust implementation of GraphRAG (Graph-based Retrieval Augmented Generation) that builds knowledge graphs from documents and enables natural language querying with configurable entity extraction and local LLM integration
git clone https://github.com/automataIA/graphrag-rs.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.