Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
Aider
AI repositoriesAI pair programming in your terminal. It edits your files and works with many models, including local ones.
python -m pip install aider-install -
PowerInfer
AI repositoriesHigh-speed Large Language Model Serving for Local Deployment
git clone https://github.com/Tiiny-AI/PowerInfer.git -
local-rag
AI repositoriesIngest files for retrieval augmented generation (RAG) with open-source Large Language Models (LLMs), all without 3rd parties or sensitive data leaving your network.
git clone https://github.com/jonfairbanks/local-rag.git -
mlx-vlm
AI repositoriesMLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.
git clone https://github.com/Neywa-Labs/mlx-vlm.git -
Soup
AI repositoriesFine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
git clone https://github.com/MakazhanAlpamys/Soup.git -
laya
AI repositoriesRun Laya, the open-source Jev-compatible System-1 decision model, from Node.js / TypeScript via ONNX Runtime
git clone https://github.com/receptron/laya.git -
AnyModelBot
AI repositories🤖 Open-source, local-first alternative to Grok Bot, OpenAI dots and Claude Duet. Your own AI bots on any model: GPT, Claude, Gemini, Grok, DeepSeek, Kimi, GLM and 70+ more through one Modelflare key. Reach them in the app, WeChat or Feishu; they remember you, work in the background, run commands and use your computer. Pay per use.
git clone https://github.com/modelflare-ai/AnyModelBot.git -
atomic-agent
AI repositoriesAtomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.
git clone https://github.com/AtomicBot-ai/atomic-agent.git -
mcp-local-rag
AI repositoriesLocal-first RAG server for developers. Semantic + keyword search for code and technical docs. Works with MCP or CLI. Fully private, zero setup.
git clone https://github.com/shinpr/mcp-local-rag.git -
openmed
AI repositoriesLocal-first healthcare AI: clinical NER and HIPAA PII de-identification on hardware you control. 2,200+ medical models, 35 model-backed PII languages, and Python, MLX, Android and browser runtimes. Apache-2.0 SDK.
git clone https://github.com/maziyarpanahi/openmed.git -
NanoSage
AI repositoriesLocal LLM Powered Recursive Search & Smart Knowledge Explorer
git clone https://github.com/masterFoad/NanoSage.git -
nodedb
AI repositoriesThe memory & storage database engine for AI agents. Multi-model, edge-to-cloud, PostgreSQL-compatible. Supports graph, vector, array, timeseries.
git clone https://github.com/NodeDB-Lab/nodedb.git -
wigolo
AI repositoriesThe go-to web for your AI coding agent — local-first search, fetch, crawl & research over MCP. No API keys, no cloud, $0/query. Public beta.
git clone https://github.com/KnockOutEZ/wigolo.git -
mojo-dllm
AI repositoriesLocal inference for diffusion language models (LLaDA, Dream), written in Mojo
git clone https://github.com/vladimirrott/mojo-dllm.git -
runanywhere-sdks
AI repositoriesProduction ready toolkit to run AI locally
git clone https://github.com/RunanywhereAI/runanywhere-sdks.git -
nativ
AI repositoriesNativ is an open-source local AI app for Mac. It runs open AI models on Apple Silicon, and nothing leaves your Mac.
git clone https://github.com/Neywa-Labs/nativ.git -
mcpsurfr
AI repositoriesWeb search MCP server that does search result reranking locally on your machine, formerly known as mcp-local-rag. ✨ no API keys ✨
git clone https://github.com/nkapila6/mcpsurfr.git -
jev
AI repositoriesjevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.
git clone https://github.com/feder-cr/jev.git -
synaplan
AI repositoriesOwn the flow: one open-source AI platform for your knowledge, models and channels – web, WhatsApp, email, Outlook, Nextcloud & ownCloud. Local and cloud models side by side, with the cost on every answer.
git clone https://github.com/metadist/synaplan.git -
HyperChat
AI repositoriesHyperChat is a Chat client that strives for openness, utilizing APIs from various LLMs to achieve the best Chat experience, as well as implementing productivity tools through the MCP protocol.
git clone https://github.com/BigSweetPotatoStudio/HyperChat.git -
EmbedAnything
AI repositoriesHighly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust 🦀
git clone https://github.com/StarlightSearch/EmbedAnything.git -
WhisperJAV
AI repositoriesASR/STT subtitle generator. Uses Qwen3-ASR, local LLM, Whisper, TEN-VAD. Noise-robust for JAV
git clone https://github.com/meizhong986/WhisperJAV.git -
kalosm
AI repositoriesInstant, controllable, local pre-trained AI models in Rust
git clone https://github.com/floneum/kalosm.git -
model-compose
AI repositoriesDeclarative AI pipelines in one YAML file. Tokens, audio chunks, and video frames flow between isolated components. Compose 100+ components for models, agents, speech, vision, and live broadcast. Run local models, cloud APIs, or both. Inspired by docker-compose.
git clone https://github.com/hanyeol/model-compose.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.