Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
Ollama
ModelsRuns open models such as gpt-oss, Qwen and DeepSeek on your own computer.
curl -fsSL https://ollama.com/install.sh | sh -
llama.cpp
ModelsThe C/C++ engine many local-model tools are built on. It runs models efficiently on ordinary hardware.
-
Aider
AI repositoriesAI pair programming in your terminal. It edits your files and works with many models, including local ones.
python -m pip install aider-install -
PowerInfer
AI repositoriesHigh-speed Large Language Model Serving for Local Deployment
git clone https://github.com/Tiiny-AI/PowerInfer.git -
Qwen3.8-Flash-Next-FP4-Local
Modelsimage text to text model by nvidia · Model Optimizer
nvidia/Qwen3.8-Flash-Next-FP4-Local -
GLM-5.3-Flash-FP4-Local
Modelsimage text to text model by nvidia · Model Optimizer
nvidia/GLM-5.3-Flash-FP4-Local -
Inflect-Micro-v2
Modelstext to speech model by owensong
owensong/Inflect-Micro-v2 -
nanobot
MCP serversYour lightweight open-source personal agent.
git clone https://github.com/HKUDS/nanobot.git -
local-rag
AI repositoriesIngest files for retrieval augmented generation (RAG) with open-source Large Language Models (LLMs), all without 3rd parties or sensitive data leaving your network.
git clone https://github.com/jonfairbanks/local-rag.git -
text generation model by yuxinlu1 · gguf
yuxinlu1/gemma-4-12B-coder-fable5-composer2.5-v1-GGUF -
mlx-vlm
AI repositoriesMLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.
git clone https://github.com/Neywa-Labs/mlx-vlm.git -
Olares
Agents & frameworksOpen-Source Personal Cloud OS for Always-On Agents
git clone https://github.com/beclab/Olares.git -
openchatx-mcp
MCP serversTurn ChatGPT into a local agent runtime. Operate your computer, use local tools, discover MCP servers, and delegate work to your own models through one MCP connection.
git clone https://github.com/WealthyV/openchatx-mcp.git -
partmode
MCP serversOpen-source, local-first 3D parametric CAD that runs in the browser for people and permissioned typed agents, powered by OpenCascade WASM.
git clone https://github.com/BOMWiki/partmode.git -
Soup
AI repositoriesFine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
git clone https://github.com/MakazhanAlpamys/Soup.git -
laya
AI repositoriesRun Laya, the open-source Jev-compatible System-1 decision model, from Node.js / TypeScript via ONNX Runtime
git clone https://github.com/receptron/laya.git -
AnyModelBot
AI repositories🤖 Open-source, local-first alternative to Grok Bot, OpenAI dots and Claude Duet. Your own AI bots on any model: GPT, Claude, Gemini, Grok, DeepSeek, Kimi, GLM and 70+ more through one Modelflare key. Reach them in the app, WeChat or Feishu; they remember you, work in the background, run commands and use your computer. Pay per use.
git clone https://github.com/modelflare-ai/AnyModelBot.git -
atomic-agent
AI repositoriesAtomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.
git clone https://github.com/AtomicBot-ai/atomic-agent.git -
ollaya
MCP serversJev-compatible API server for open decision models. Ollama for decision models: pull and serve 29 model families (Laya, pplx-decider, Clef, Winnow, coba...) locally or self-hosted behind /v1/systemone. The TypeSafe SDK works unchanged: set its base URL and pick an open model. CLI, desktop app, Docker, MCP server, public bench.
git clone https://github.com/ollaya-dev/ollaya.git -
mcp-local-rag
AI repositoriesLocal-first RAG server for developers. Semantic + keyword search for code and technical docs. Works with MCP or CLI. Fully private, zero setup.
git clone https://github.com/shinpr/mcp-local-rag.git -
langroid
Agents & frameworksHarness LLMs with Multi-Agent Programming
git clone https://github.com/langroid/langroid.git -
comfyui-mcp-server
MCP serverslightweight Python-based MCP (Model Context Protocol) server for local ComfyUI
git clone https://github.com/joenorton/comfyui-mcp-server.git -
text generation model by yuxinlu1 · gguf
yuxinlu1/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-tau2-GGUF -
openmed
AI repositoriesLocal-first healthcare AI: clinical NER and HIPAA PII de-identification on hardware you control. 2,200+ medical models, 35 model-backed PII languages, and Python, MLX, Android and browser runtimes. Apache-2.0 SDK.
git clone https://github.com/maziyarpanahi/openmed.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.