Library
86,689 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
llama-modchip
Agents & frameworksRun 284B DeepSeek-V4-Flash (<59GiB RAM: 41.1 cold pp, 9.1 N=1 tg, up to 25.3 spec tok/s) & 30B MoEs (22.4 N=1 / 111.6 spec tok/s) on 64GB CPU (0 GPUs).
git clone https://github.com/synchopate/llama-modchip.git -
image text to text model by JonathanColetti · transformers
JonathanColetti/Qwen3.5-0.8B-Astra-WeightEdit -
Alpie_seed
Modelsimage text to text model by 169Pi · transformers
169Pi/Alpie_seed -
MiniCPM-V-4.7-1B-heretic
Modelsimage text to text model by saidutta69 · transformers
saidutta69/MiniCPM-V-4.7-1B-heretic -
Qwen3.5-4B-heretic
Modelsimage text to text model by saidutta69 · transformers
saidutta69/Qwen3.5-4B-heretic -
janas
AI repositories37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.
git clone https://github.com/prabanta-dev/janas.git -
PolyStrata
AI repositoriesRun large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and MiniCPM-V on a second engine written for PolyStrata. One-click install for Windows and Linux, OpenAI/Anthropic API on localhost.
git clone https://github.com/VecSzn/PolyStrata.git -
vmlx
MCP serversvMLX - Use MLX models easily - JANGQ (GGUF for MLX) - Not dependant on mlx_vlm
git clone https://github.com/jjang-ai/vmlx.git -
velocity-local-services
MCP serversVelocity Local Services: an app for running LLMs locally on Windows and Linux. Load any GGUF model and chat with web search, tools and schematics, let it use your computer by voice, and serve it to opencode, Hermes or any app through an OpenAI-compatible API and MCP. Context up to 32M tokens. No cloud.
git clone https://github.com/Veloresearch/velocity-local-services.git -
deepseek-local-guide-ru
Docs & tutorials🐋 Полный гайд на русском: как установить и запустить DeepSeek локально (V4, R1) на ПК, Mac и сервере — Ollama, llama.cpp, LM Studio, vLLM, Open WebUI, API, RAG, агенты, fine-tuning, лучшие фишки
git clone https://github.com/justxor/deepseek-local-guide-ru.git -
lilbee
MCP serversA local model engine with a search engine and web crawler built in. Run your coding agents on your own GPUs, and get cited answers from your files, code, and the sites you crawl. One executable.
git clone https://github.com/tobocop2/lilbee.git -
LumaBrowser
MCP serversLocal AI desktop app: a Chromium browser with a GPU-aware llama.cpp runtime, OpenAI-compatible API, AI chat and agents, Stable Diffusion image/video, TTS and music, plus an MCP server so Claude Code, Codex and Cline can drive your browser. Windows, macOS, Linux.
git clone https://github.com/amurgola/LumaBrowser.git -
model-scanner
MCP serversScans ML model files (PyTorch, joblib, NumPy, GGUF, TensorFlow…) and HF repos for supply-chain risks
@guardbee/mcp-model-scanner@0.4.0 -
hayward
MCP serversChecks ML model files (pickle, PyTorch, joblib, NumPy, GGUF, ONNX) for code that runs on load.
hayward@1.4.1 -
vetted-consumer
MCP serversWill a local LLM run on your hardware? GGUF quant, buy-vs-rent-vs-API cost, used-GPU prices.
-
MCP server to fine-tune LoRA, export GGUF, and deploy local LLMs on Onde Inference.
@ondeinference/cli@0.6.1 -
Lynn
Agents & frameworks开源桌面 AI Agent 与 CLI:长期记忆、多 Agent、实时语音;Qwen3.8-27B Coder390 EfficientThink 本地 GGUF(llama.cpp Q2/Q3,内置 Q4 MTP)· Open-source desktop AI agent & CLI with Coder390 local models
git clone https://github.com/MerkyorLynn/Lynn.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.