Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
llama.cpp
ModelsThe C/C++ engine many local-model tools are built on. It runs models efficiently on ordinary hardware.
-
PowerInfer
AI repositoriesHigh-speed Large Language Model Serving for Local Deployment
git clone https://github.com/Tiiny-AI/PowerInfer.git -
Inflect-Mini-v3
Modelstext to speech model by owensong
owensong/Inflect-Mini-v3 -
Phocinae-Largha-150M-v1
Modelstext classification model by Phocinae
Phocinae/Phocinae-Largha-150M-v1 -
mojo-dllm
AI repositoriesLocal inference for diffusion language models (LLaDA, Dream), written in Mojo
git clone https://github.com/vladimirrott/mojo-dllm.git -
WVY-Blender-5m
Modelstext generation model by StarpowerTechnology · pytorch
StarpowerTechnology/WVY-Blender-5m -
Klee
AI repositoriesA native macOS AI chat app powered by MLX. 100% local inference on Apple Silicon, no cloud required. Built with ShipSwift.
git clone https://github.com/signerlabs/Klee.git -
image text to text model by Jackrong · transformers
Jackrong/Qwopus3-5-9B-Coder-Flash-GGUF -
ollaya
MCP serversJev-compatible API server for open decision models. Ollama for decision models: pull and serve 29 model families (Laya, pplx-decider, Clef, Winnow, coba...) locally or self-hosted behind /v1/systemone. The TypeSafe SDK works unchanged: set its base URL and pick an open model. CLI, desktop app, Docker, MCP server, public bench.
git clone https://github.com/ollaya-dev/ollaya.git -
yzma
AI repositoriesGo with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.
git clone https://github.com/hybridgroup/yzma.git -
offline-mcp
MCP serversLocal AI over Ollama for low connectivity: status, local inference, model and deployment guides.
offline-mcp@0.1.13 -
localharness
Agents & frameworksAn open-source, coding agent harness designed specifically for local LLMs. Designed as everything a user needs to jumpstart their own harness (detailed event steams, logs, and performance data) or quickly replace closed source one (featuring out of the box plugins for web search, image gen, memory, auto research and more in dev).
git clone https://github.com/ahwurm/localharness.git -
halogen-flash-server
AI repositoriesLocal inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models, over the OpenAI and Anthropic APIs on one port.
git clone https://github.com/peonist-ai/halogen-flash-server.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.