Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
-
PowerInfer
AI repositoriesHigh-speed Large Language Model Serving for Local Deployment
git clone https://github.com/Tiiny-AI/PowerInfer.git -
mojo-dllm
AI repositoriesLocal inference for diffusion language models (LLaDA, Dream), written in Mojo
git clone https://github.com/vladimirrott/mojo-dllm.git -
Klee
AI repositoriesA native macOS AI chat app powered by MLX. 100% local inference on Apple Silicon, no cloud required. Built with ShipSwift.
git clone https://github.com/signerlabs/Klee.git -
yzma
AI repositoriesGo with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.
git clone https://github.com/hybridgroup/yzma.git -
halogen-flash-server
AI repositoriesLocal inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models, over the OpenAI and Anthropic APIs on one port.
git clone https://github.com/peonist-ai/halogen-flash-server.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.