Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
-
cactus
AI repositoriesSub-50mb agentic, voice and vision intelligence for consumer devices.
git clone https://github.com/cactus-compute/cactus.git -
runanywhere-sdks
AI repositoriesProduction ready toolkit to run AI locally
git clone https://github.com/RunanywhereAI/runanywhere-sdks.git -
Foundation-Models-Framework-Lab
AI repositoriesA practical lab for building, testing, and evaluating apps with Apple's Foundation Models framework.
git clone https://github.com/rudrankriyam/Foundation-Models-Framework-Lab.git -
nativ
AI repositoriesNativ is an open-source local AI app for Mac. It runs open AI models on Apple Silicon, and nothing leaves your Mac.
git clone https://github.com/Neywa-Labs/nativ.git -
litert-samples
AI repositoriesLiteRT and LiteRT-LM sample apps, model recipes, agent skills and utilities.
git clone https://github.com/google-ai-edge/litert-samples.git -
openmed
AI repositoriesLocal-first healthcare AI: clinical NER and HIPAA PII de-identification on hardware you control. 2,200+ medical models, 35 model-backed PII languages, and Python, MLX, Android and browser runtimes. Apache-2.0 SDK.
git clone https://github.com/maziyarpanahi/openmed.git -
SwiftLM
AI repositories⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.
git clone https://github.com/SharpAI/SwiftLM.git -
BigMoeOnEdge
AI repositoriesRun MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.
git clone https://github.com/Helldez/BigMoeOnEdge.git -
picollm
AI repositoriesOn-device LLM Inference Powered by X-Bit Quantization
git clone https://github.com/Picovoice/picollm.git -
jev
AI repositoriesjevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.
git clone https://github.com/feder-cr/jev.git -
VivaDicta
AI repositoriesiOS & watchOS speech-to-text app with AI voice keyboard, on-device RAG, and chat with your notes - powered by Apple Foundation Models, WhisperKit, NVIDIA Parakeet, and 20+ AI providers
git clone https://github.com/n0an/VivaDicta.git -
OGAD
AI repositoriesYour private, on-device personal AI assistant for macOS, Windows and Linux. Chat, create, search files, and connect tools with local models. Includes an OpenAI-compatible API. Opt-in Pro sees, remembers, reflects, and acts with your approval, for one payment. No cloud or account.
git clone https://github.com/off-grid-ai/OGAD.git -
ClawMem
AI repositoriesOn-device memory layer for AI agents. Claude Code, OpenClaw and Hermes. Hooks + MCP server + hybrid RAG search.
git clone https://github.com/yoloshii/ClawMem.git -
slotstream
AI repositoriesRun a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.
git clone https://github.com/carloslfu/slotstream.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.