Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
turbo-fieldfare
AI repositoriesGemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook
git clone https://github.com/drumih/turbo-fieldfare.git -
ai
AI repositoriesOn-device LLM execution in React Native with Vercel AI SDK compatibility
git clone https://github.com/callstackincubator/ai.git -
xybrid
AI repositoriesCross-platform on-device AI toolkit
git clone https://github.com/xybrid-ai/xybrid.git -
cactus
AI repositoriesSub-50mb agentic, voice and vision intelligence for consumer devices.
git clone https://github.com/cactus-compute/cactus.git -
apfel
AI repositoriesThe free AI already on your Mac. CLI tool, OpenAI-compatible server, and interactive chat — all on-device via Apple Intelligence. No API keys, no cloud, no downloads.
git clone https://github.com/Arthur-Ficial/apfel.git -
runanywhere-sdks
AI repositoriesProduction ready toolkit to run AI locally
git clone https://github.com/RunanywhereAI/runanywhere-sdks.git -
engine
AI repositories2bit quants, kernels and runtime for consumer devices.
git clone https://github.com/cactus-compute/engine.git -
sentient-os
AI repositoriesAn on-device LLM understands your entire life, then proactively offers to get your work done through computer use.
git clone https://github.com/Sentient-OS-Labs/sentient-os.git -
GenieX
AI repositoriesRun frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code
git clone https://github.com/qualcomm/GenieX.git -
flutter_edge_ai
AI repositoriesOn-device AI for Flutter — Gemma and other LLMs, multimodal, function calling, embeddings, RAG and speech on Android, iOS, Web, macOS, Windows and Linux.
git clone https://github.com/DenisovAV/flutter_edge_ai.git -
nativ
AI repositoriesNativ is an open-source local AI app for Mac. It runs open AI models on Apple Silicon, and nothing leaves your Mac.
git clone https://github.com/Neywa-Labs/nativ.git -
SiliconScope
AI repositoriesSudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking
git clone https://github.com/kennss/SiliconScope.git -
litert-samples
AI repositoriesLiteRT and LiteRT-LM sample apps, model recipes, agent skills and utilities.
git clone https://github.com/google-ai-edge/litert-samples.git -
SwiftLM
AI repositories⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.
git clone https://github.com/SharpAI/SwiftLM.git -
OlliteRT
AI repositoriesTurn your Android phone into an OpenAI-compatible LLM inference server - Fully local, private and Open Source
git clone https://github.com/NightMean/OlliteRT.git -
Mika
AI repositoriesAn on-device AI agent for Android that operates apps and the web to get things done for you.
git clone https://github.com/wangzan101/Mika.git -
Parrot
AI repositoriesMeeting recorder for your Mac with a live AI assistant. On-device transcription, answers from your own docs mid-call. Local-first and open source.
git clone https://github.com/turantekin/Parrot.git -
Llamatik
AI repositoriesTrue on-device AI SDK for Kotlin Multiplatform (Android, iOS, Desktop, JVM, WASM). LLM inference, Speech-to-Text, Image Generation, Agent Framework and RAG — powered by llama.cpp, whisper.cpp and stable-diffusion.cpp.
git clone https://github.com/llamatik/Llamatik.git -
MNN
AI repositoriesMNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.
git clone https://github.com/alibaba/MNN.git -
openmed
AI repositoriesLocal-first healthcare AI: clinical NER and HIPAA PII de-identification on hardware you control. 2,200+ medical models, 35 model-backed PII languages, and Python, MLX, Android and browser runtimes. Apache-2.0 SDK.
git clone https://github.com/maziyarpanahi/openmed.git -
humla
AI repositoriesOpen-source AI meeting notes for Mac. Records mic + system audio with no bot, transcribes on-device or via OpenAI / Deepgram / Groq, identifies speakers offline, and writes summaries that fuse your notes with the transcript. Ask your notes and get cited answers. Tauri 2 + Rust + Swift.
git clone https://github.com/michaelwilhelmsen/humla.git -
Foundation-Models-Framework-Lab
AI repositoriesA practical lab for building, testing, and evaluating apps with Apple's Foundation Models framework.
git clone https://github.com/rudrankriyam/Foundation-Models-Framework-Lab.git -
BigMoeOnEdge
AI repositoriesRun MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.
git clone https://github.com/Helldez/BigMoeOnEdge.git -
jev
AI repositoriesjevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.
git clone https://github.com/feder-cr/jev.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.