Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
-
turbo-fieldfare
AI repositoriesGemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook
git clone https://github.com/drumih/turbo-fieldfare.git -
ai
AI repositoriesOn-device LLM execution in React Native with Vercel AI SDK compatibility
git clone https://github.com/callstackincubator/ai.git -
xybrid
AI repositoriesCross-platform on-device AI toolkit
git clone https://github.com/xybrid-ai/xybrid.git -
cactus
AI repositoriesSub-50mb agentic, voice and vision intelligence for consumer devices.
git clone https://github.com/cactus-compute/cactus.git -
thunderbolt
Agents & frameworksAI You Control: Choose your models. Own your data. Eliminate vendor lock-in.
git clone https://github.com/thunderbird/thunderbolt.git -
apfel
AI repositoriesThe free AI already on your Mac. CLI tool, OpenAI-compatible server, and interactive chat — all on-device via Apple Intelligence. No API keys, no cloud, no downloads.
git clone https://github.com/Arthur-Ficial/apfel.git -
MasterAgent
Agents & frameworksBuild AI agents that run 100% on-device. Sub-100ms latency on Qualcomm NPU. Zero cloud dependency.
git clone https://github.com/OpenSparX/MasterAgent.git -
PhoneClaw
Agents & frameworksPhoneClaw turns phones into local AI agent runtimes with on-device models, native mobile Skills, LiveLand, and optional Mac Gateway inference.
git clone https://github.com/kellyvv/PhoneClaw.git -
Ternary-Bonsai-2-27B-gguf
Modelstext generation model by prism-ml · llama.cpp
prism-ml/Ternary-Bonsai-2-27B-gguf -
runanywhere-sdks
AI repositoriesProduction ready toolkit to run AI locally
git clone https://github.com/RunanywhereAI/runanywhere-sdks.git -
Octopus-v2
Modelstext generation model by NexaAI · transformers
NexaAI/Octopus-v2 -
needle
Modelsmodel by Cactus-Compute · jax
Cactus-Compute/needle -
MiniCPM-V-4.6
Modelsimage text to text model by openbmb · transformers
openbmb/MiniCPM-V-4.6 -
MiniCPM5-2B
Modelstext generation model by openbmb · transformers
openbmb/MiniCPM5-2B -
Underdog-Woof
Modelstext to speech model by ConwayResearch · numpy
ConwayResearch/Underdog-Woof -
MiniCPM5-1B
Modelstext generation model by openbmb · transformers
openbmb/MiniCPM5-1B -
engine
AI repositories2bit quants, kernels and runtime for consumer devices.
git clone https://github.com/cactus-compute/engine.git -
MiniCPM-V-4.7-35B-A3B
Modelsimage text to text model by openbmb · transformers
openbmb/MiniCPM-V-4.7-35B-A3B -
needle3
Modelstext generation model by Cactus-Compute · cactus-compute
Cactus-Compute/needle3 -
sentient-os
AI repositoriesAn on-device LLM understands your entire life, then proactively offers to get your work done through computer use.
git clone https://github.com/Sentient-OS-Labs/sentient-os.git -
Ternary-Bonsai-27B-gguf
Modelstext generation model by prism-ml · llama.cpp
prism-ml/Ternary-Bonsai-27B-gguf -
GenieX
AI repositoriesRun frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code
git clone https://github.com/qualcomm/GenieX.git -
Bonsai-8B-gguf
Modelstext generation model by prism-ml · llama.cpp
prism-ml/Bonsai-8B-gguf -
supertonic-3
Modelstext to speech model by Supertone · supertonic
Supertone/supertonic-3
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.