Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
-
turbo-fieldfare
AI repositoriesGemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook
git clone https://github.com/drumih/turbo-fieldfare.git -
ai
AI repositoriesOn-device LLM execution in React Native with Vercel AI SDK compatibility
git clone https://github.com/callstackincubator/ai.git -
MNN
AI repositoriesMNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.
git clone https://github.com/alibaba/MNN.git -
picollm
AI repositoriesOn-device LLM Inference Powered by X-Bit Quantization
git clone https://github.com/Picovoice/picollm.git -
sentient-os
AI repositoriesAn on-device LLM understands your entire life, then proactively offers to get your work done through computer use.
git clone https://github.com/Sentient-OS-Labs/sentient-os.git -
localmind
MCP serversA mobile application designed to provide a beautiful, fast, and privacy-respecting interface for on device LLM and local LLM servers and cloud providers
git clone https://github.com/abdulmominsakib/localmind.git -
apple-silicon-llm-bench
Datasets & benchmarksReproducible on-device LLM benchmarks for Apple Silicon (iPhone 17 Pro, M4 Max): Apple Core AI, MLX, llama.cpp, LiteRT-LM and Core ML on the same model and harness, every number with its quantization and capture session; hybrid Mamba-2 models (Nemotron-3 Nano, Granite-4.0-H, Falcon-H1) included.
git clone https://github.com/john-rocky/apple-silicon-llm-bench.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.