InnerVault

Library

85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. cactus

    AI repositories

    Sub-50mb agentic, voice and vision intelligence for consumer devices.

    Indexed GitHub, cactus-compute 14.7k ★Apache-2.0Updated 2 days ago

    git clone https://github.com/cactus-compute/cactus.git
  2. ai

    AI repositories

    On-device LLM execution in React Native with Vercel AI SDK compatibility

    Stale GitHub, callstackincubator 1,426 ★MITUpdated 17 days ago

    git clone https://github.com/callstackincubator/ai.git
  3. xybrid

    AI repositories

    Cross-platform on-device AI toolkit

    Stale GitHub, xybrid-ai 522 ★Apache-2.0Updated 5 days ago

    git clone https://github.com/xybrid-ai/xybrid.git
  4. runanywhere-sdks

    AI repositories

    Production ready toolkit to run AI locally

    Stale GitHub, RunanywhereAI 10.3k ★Custom licence (see repository)Updated 12 days ago

    git clone https://github.com/RunanywhereAI/runanywhere-sdks.git
  5. engine

    AI repositories

    2bit quants, kernels and runtime for consumer devices.

    Stale GitHub, cactus-compute 6,181 ★Custom licence (see repository)Updated 11 days ago

    git clone https://github.com/cactus-compute/engine.git
  6. flutter_edge_ai

    AI repositories

    On-device AI for Flutter — Gemma and other LLMs, multimodal, function calling, embeddings, RAG and speech on Android, iOS, Web, macOS, Windows and Linux.

    Indexed GitHub, DenisovAV 665 ★MITUpdated today

    git clone https://github.com/DenisovAV/flutter_edge_ai.git
  7. GenieX

    AI repositories

    Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code

    Stale GitHub, qualcomm 8,494 ★BSD-3-ClauseUpdated 11 days ago

    git clone https://github.com/qualcomm/GenieX.git
  8. turbo-fieldfare

    AI repositories

    Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

    Stale GitHub, drumih 6,930 ★Apache-2.0Updated 33 days ago

    git clone https://github.com/drumih/turbo-fieldfare.git
  9. nativ

    AI repositories

    Nativ is an open-source local AI app for Mac. It runs open AI models on Apple Silicon, and nothing leaves your Mac.

    Indexed GitHub, Neywa-Labs 1,591 ★MITUpdated yesterday

    git clone https://github.com/Neywa-Labs/nativ.git
  10. SiliconScope

    AI repositories

    Sudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking

    Stale GitHub, kennss 1,013 ★MITUpdated 14 days ago

    git clone https://github.com/kennss/SiliconScope.git
  11. litert-samples

    AI repositories

    LiteRT and LiteRT-LM sample apps, model recipes, agent skills and utilities.

    Indexed GitHub, google-ai-edge 496 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/google-ai-edge/litert-samples.git
  12. OlliteRT

    AI repositories

    Turn your Android phone into an OpenAI-compatible LLM inference server - Fully local, private and Open Source

    Stale GitHub, NightMean 597 ★Apache-2.0Updated 15 days ago

    git clone https://github.com/NightMean/OlliteRT.git
  13. SwiftLM

    AI repositories

    ⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.

    Indexed GitHub, SharpAI 799 ★MITUpdated today

    git clone https://github.com/SharpAI/SwiftLM.git
  14. Llamatik

    AI repositories

    True on-device AI SDK for Kotlin Multiplatform (Android, iOS, Desktop, JVM, WASM). LLM inference, Speech-to-Text, Image Generation, Agent Framework and RAG — powered by llama.cpp, whisper.cpp and stable-diffusion.cpp.

    Indexed GitHub, llamatik 220 ★Custom licence (see repository)Updated 3 days ago

    git clone https://github.com/llamatik/Llamatik.git
  15. Mika

    AI repositories

    An on-device AI agent for Android that operates apps and the web to get things done for you.

    Indexed GitHub, wangzan101 8,769 ★Apache-2.0Updated today

    git clone https://github.com/wangzan101/Mika.git
  16. sentient-os

    AI repositories

    An on-device LLM understands your entire life, then proactively offers to get your work done through computer use.

    Stale GitHub, Sentient-OS-Labs 708 ★AGPL-3.0Updated 9 days ago

    git clone https://github.com/Sentient-OS-Labs/sentient-os.git
  17. A practical lab for building, testing, and evaluating apps with Apple's Foundation Models framework.

    Stale GitHub, rudrankriyam 1,190 ★MITUpdated 9 days ago

    git clone https://github.com/rudrankriyam/Foundation-Models-Framework-Lab.git
  18. BigMoeOnEdge

    AI repositories

    Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.

    Indexed GitHub, Helldez 924 ★Apache-2.0Updated today

    git clone https://github.com/Helldez/BigMoeOnEdge.git
  19. jev

    AI repositories

    jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.

    Stale GitHub, feder-cr 1,342 ★MITUpdated 31 days ago

    git clone https://github.com/feder-cr/jev.git
  20. Wax

    AI repositories

    Shared Single-file memory layer for all your agents, sub mili-second RAG over text, photo and video on Apple Silicon.. No Server. No API. One File. Pure Swift

    Indexed GitHub, christopherkarani 810 ★Apache-2.0Updated yesterday

    git clone https://github.com/christopherkarani/Wax.git
  21. slotstream

    AI repositories

    Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.

    Indexed GitHub, carloslfu 673 ★MITUpdated today

    git clone https://github.com/carloslfu/slotstream.git
  22. OGAD

    AI repositories

    Your private, on-device personal AI assistant for macOS, Windows and Linux. Chat, create, search files, and connect tools with local models. Includes an OpenAI-compatible API. Opt-in Pro sees, remembers, reflects, and acts with your approval, for one payment. No cloud or account.

    Indexed GitHub, off-grid-ai 147 ★AGPL-3.0Updated yesterday

    git clone https://github.com/off-grid-ai/OGAD.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.