InnerVault

Library

85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.

Results

  1. SwiftLM

    AI repositories

    ⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.

    Indexed GitHub, SharpAI 799 ★MITUpdated today

    git clone https://github.com/SharpAI/SwiftLM.git
  2. BotPsy-0.8B

    Models

    text generation model by qvac · transformers

    Indexed Hugging Face Hub, qvac 26 ♥apache-2.0Updated 5 days ago

    qvac/BotPsy-0.8B
  3. BigMoeOnEdge

    AI repositories

    Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.

    Indexed GitHub, Helldez 924 ★Apache-2.0Updated today

    git clone https://github.com/Helldez/BigMoeOnEdge.git
  4. text generation model by qvac · gguf

    Indexed Hugging Face Hub, qvac 22 ♥apache-2.0Updated 5 days ago

    qvac/BotPsy-0.8B-GGUFs
  5. picollm

    AI repositories

    On-device LLM Inference Powered by X-Bit Quantization

    Indexed GitHub, Picovoice 320 ★Apache-2.0Updated 4 days ago

    git clone https://github.com/Picovoice/picollm.git
  6. automatic speech recognition model by FermionResearch · mlx

    Stale Hugging Face Hub, FermionResearch 19 ♥cc-by-4.0Updated 19 days ago

    FermionResearch/Phonon-2.5-English
  7. text generation model by openbmb · transformers

    Stale Hugging Face Hub, openbmb 22 ♥apache-2.0Updated 32 days ago

    openbmb/MiniCPM-V-4.7-35B-A3B-DSpark
  8. text generation model by nota-ai · mlx

    Stale Hugging Face Hub, nota-ai 32 ♥openmdw-1.1Updated 34 days ago

    nota-ai/Nemotron-3.5-Lightning-30B-A3B-Nota-Ternary-MLX-1014
  9. droid-mcp

    MCP servers

    Let an AI use your Android phone: an app and an SDK with 160+ MCP tools (calendar, SMS, files, camera, notifications, screen control) for Claude Code, Codex, Cursor or on-device models, with approvals on the phone.

    Stale GitHub, stixez 42 ★Apache-2.0Updated 8 days ago

    git clone https://github.com/stixez/droid-mcp.git
  10. leclap

    MCP servers

    The video engine for AI agents. Compose, validate, preview and render editable JSON templates through MCP or CLI. Local FFmpeg rendering on Node, in browsers and on-device.

    Stale GitHub, heristop 36 ★MITUpdated 15 days ago

    git clone https://github.com/heristop/leclap.git
  11. Phonon-2.5

    Models

    automatic speech recognition model by FermionResearch · mlx

    Stale Hugging Face Hub, FermionResearch 42 ♥cc-by-4.0Updated 19 days ago

    FermionResearch/Phonon-2.5
  12. text generation model by FrostWolfAI · gguf

    Indexed Hugging Face Hub, FrostWolfAI 39 ♥apache-2.0Updated 10 days ago

    FrostWolfAI/Spark-X2.6-4B-abliterated-GGUF
  13. image text to text model by prism-ml · llama.cpp

    Stale Hugging Face Hub, prism-ml 34 ♥apache-2.0Updated 33 days ago

    prism-ml/Ternary-Bonsai-2-2B-gguf
  14. image text to text model by prism-ml · llama.cpp

    Stale Hugging Face Hub, prism-ml 30 ♥apache-2.0Updated 32 days ago

    prism-ml/Ternary-Bonsai-2-4B-gguf
  15. jev

    AI repositories

    jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.

    Stale GitHub, feder-cr 1,342 ★MITUpdated 31 days ago

    git clone https://github.com/feder-cr/jev.git
  16. image text to text model by saidutta69 · transformers

    Stale Hugging Face Hub, saidutta69 30 ♥apache-2.0Updated 32 days ago

    saidutta69/MiniCPM-V-4.7-1B-heretic
  17. image text to text model by saidutta69 · transformers

    Stale Hugging Face Hub, saidutta69 25 ♥apache-2.0Updated 10 days ago

    saidutta69/Qwen3.5-4B-heretic
  18. DroidBridge

    MCP servers

    On-device MCP server for Android. Connect ChatGPT through OpenAI's official secure tunnel, let AI agents operate your phone and run scheduled automations on it — App edition (Accessibility/Shizuku) or root edition (Magisk/KernelSU/APatch). No PC, no ADB. 卓爱桥

    Indexed GitHub, zephyr7030 23 ★Apache-2.0Updated yesterday

    git clone https://github.com/zephyr7030/DroidBridge.git
  19. VivaDicta

    AI repositories

    iOS & watchOS speech-to-text app with AI voice keyboard, on-device RAG, and chat with your notes - powered by Apple Foundation Models, WhisperKit, NVIDIA Parakeet, and 20+ AI providers

    Indexed GitHub, n0an 144 ★MITUpdated 2 days ago

    git clone https://github.com/n0an/VivaDicta.git
  20. apple-silicon-llm-bench

    Datasets & benchmarks

    Reproducible on-device LLM benchmarks for Apple Silicon (iPhone 17 Pro, M4 Max): Apple Core AI, MLX, llama.cpp, LiteRT-LM and Core ML on the same model and harness, every number with its quantization and capture session; hybrid Mamba-2 models (Nemotron-3 Nano, Granite-4.0-H, Falcon-H1) included.

    Indexed GitHub, john-rocky 73 ★MITUpdated today

    git clone https://github.com/john-rocky/apple-silicon-llm-bench.git
  21. apple-fm-mcp

    MCP servers

    Apple Foundation Models on-device. Generate, summarize, classify via Apple Intelligence.

    Stale Official MCP Registry, io.github.sophiacave Updated 5 months ago 1 note

    apple-fm-mcp@1.0.1
  22. fm-mcp

    MCP servers

    Delegate summarising, extraction, classification and OCR to the macOS 27 on-device model.

    Stale Official MCP Registry, io.github.yrangana Updated 29 days ago 1 note

    fm-mcp@0.1.3
  23. OGAD

    AI repositories

    Your private, on-device personal AI assistant for macOS, Windows and Linux. Chat, create, search files, and connect tools with local models. Includes an OpenAI-compatible API. Opt-in Pro sees, remembers, reflects, and acts with your approval, for one payment. No cloud or account.

    Indexed GitHub, off-grid-ai 147 ★AGPL-3.0Updated yesterday

    git clone https://github.com/off-grid-ai/OGAD.git
  24. Your Obsidian vault, exposed to Claude, Codex, Cursor and any MCP client. Runs inside Obsidian, on-device semantic search, no cloud round-trip, no binary to download.

    Stale GitHub, istefox 114 ★MITUpdated 23 days ago

    git clone https://github.com/istefox/obsidian-mcp-connector.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.