InnerVault

Library

85,336 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. omlx

    AI repositories

    LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

    Indexed GitHub, jundot 23.7k ★Apache-2.0Updated today

    git clone https://github.com/jundot/omlx.git
  2. vllm-metal

    AI repositories

    Community maintained hardware plugin for vLLM on Apple Silicon

    Stale GitHub, vllm-project 1,987 ★Apache-2.0Updated 4 days ago

    git clone https://github.com/vllm-project/vllm-metal.git
  3. Klee

    AI repositories

    A native macOS AI chat app powered by MLX. 100% local inference on Apple Silicon, no cloud required. Built with ShipSwift.

    Indexed GitHub, signerlabs 1,773 ★Updated 2 days ago

    git clone https://github.com/signerlabs/Klee.git
  4. nativ

    AI repositories

    Nativ is an open-source local AI app for Mac. It runs open AI models on Apple Silicon, and nothing leaves your Mac.

    Indexed GitHub, Neywa-Labs 1,591 ★MITUpdated yesterday

    git clone https://github.com/Neywa-Labs/nativ.git
  5. SiliconScope

    AI repositories

    Sudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking

    Stale GitHub, kennss 1,013 ★MITUpdated 14 days ago

    git clone https://github.com/kennss/SiliconScope.git
  6. text generation model by Jiunsong

    Stale Hugging Face Hub, Jiunsong 1,004 ♥gemmaUpdated 7 months ago

    Jiunsong/supergemma4-26b-uncensored-gguf-v2
  7. text generation model by harshatheg · mlx

    Stale Hugging Face Hub, harshatheg 585 ♥apache-2.0Updated 2 months ago

    harshatheg/Qwen-2.5-1B-RLCD
  8. mlx-serve

    AI repositories

    Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.

    Indexed GitHub, ddalcu 2,475 ★Custom licence (see repository)Updated today

    git clone https://github.com/ddalcu/mlx-serve.git
  9. turbo-fieldfare

    AI repositories

    Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

    Stale GitHub, drumih 6,930 ★Apache-2.0Updated 33 days ago

    git clone https://github.com/drumih/turbo-fieldfare.git
  10. apple-silicon-llm-bench

    Datasets & benchmarks

    Reproducible on-device LLM benchmarks for Apple Silicon (iPhone 17 Pro, M4 Max): Apple Core AI, MLX, llama.cpp, LiteRT-LM and Core ML on the same model and harness, every number with its quantization and capture session; hybrid Mamba-2 models (Nemotron-3 Nano, Granite-4.0-H, Falcon-H1) included.

    Indexed GitHub, john-rocky 73 ★MITUpdated today

    git clone https://github.com/john-rocky/apple-silicon-llm-bench.git
  11. Phonon-2

    Models

    automatic speech recognition model by FermionResearch · mlx

    Stale Hugging Face Hub, FermionResearch 370 ♥cc-by-4.0Updated 24 days ago

    FermionResearch/Phonon-2
  12. mlx-vlm

    AI repositories

    MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.

    Indexed GitHub, Neywa-Labs 5,848 ★MITUpdated yesterday

    git clone https://github.com/Neywa-Labs/mlx-vlm.git
  13. vllm-mlx

    AI repositories

    High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.

    Stale GitHub, waybarrios 1,646 ★Apache-2.0Updated 11 days ago

    git clone https://github.com/waybarrios/vllm-mlx.git
  14. inferssd

    AI repositories

    Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.

    Indexed GitHub, wici-ai 1,025 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/wici-ai/inferssd.git
  15. automatic speech recognition model by moondream

    Stale Hugging Face Hub, moondream 301 ♥cc-by-4.0Updated 54 days ago

    moondream/parakeet-redux
  16. image text to text model by orcarouter · mlx

    Indexed Hugging Face Hub, orcarouter 1,657 ♥apache-2.0Updated 20 days ago

    orcarouter/Qwen3.8-27B-Uncensored-MLX
  17. Six local Rust tools for evidence digests, signature checks, keys and schemas on Apple Silicon.

    Stale Official MCP Registry, io.github.dengyier Updated 6 days ago 1 note

    https://github.com/dengyier/OpenWorkProof/releases/download/rust-v0.1.0/openworkproof-rust-macos-arm64.mcpb
  18. apfel

    AI repositories

    The free AI already on your Mac. CLI tool, OpenAI-compatible server, and interactive chat — all on-device via Apple Intelligence. No API keys, no cloud, no downloads.

    Stale GitHub, Arthur-Ficial 6,477 ★MITUpdated 33 days ago

    git clone https://github.com/Arthur-Ficial/apfel.git
  19. text generation model by antirez · gguf

    Stale Hugging Face Hub, antirez 485 ♥mitUpdated 2 months ago

    antirez/deepseek-v4-gguf
  20. tiny-llm

    AI repositories

    learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen

    Stale GitHub, skyzh 5,680 ★Apache-2.0Updated 9 days ago

    git clone https://github.com/skyzh/tiny-llm.git
  21. automatic speech recognition model by ConwayResearch · transformers

    Stale Hugging Face Hub, ConwayResearch 86 ♥cc-by-4.0Updated 32 days ago

    ConwayResearch/Underdog-Bark-3.0
  22. image-to-3dlab

    AI repositories

    AssetFurnace: the most complete open-source image-to-3D pipeline (Oct 2026). Prompt or picture → textured, rigged, animated game character, locally on Apple Silicon or NVIDIA. Pixal3D, TRELLIS.2, Hunyuan3D, SF3D, auto-rig and 21 moves. For indie game devs and 3D artists. Free, Apache-2.0.

    Indexed GitHub, Bingeljell 1,197 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/Bingeljell/image-to-3dlab.git
  23. text generation model by apetersson · mlx

    Stale Hugging Face Hub, apetersson 23 ♥mitUpdated 15 days ago

    apetersson/DeepSeek-V4.1-Flash-1017-Abliterated-MLX
  24. automatic speech recognition model by ConwayResearch · transformers

    Stale Hugging Face Hub, ConwayResearch 69 ♥cc-by-4.0Updated 32 days ago

    ConwayResearch/Underdog-Bark-3.0-Clean

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.