InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. mlx-vlm

    AI repositories

    MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.

    Indexed GitHub, Neywa-Labs 5,848 ★MITUpdated yesterday

    git clone https://github.com/Neywa-Labs/mlx-vlm.git
  2. llmfit

    AI repositories

    Hundreds of models & providers. One command to find what runs on your hardware.

    Stale GitHub, AlexsJones 38.8k ★MITUpdated 7 days ago

    git clone https://github.com/AlexsJones/llmfit.git
  3. vllm-mlx

    AI repositories

    High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.

    Stale GitHub, waybarrios 1,646 ★Apache-2.0Updated 11 days ago

    git clone https://github.com/waybarrios/vllm-mlx.git
  4. mlx-serve

    AI repositories

    Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.

    Indexed GitHub, ddalcu 2,475 ★Custom licence (see repository)Updated today

    git clone https://github.com/ddalcu/mlx-serve.git
  5. Bonsai-demo

    AI repositories

    Bonsai Demo

    Stale GitHub, PrismML-Eng 3,485 ★Apache-2.0Updated 11 days ago

    git clone https://github.com/PrismML-Eng/Bonsai-demo.git
  6. omlx

    AI repositories

    LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

    Indexed GitHub, jundot 23.7k ★Apache-2.0Updated today

    git clone https://github.com/jundot/omlx.git
  7. Klee

    AI repositories

    A native macOS AI chat app powered by MLX. 100% local inference on Apple Silicon, no cloud required. Built with ShipSwift.

    Indexed GitHub, signerlabs 1,773 ★Updated 2 days ago

    git clone https://github.com/signerlabs/Klee.git
  8. vllm-metal

    AI repositories

    Community maintained hardware plugin for vLLM on Apple Silicon

    Stale GitHub, vllm-project 1,987 ★Apache-2.0Updated 4 days ago

    git clone https://github.com/vllm-project/vllm-metal.git
  9. SwiftLM

    AI repositories

    ⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.

    Indexed GitHub, SharpAI 799 ★MITUpdated today

    git clone https://github.com/SharpAI/SwiftLM.git
  10. openmed

    AI repositories

    Local-first healthcare AI: clinical NER and HIPAA PII de-identification on hardware you control. 2,200+ medical models, 35 model-backed PII languages, and Python, MLX, Android and browser runtimes. Apache-2.0 SDK.

    Stale GitHub, maziyarpanahi 5,784 ★Apache-2.0Updated 9 days ago

    git clone https://github.com/maziyarpanahi/openmed.git
  11. llmman

    AI repositories

    Run any agent on any model, models stored as OCI images

    Indexed GitHub, llmmanorg 590 ★Apache-2.0Updated yesterday

    git clone https://github.com/llmmanorg/llmman.git
  12. nativ

    AI repositories

    Nativ is an open-source local AI app for Mac. It runs open AI models on Apple Silicon, and nothing leaves your Mac.

    Indexed GitHub, Neywa-Labs 1,591 ★MITUpdated yesterday

    git clone https://github.com/Neywa-Labs/nativ.git
  13. Fabric

    AI repositories

    Node Creative Coding / 3D / Image Processing tool inspired by Quartz Composer

    Stale GitHub, Fabric-Project 605 ★BSD-3-ClauseUpdated 9 days ago

    git clone https://github.com/Fabric-Project/Fabric.git
  14. SiliconScope

    AI repositories

    Sudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking

    Stale GitHub, kennss 1,013 ★MITUpdated 14 days ago

    git clone https://github.com/kennss/SiliconScope.git
  15. inference

    AI repositories

    Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.

    Indexed GitHub, xorbitsai 9,660 ★Apache-2.0Updated today

    git clone https://github.com/xorbitsai/inference.git
  16. slotstream

    AI repositories

    Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.

    Indexed GitHub, carloslfu 673 ★MITUpdated today

    git clone https://github.com/carloslfu/slotstream.git
  17. Atomic-Chat

    AI repositories

    Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V

    Stale GitHub, AtomicBot-ai 1,808 ★Custom licence (see repository)Updated 30 days ago

    git clone https://github.com/AtomicBot-ai/Atomic-Chat.git
  18. unsloth

    AI repositories

    Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.

    Indexed GitHub, unslothai 79.6k ★Apache-2.0Updated today

    git clone https://github.com/unslothai/unsloth.git
  19. flama

    AI repositories

    The production framework for Predictive and Generative AI. Serve any model as an API in one line, with OpenAI/Anthropic/Ollama-compatible endpoints, a built-in chat UI, and native MCP.

    Indexed GitHub, vortico 307 ★Apache-2.0Updated 2 days ago

    git clone https://github.com/vortico/flama.git
  20. image-to-3dlab

    AI repositories

    AssetFurnace: the most complete open-source image-to-3D pipeline (Oct 2026). Prompt or picture → textured, rigged, animated game character, locally on Apple Silicon or NVIDIA. Pixal3D, TRELLIS.2, Hunyuan3D, SF3D, auto-rig and 21 moves. For indie game devs and 3D artists. Free, Apache-2.0.

    Indexed GitHub, Bingeljell 1,197 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/Bingeljell/image-to-3dlab.git
  21. libratory

    AI repositories

    Your free book and audiobook laboratory. Turn the PDFs you own into chapter-marked M4B audiobooks, read-along books and bilingual editions, on your own machine. Local TTS, AI cleanup and translations, an assistant that runs the library, chat with cited sources. Apple Silicon Mac, Linux, or one Docker container on a headless server.

    Stale GitHub, subev 141 ★Custom licence (see repository)Updated 10 days ago

    git clone https://github.com/subev/libratory.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.