InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

Looks like a goal we have a starting path for: I want to connect AI to my tools

  1. omlx

    AI repositories

    LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

    Indexed GitHub, jundot 23.7k ★Apache-2.0Updated today

    git clone https://github.com/jundot/omlx.git
  2. sie

    AI repositories

    Open-source inference server and production cluster for all the models your agent needs.

    Indexed GitHub, superlinked 3,517 ★Apache-2.0Updated yesterday

    git clone https://github.com/superlinked/sie.git
  3. GenerativeAIExamples

    AI repositories

    Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.

    Stale GitHub, NVIDIA 4,210 ★Apache-2.0Updated 2 months ago

    git clone https://github.com/NVIDIA/GenerativeAIExamples.git
  4. vllm-mlx

    AI repositories

    High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.

    Stale GitHub, waybarrios 1,646 ★Apache-2.0Updated 11 days ago

    git clone https://github.com/waybarrios/vllm-mlx.git
  5. ramalama

    AI repositories

    RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.

    Stale GitHub, containers 3,097 ★MITUpdated 16 days ago

    git clone https://github.com/containers/ramalama.git
  6. OlliteRT

    AI repositories

    Turn your Android phone into an OpenAI-compatible LLM inference server - Fully local, private and Open Source

    Stale GitHub, NightMean 597 ★Apache-2.0Updated 15 days ago

    git clone https://github.com/NightMean/OlliteRT.git
  7. SwiftLM

    AI repositories

    ⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.

    Indexed GitHub, SharpAI 799 ★MITUpdated today

    git clone https://github.com/SharpAI/SwiftLM.git
  8. mlx-serve

    AI repositories

    Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.

    Indexed GitHub, ddalcu 2,475 ★Custom licence (see repository)Updated today

    git clone https://github.com/ddalcu/mlx-serve.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.