InnerVault

vllm-mlx

Stale GitHub, waybarrios

High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.

Open the source (opens github.com) https://github.com/waybarrios/vllm-mlx

What it is

AI repositories from waybarrios.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/waybarrios/vllm-mlx.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. mlx-serve

    AI repositories

    Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.

    Indexed GitHub, ddalcu 2,475 ★Custom licence (see repository)Updated today

    git clone https://github.com/ddalcu/mlx-serve.git
  2. slotstream

    AI repositories

    Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.

    Indexed GitHub, carloslfu 673 ★MITUpdated today

    git clone https://github.com/carloslfu/slotstream.git
  3. ai-coding-welfare

    AI repositories

    AI Coding 福利站导航:免费白嫖 Claude Code / Codex 的中转站与公益站合集,含额度、模型、价格自动更新与一键配置脚本

    Indexed GitHub, panxunying 1,343 ★MITUpdated today

    git clone https://github.com/panxunying/ai-coding-welfare.git
  4. axonhub

    AI repositories

    ⚡️ Open-source AI Gateway — Use any SDK to call 100+ LLMs. Built-in failover, load balancing, cost control & end-to-end tracing.

    Indexed GitHub, looplj 5,457 ★Apache-2.0Updated yesterday

    git clone https://github.com/looplj/axonhub.git
  5. gpt-load

    AI repositories

    Self-hosted AI gateway for multi-channel, multi-credential setups — API keys and subscription accounts, scheduling, failover, request logs and usage. 自托管 AI 网关:多渠道多凭据统一接入,含密钥与订阅账号、调度容错、日志与用量。

    Stale GitHub, tbphp 7,199 ★MITUpdated 8 days ago

    git clone https://github.com/tbphp/gpt-load.git
  6. CliRelay

    AI repositories

    Self-hosted AI gateway for coding CLIs — one OpenAI/Claude/Gemini/Codex-compatible endpoint, with a multi-tenant web console, request logs, and spend quotas.

    Indexed GitHub, kittors 1,053 ★MITUpdated 3 days ago

    git clone https://github.com/kittors/CliRelay.git