InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

Looks like a goal we have a starting path for: I want to connect AI to my tools

  1. mlx-serve

    AI repositories

    Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.

    Indexed GitHub, ddalcu 2,475 ★Custom licence (see repository)Updated today

    git clone https://github.com/ddalcu/mlx-serve.git
  2. ai-coding-welfare

    AI repositories

    AI Coding 福利站导航:免费白嫖 Claude Code / Codex 的中转站与公益站合集,含额度、模型、价格自动更新与一键配置脚本

    Indexed GitHub, panxunying 1,343 ★MITUpdated today

    git clone https://github.com/panxunying/ai-coding-welfare.git
  3. axonhub

    AI repositories

    ⚡️ Open-source AI Gateway — Use any SDK to call 100+ LLMs. Built-in failover, load balancing, cost control & end-to-end tracing.

    Indexed GitHub, looplj 5,457 ★Apache-2.0Updated yesterday

    git clone https://github.com/looplj/axonhub.git
  4. smg

    AI repositories

    Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

    Indexed GitHub, smg-project 723 ★Apache-2.0Updated today

    git clone https://github.com/smg-project/smg.git
  5. llmgateway

    AI repositories

    Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.

    Indexed GitHub, theopenco 1,743 ★Custom licence (see repository)Updated today

    git clone https://github.com/theopenco/llmgateway.git
  6. gpt-load

    AI repositories

    Self-hosted AI gateway for multi-channel, multi-credential setups — API keys and subscription accounts, scheduling, failover, request logs and usage. 自托管 AI 网关:多渠道多凭据统一接入,含密钥与订阅账号、调度容错、日志与用量。

    Stale GitHub, tbphp 7,199 ★MITUpdated 8 days ago

    git clone https://github.com/tbphp/gpt-load.git
  7. OlliteRT

    AI repositories

    Turn your Android phone into an OpenAI-compatible LLM inference server - Fully local, private and Open Source

    Stale GitHub, NightMean 597 ★Apache-2.0Updated 15 days ago

    git clone https://github.com/NightMean/OlliteRT.git
  8. CliRelay

    AI repositories

    Self-hosted AI gateway for coding CLIs — one OpenAI/Claude/Gemini/Codex-compatible endpoint, with a multi-tenant web console, request logs, and spend quotas.

    Indexed GitHub, kittors 1,053 ★MITUpdated 3 days ago

    git clone https://github.com/kittors/CliRelay.git
  9. PolyStrata

    AI repositories

    Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and MiniCPM-V on a second engine written for PolyStrata. One-click install for Windows and Linux, OpenAI/Anthropic API on localhost.

    Stale GitHub, VecSzn 722 ★MITUpdated 16 days ago

    git clone https://github.com/VecSzn/PolyStrata.git
  10. otari

    AI repositories

    Open-source AI gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.

    Indexed GitHub, mozilla-ai 927 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/mozilla-ai/otari.git
  11. vllm-mlx

    AI repositories

    High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.

    Stale GitHub, waybarrios 1,646 ★Apache-2.0Updated 11 days ago

    git clone https://github.com/waybarrios/vllm-mlx.git
  12. BricksLLM

    AI repositories

    🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.

    Stale GitHub, bricks-cloud 1,230 ★MITUpdated 22 months ago

    git clone https://github.com/bricks-cloud/BricksLLM.git
  13. antirion

    AI repositories

    🕷️ The fastest open-source AI Gateway and LLM Gateway — one binary with built-in console to route, secure, budget and observe every LLM call across OpenAI, Anthropic, Gemini, Bedrock and more.

    Stale GitHub, eliasbiondo 501 ★Apache-2.0Updated 17 days ago

    git clone https://github.com/eliasbiondo/antirion.git
  14. halogen-flash-server

    AI repositories

    Local inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models, over the OpenAI and Anthropic APIs on one port.

    Stale GitHub, peonist-ai 1,258 ★Custom licence (see repository)Updated 8 days ago

    git clone https://github.com/peonist-ai/halogen-flash-server.git
  15. slotstream

    AI repositories

    Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.

    Indexed GitHub, carloslfu 673 ★MITUpdated today

    git clone https://github.com/carloslfu/slotstream.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.