InnerVault

Library

85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.

Results

  1. vllm-metal

    AI repositories

    Community maintained hardware plugin for vLLM on Apple Silicon

    Stale GitHub, vllm-project 1,987 ★Apache-2.0Updated 4 days ago

    git clone https://github.com/vllm-project/vllm-metal.git
  2. tt-metal

    AI repositories

    :metal: TT-NN operator library, and TT-Metalium low level kernel programming model.

    Stale GitHub, tenstorrent 1,747 ★Apache-2.0Updated 8 days ago

    git clone https://github.com/tenstorrent/tt-metal.git
  3. uzu

    AI repositories

    A high-performance inference engine for AI models

    Indexed GitHub, trymirai 3,351 ★MITUpdated today

    git clone https://github.com/trymirai/uzu.git
  4. turbo-fieldfare

    AI repositories

    Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

    Stale GitHub, drumih 6,930 ★Apache-2.0Updated 33 days ago

    git clone https://github.com/drumih/turbo-fieldfare.git
  5. TensorFold

    AI repositories

    LLM Inference Engine for Metal, CUDA and Vulkan.

    Indexed GitHub, ashhart 2,266 ★Apache-2.0Updated today

    git clone https://github.com/ashhart/TensorFold.git
  6. inferssd

    AI repositories

    Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.

    Indexed GitHub, wici-ai 1,025 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/wici-ai/inferssd.git
  7. larql

    AI repositories

    Run, serve, query and edit AI models — a Rust model runtime built on VINDEX3, an executable, inspectable model format.

    Indexed GitHub, chrishayuk 1,175 ★Apache-2.0Updated yesterday

    git clone https://github.com/chrishayuk/larql.git
  8. Fabric

    AI repositories

    Node Creative Coding / 3D / Image Processing tool inspired by Quartz Composer

    Stale GitHub, Fabric-Project 605 ★BSD-3-ClauseUpdated 9 days ago

    git clone https://github.com/Fabric-Project/Fabric.git
  9. SwiftLM

    AI repositories

    ⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.

    Indexed GitHub, SharpAI 799 ★MITUpdated today

    git clone https://github.com/SharpAI/SwiftLM.git
  10. yzma

    AI repositories

    Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.

    Stale GitHub, hybridgroup 652 ★Custom licence (see repository)Updated 32 days ago

    git clone https://github.com/hybridgroup/yzma.git
  11. slotstream

    AI repositories

    Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.

    Indexed GitHub, carloslfu 673 ★MITUpdated today

    git clone https://github.com/carloslfu/slotstream.git
  12. Wax

    AI repositories

    Shared Single-file memory layer for all your agents, sub mili-second RAG over text, photo and video on Apple Silicon.. No Server. No API. One File. Pure Swift

    Indexed GitHub, christopherkarani 810 ★Apache-2.0Updated yesterday

    git clone https://github.com/christopherkarani/Wax.git
  13. TensorSharp

    AI repositories

    A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, iPhone App, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/iOS/Linux with full GPU capability

    Stale GitHub, zhongkaifu 675 ★BSD-3-ClauseUpdated 4 days ago

    git clone https://github.com/zhongkaifu/TensorSharp.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.