Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
-
vllm-metal
AI repositoriesCommunity maintained hardware plugin for vLLM on Apple Silicon
git clone https://github.com/vllm-project/vllm-metal.git -
tt-metal
AI repositories:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.
git clone https://github.com/tenstorrent/tt-metal.git -
uzu
AI repositoriesA high-performance inference engine for AI models
git clone https://github.com/trymirai/uzu.git -
turbo-fieldfare
AI repositoriesGemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook
git clone https://github.com/drumih/turbo-fieldfare.git -
TensorFold
AI repositoriesLLM Inference Engine for Metal, CUDA and Vulkan.
git clone https://github.com/ashhart/TensorFold.git -
inferssd
AI repositoriesRun models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.
git clone https://github.com/wici-ai/inferssd.git -
larql
AI repositoriesRun, serve, query and edit AI models — a Rust model runtime built on VINDEX3, an executable, inspectable model format.
git clone https://github.com/chrishayuk/larql.git -
Fabric
AI repositoriesNode Creative Coding / 3D / Image Processing tool inspired by Quartz Composer
git clone https://github.com/Fabric-Project/Fabric.git -
SwiftLM
AI repositories⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.
git clone https://github.com/SharpAI/SwiftLM.git -
yzma
AI repositoriesGo with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.
git clone https://github.com/hybridgroup/yzma.git -
slotstream
AI repositoriesRun a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.
git clone https://github.com/carloslfu/slotstream.git -
Wax
AI repositoriesShared Single-file memory layer for all your agents, sub mili-second RAG over text, photo and video on Apple Silicon.. No Server. No API. One File. Pure Swift
git clone https://github.com/christopherkarani/Wax.git -
TensorSharp
AI repositoriesA native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, iPhone App, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/iOS/Linux with full GPU capability
git clone https://github.com/zhongkaifu/TensorSharp.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.