InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. LMCache

    AI repositories

    LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

    Indexed GitHub, LMCache 12.4k ★Apache-2.0Updated 2 days ago

    git clone https://github.com/LMCache/LMCache.git
  2. gpustack

    AI repositories

    A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

    Indexed GitHub, gpustack 6,039 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/gpustack/gpustack.git
  3. strix-halo-guide

    Datasets & benchmarks

    Evidence-backed AMD Strix Halo local-AI setup and benchmarks: Qwen3.8, Ollama, llama.cpp, Vulkan/ROCm, large GGUFs, and cross-OEM results.

    Stale GitHub, hogeheer499-commits 373 ★MITUpdated 7 days ago

    git clone https://github.com/hogeheer499-commits/strix-halo-guide.git
  4. lemonade

    MCP servers

    Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

    Indexed GitHub, lemonade-sdk 6,222 ★Apache-2.0Updated today

    git clone https://github.com/lemonade-sdk/lemonade.git
  5. Hyperloom

    Agents & frameworks

    An agentic system that auto-optimizes LLM workloads on AMD GPUs.

    Stale GitHub, AMD-AGI 269 ★Custom licence (see repository)Updated 4 days ago

    git clone https://github.com/AMD-AGI/Hyperloom.git
  6. yzma

    AI repositories

    Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.

    Stale GitHub, hybridgroup 652 ★Custom licence (see repository)Updated 32 days ago

    git clone https://github.com/hybridgroup/yzma.git
  7. halogen-flash-server

    AI repositories

    Local inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models, over the OpenAI and Anthropic APIs on one port.

    Stale GitHub, peonist-ai 1,258 ★Custom licence (see repository)Updated 8 days ago

    git clone https://github.com/peonist-ai/halogen-flash-server.git
  8. z-image-studio

    MCP servers

    A Cli, a webUI, and a MCP server for the Z-Image-Turbo text-to-image generation model (Tongyi-MAI/Z-Image-Turbo base model as well as quantized models)

    Stale GitHub, iconben 128 ★Apache-2.0Updated 25 days ago

    git clone https://github.com/iconben/z-image-studio.git
  9. project-maya

    AI repositories

    Project Maya - run GLM-5.3-Flash (321B MoE), DeepSeek-V4.1-Flash-1017 (748B MoE) and MiniMax-M3.1-Flash (428B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools.

    Stale GitHub, mw00 2,482 ★MITUpdated 12 days ago

    git clone https://github.com/mw00/project-maya.git
  10. FastFlowLM

    AI repositories

    Run LLMs on AMD Ryzen™ AI NPUs in minutes; purpose-built and deeply optimized for the AMD NPUs.

    Indexed GitHub, ROCm 2,053 ★Custom licence (see repository)Updated today

    git clone https://github.com/ROCm/FastFlowLM.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.