InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. FastFlowLM

    AI repositories

    Run LLMs on AMD Ryzen™ AI NPUs in minutes; purpose-built and deeply optimized for the AMD NPUs.

    Indexed GitHub, ROCm 2,053 ★Custom licence (see repository)Updated today

    git clone https://github.com/ROCm/FastFlowLM.git
  2. Hyperloom

    Agents & frameworks

    An agentic system that auto-optimizes LLM workloads on AMD GPUs.

    Stale GitHub, AMD-AGI 269 ★Custom licence (see repository)Updated 4 days ago

    git clone https://github.com/AMD-AGI/Hyperloom.git
  3. LMCache

    AI repositories

    LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

    Indexed GitHub, LMCache 12.4k ★Apache-2.0Updated 2 days ago

    git clone https://github.com/LMCache/LMCache.git
  4. vllm

    AI repositories

    A high-throughput and memory-efficient inference and serving engine for LLMs

    Indexed GitHub, vllm-project 97.0k ★Apache-2.0Updated today

    git clone https://github.com/vllm-project/vllm.git
  5. gufo

    AI repositories

    The open-source AI engine for AMD Strix Halo. Text, embeddings, speech, image and video models in one binary, with OpenAI-compatible APIs, caching for coding agents and model extensions. Linux and Windows.

    Indexed GitHub, gufo-org 1,167 ★MITUpdated 2 days ago

    git clone https://github.com/gufo-org/gufo.git
  6. Amdoren

    Public APIs

    Free currency API with over 150 currencies

    Indexed public-apis (GitHub list)

  7. turnkeyml

    Datasets & benchmarks

    No-code CLI designed for accelerating ONNX workflows

    Stale GitHub, onnx 247 ★Apache-2.0Updated 4 months ago

    git clone https://github.com/onnx/turnkeyml.git
  8. Amdahl

    MCP servers

    Outbound optimization: messages in the sender's voice, and answers from your calls and CRM deals.

    Stale Official MCP Registry, ai.amdahl Updated 11 days ago 1 note

  9. halogen-flash-server

    AI repositories

    Local inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models, over the OpenAI and Anthropic APIs on one port.

    Stale GitHub, peonist-ai 1,258 ★Custom licence (see repository)Updated 8 days ago

    git clone https://github.com/peonist-ai/halogen-flash-server.git
  10. strix-halo-guide

    Datasets & benchmarks

    Evidence-backed AMD Strix Halo local-AI setup and benchmarks: Qwen3.8, Ollama, llama.cpp, Vulkan/ROCm, large GGUFs, and cross-OEM results.

    Stale GitHub, hogeheer499-commits 373 ★MITUpdated 7 days ago

    git clone https://github.com/hogeheer499-commits/strix-halo-guide.git
  11. uccl

    AI repositories

    UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)

    Indexed GitHub, uccl-project 1,585 ★Apache-2.0Updated yesterday

    git clone https://github.com/uccl-project/uccl.git
  12. lemonade

    MCP servers

    Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

    Indexed GitHub, lemonade-sdk 6,222 ★Apache-2.0Updated today

    git clone https://github.com/lemonade-sdk/lemonade.git
  13. ODS

    Agents & frameworks

    ODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or Linux box into a private AI server.

    Indexed GitHub, Osmantic 7,835 ★Apache-2.0Updated today

    git clone https://github.com/Osmantic/ODS.git
  14. dstack

    Skills

    A unified orchestration layer for heterogeneous AI compute. It standardizes how to manage compute and run training and inference on GPU clouds, Kubernetes, VMs, or bare-metal clusters.

    Stale GitHub, dstackai 2,293 ★MPL-2.0Updated 18 days ago

    git clone https://github.com/dstackai/dstack.git
  15. qwen38-strix-halo-harness

    Datasets & benchmarks

    AI coding agent harness for any hardware, local or cloud (OpenAI-compatible engines). Tuned for AMD Strix Halo: Qwen3.8 125B on the iGPU, NPU side-jobs, crash recovery, logged benchmarks.

    Stale GitHub, aic0d3r 38 ★MITUpdated 8 days ago

    git clone https://github.com/aic0d3r/qwen38-strix-halo-harness.git
  16. Vivado MCP Native

    MCP servers

    Native MCP server for controlling AMD/Xilinx Vivado on Windows and Linux via persistent Tcl.

    Stale Official MCP Registry, io.github.Arthurzxy Updated 3 months ago 1 note

    vivado-mcp-native@0.2.1
  17. babelscribe

    MCP servers

    Offline speech-to-text and SRT subtitles in 99 languages on your own AMD/NVIDIA/Intel/Apple GPU.

    Stale Official MCP Registry, io.github.phonology024 Updated 11 days ago 1 note

    babelscribe@0.4.0
  18. Vivado Red MCP

    MCP servers

    Drive AMD Vivado from AI assistants, with Red Pitaya STEMlab 125-14 build and deploy flows.

    Stale Official MCP Registry, io.github.sinemortal Updated 14 days ago 1 note

    vivado-red-mcp@0.5.0
  19. MarvinLabs vram_fit

    MCP servers

    Will a QLoRA fine-tune of gemma-3-4b-it fit your GPU? Verdicts from measured AMD and NVIDIA probes.

    Stale Official MCP Registry, org.marvinlabs Updated 22 days ago 1 note

  20. project-maya

    AI repositories

    Project Maya - run GLM-5.3-Flash (321B MoE), DeepSeek-V4.1-Flash-1017 (748B MoE) and MiniMax-M3.1-Flash (428B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools.

    Stale GitHub, mw00 2,482 ★MITUpdated 12 days ago

    git clone https://github.com/mw00/project-maya.git
  21. self-hosted-ai-stack

    AI repositories

    Deploy a self-hosted AI stack with Docker Compose: local LLMs, chat, document parsing, embeddings, transcription, text-to-speech and MCP tools. Powered by Ollama, LiteLLM, AnythingLLM and more. Local-first with auto-configured authentication, lightweight stacks, optional HTTPS and NVIDIA GPU support. MIT licensed. Multi-arch: amd64, arm64.

    Indexed GitHub, hwdsl2 179 ★MITUpdated yesterday

    git clone https://github.com/hwdsl2/self-hosted-ai-stack.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.