InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. FastFlowLM

    AI repositories

    Run LLMs on AMD Ryzen™ AI NPUs in minutes; purpose-built and deeply optimized for the AMD NPUs.

    Indexed GitHub, ROCm 2,053 ★Custom licence (see repository)Updated today

    git clone https://github.com/ROCm/FastFlowLM.git
  2. VKORE-46M-NPU

    Models

    text generation model by FINAL-Bench · transformers

    Stale Hugging Face Hub, FINAL-Bench 27 ♥apache-2.0Updated 27 days ago

    FINAL-Bench/VKORE-46M-NPU
  3. MasterAgent

    Agents & frameworks

    Build AI agents that run 100% on-device. Sub-100ms latency on Qualcomm NPU. Zero cloud dependency.

    Stale GitHub, OpenSparX 965 ★Apache-2.0Updated 49 days ago

    git clone https://github.com/OpenSparX/MasterAgent.git
  4. lemonade

    MCP servers

    Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

    Indexed GitHub, lemonade-sdk 6,222 ★Apache-2.0Updated today

    git clone https://github.com/lemonade-sdk/lemonade.git
  5. ascend-sleuth

    Skills

    昇腾 NPU 训练与推理故障诊断知识库:按症状命中 case、用先验知识与源码分析定位根因,定位后进待审队列、每周升格回库。

    Indexed GitHub, pillumina 6 ★MITUpdated today

    git clone https://github.com/pillumina/ascend-sleuth.git
  6. turnkeyml

    Datasets & benchmarks

    No-code CLI designed for accelerating ONNX workflows

    Stale GitHub, onnx 247 ★Apache-2.0Updated 4 months ago

    git clone https://github.com/onnx/turnkeyml.git
  7. npubmail

    MCP servers

    Email inbox for AI agents, owned by a Nostr key. No signup or API key. Receive codes, read, send.

    Stale Official MCP Registry, com.npubmail Updated 39 days ago 1 note

    https://github.com/obvioussummer46/npubmail/releases/download/v0.2.1/npubmail-mcp-0.2.1.mcpb@0.2.1
  8. torch-rechub

    AI repositories

    A Lighting Pytorch Framework for Recommendation Models, Easy-to-use and Easy-to-extend.

    Stale GitHub, datawhalechina 1,235 ★MITUpdated 18 days ago

    git clone https://github.com/datawhalechina/torch-rechub.git
  9. litert-samples

    AI repositories

    LiteRT and LiteRT-LM sample apps, model recipes, agent skills and utilities.

    Indexed GitHub, google-ai-edge 496 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/google-ai-edge/litert-samples.git
  10. ai-dev-gallery

    Tools & apps

    An open-source project for Windows developers to learn how to add AI with local models and APIs to Windows apps.

    Indexed GitHub, microsoft 1,518 ★MITUpdated today

    git clone https://github.com/microsoft/ai-dev-gallery.git
  11. qwen38-strix-halo-harness

    Datasets & benchmarks

    AI coding agent harness for any hardware, local or cloud (OpenAI-compatible engines). Tuned for AMD Strix Halo: Qwen3.8 125B on the iGPU, NPU side-jobs, crash recovery, logged benchmarks.

    Stale GitHub, aic0d3r 38 ★MITUpdated 8 days ago

    git clone https://github.com/aic0d3r/qwen38-strix-halo-harness.git
  12. GenieX

    AI repositories

    Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code

    Stale GitHub, qualcomm 8,494 ★BSD-3-ClauseUpdated 11 days ago

    git clone https://github.com/qualcomm/GenieX.git
  13. taOS

    Agents & frameworks

    Self-hosted AI agent OS. Your memory, chat, agents, and files stay on hardware you own, offline by default, cloud by choice. Offline AI memory (taOSmd), self-hosted multi-framework group chat, a full web desktop + app store, and auto-clustering across the consumer hardware you already have (Orange/Raspberry Pi, Mac mini, gaming PC).

    Indexed GitHub, jaylfc 608 ★AGPL-3.0Updated yesterday

    git clone https://github.com/jaylfc/taOS.git
  14. halogen-flash-server

    AI repositories

    Local inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models, over the OpenAI and Anthropic APIs on one port.

    Stale GitHub, peonist-ai 1,258 ★Custom licence (see repository)Updated 8 days ago

    git clone https://github.com/peonist-ai/halogen-flash-server.git
  15. agency-mcp-server

    MCP servers

    On-demand access to 150+ specialist AI agent templates — search, browse, and spawn agents

    Stale Official MCP Registry, io.github.npupko Updated 7 months ago 1 note

    agency-mcp-server@0.2.2
  16. ipex-llm

    AI repositories

    Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.

    Stale Archived GitHub, intel 8,846 ★Apache-2.0Updated 9 months ago 1 note

    git clone https://github.com/intel/ipex-llm.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.