Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
FastFlowLM
AI repositoriesRun LLMs on AMD Ryzen™ AI NPUs in minutes; purpose-built and deeply optimized for the AMD NPUs.
git clone https://github.com/ROCm/FastFlowLM.git -
VKORE-46M-NPU
Modelstext generation model by FINAL-Bench · transformers
FINAL-Bench/VKORE-46M-NPU -
MasterAgent
Agents & frameworksBuild AI agents that run 100% on-device. Sub-100ms latency on Qualcomm NPU. Zero cloud dependency.
git clone https://github.com/OpenSparX/MasterAgent.git -
lemonade
MCP serversLemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
git clone https://github.com/lemonade-sdk/lemonade.git -
ascend-sleuth
Skills昇腾 NPU 训练与推理故障诊断知识库:按症状命中 case、用先验知识与源码分析定位根因,定位后进待审队列、每周升格回库。
git clone https://github.com/pillumina/ascend-sleuth.git -
turnkeyml
Datasets & benchmarksNo-code CLI designed for accelerating ONNX workflows
git clone https://github.com/onnx/turnkeyml.git -
npubmail
MCP serversEmail inbox for AI agents, owned by a Nostr key. No signup or API key. Receive codes, read, send.
https://github.com/obvioussummer46/npubmail/releases/download/v0.2.1/npubmail-mcp-0.2.1.mcpb@0.2.1 -
torch-rechub
AI repositoriesA Lighting Pytorch Framework for Recommendation Models, Easy-to-use and Easy-to-extend.
git clone https://github.com/datawhalechina/torch-rechub.git -
litert-samples
AI repositoriesLiteRT and LiteRT-LM sample apps, model recipes, agent skills and utilities.
git clone https://github.com/google-ai-edge/litert-samples.git -
ai-dev-gallery
Tools & appsAn open-source project for Windows developers to learn how to add AI with local models and APIs to Windows apps.
git clone https://github.com/microsoft/ai-dev-gallery.git -
qwen38-strix-halo-harness
Datasets & benchmarksAI coding agent harness for any hardware, local or cloud (OpenAI-compatible engines). Tuned for AMD Strix Halo: Qwen3.8 125B on the iGPU, NPU side-jobs, crash recovery, logged benchmarks.
git clone https://github.com/aic0d3r/qwen38-strix-halo-harness.git -
GenieX
AI repositoriesRun frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code
git clone https://github.com/qualcomm/GenieX.git -
taOS
Agents & frameworksSelf-hosted AI agent OS. Your memory, chat, agents, and files stay on hardware you own, offline by default, cloud by choice. Offline AI memory (taOSmd), self-hosted multi-framework group chat, a full web desktop + app store, and auto-clustering across the consumer hardware you already have (Orange/Raspberry Pi, Mac mini, gaming PC).
git clone https://github.com/jaylfc/taOS.git -
halogen-flash-server
AI repositoriesLocal inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models, over the OpenAI and Anthropic APIs on one port.
git clone https://github.com/peonist-ai/halogen-flash-server.git -
agency-mcp-server
MCP serversOn-demand access to 150+ specialist AI agent templates — search, browse, and spawn agents
agency-mcp-server@0.2.2 -
ipex-llm
AI repositoriesAccelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.
git clone https://github.com/intel/ipex-llm.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.