FastFlowLM
Run LLMs on AMD Ryzen™ AI NPUs in minutes; purpose-built and deeply optimized for the AMD NPUs.
Open the source (opens github.com) https://github.com/rocm/fastflowlm
What it is
AI repositories from ROCm.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Get the code
git clone https://github.com/ROCm/FastFlowLM.git
Standard git access to a public repository
Setup steps: not provided by the source. Follow the instructions on the source.
Related
-
vllm
AI repositoriesA high-throughput and memory-efficient inference and serving engine for LLMs
git clone https://github.com/vllm-project/vllm.git -
project-maya
AI repositoriesProject Maya - run GLM-5.3-Flash (321B MoE), DeepSeek-V4.1-Flash-1017 (748B MoE) and MiniMax-M3.1-Flash (428B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools.
git clone https://github.com/mw00/project-maya.git -
LlamaFactory
AI repositoriesUnified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
git clone https://github.com/hiyouga/LlamaFactory.git -
unsloth
AI repositoriesLocal UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.
git clone https://github.com/unslothai/unsloth.git -
all-in-rag
AI repositories🔍大模型应用开发实战一:RAG 技术全栈指南,在线阅读地址:https://datawhalechina.github.io/all-in-rag/
git clone https://github.com/datawhalechina/all-in-rag.git -
sglang
AI repositoriesSGLang is a high-performance serving framework for large language models and multimodal models.
git clone https://github.com/sgl-project/sglang.git