MNN
MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.
Open the source (opens github.com) https://github.com/alibaba/mnn
What it is
AI repositories from alibaba.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Get the code
git clone https://github.com/alibaba/MNN.git
Standard git access to a public repository
Setup steps: not provided by the source. Follow the instructions on the source.
Related
-
oneDNN
AI repositoriesOpen-source library of optimized deep learning operations (matmul, convolution, attention) for CPUs (x64, AArch64, RISC-V) and Intel GPUs. Used by PyTorch, TensorFlow, OpenVINO, and ONNX Runtime.
git clone https://github.com/uxlfoundation/oneDNN.git -
Operit
AI repositoriesThe most powerful AI agent and AI chat software on Android/Operit是一款Android上能力最为强大、发展最久的AI Agent
git clone https://github.com/AAswordman/Operit.git -
computer-vision-course
AI repositoriesThis repo is the homebase of a community driven course on Computer Vision with Neural Networks. Feel free to join us on the Hugging Face discord: hf.co/join/discord
git clone https://github.com/huggingface/computer-vision-course.git -
engine
AI repositories2bit quants, kernels and runtime for consumer devices.
git clone https://github.com/cactus-compute/engine.git -
nano-vllm
AI repositoriesNano vLLM
git clone https://github.com/GeeeekExplorer/nano-vllm.git -
web-llm
AI repositoriesHigh-performance In-browser LLM Inference Engine
git clone https://github.com/mlc-ai/web-llm.git