InnerVault

MNN

IndexedGitHub, alibaba

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

Open the source (opens github.com) https://github.com/alibaba/mnn

What it is

AI repositories from alibaba.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/alibaba/MNN.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. oneDNN

    AI repositories

    Open-source library of optimized deep learning operations (matmul, convolution, attention) for CPUs (x64, AArch64, RISC-V) and Intel GPUs. Used by PyTorch, TensorFlow, OpenVINO, and ONNX Runtime.

    Indexed GitHub, uxlfoundation 4,094 ★Apache-2.0Updated today

    git clone https://github.com/uxlfoundation/oneDNN.git
  2. Operit

    AI repositories

    The most powerful AI agent and AI chat software on Android/Operit是一款Android上能力最为强大、发展最久的AI Agent

    Stale GitHub, AAswordman 9,195 ★LGPL-3.0Updated 13 days ago

    git clone https://github.com/AAswordman/Operit.git
  3. computer-vision-course

    AI repositories

    This repo is the homebase of a community driven course on Computer Vision with Neural Networks. Feel free to join us on the Hugging Face discord: hf.co/join/discord

    Stale GitHub, huggingface 910 ★MITUpdated 7 days ago

    git clone https://github.com/huggingface/computer-vision-course.git
  4. engine

    AI repositories

    2bit quants, kernels and runtime for consumer devices.

    Stale GitHub, cactus-compute 6,181 ★Custom licence (see repository)Updated 11 days ago

    git clone https://github.com/cactus-compute/engine.git
  5. nano-vllm

    AI repositories

    Nano vLLM

    Stale GitHub, GeeeekExplorer 15.8k ★MITUpdated 6 months ago

    git clone https://github.com/GeeeekExplorer/nano-vllm.git
  6. web-llm

    AI repositories

    High-performance In-browser LLM Inference Engine

    Stale GitHub, mlc-ai 19.3k ★Apache-2.0Updated 36 days ago

    git clone https://github.com/mlc-ai/web-llm.git