GenieX
Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code
Open the source (opens github.com) https://github.com/qualcomm/geniex
What it is
AI repositories from qualcomm.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Get the code
git clone https://github.com/qualcomm/GenieX.git
Standard git access to a public repository
Setup steps: not provided by the source. Follow the instructions on the source.
Related
-
Automodel
AI repositories๐ Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support
git clone https://github.com/NVIDIA-NeMo/Automodel.git -
vllm
AI repositoriesA high-throughput and memory-efficient inference and serving engine for LLMs
git clone https://github.com/vllm-project/vllm.git -
sglang
AI repositoriesSGLang is a high-performance serving framework for large language models and multimodal models.
git clone https://github.com/sgl-project/sglang.git -
xtuner
AI repositoriesA Next-Generation Training Engine Built for Ultra-Large MoE Models
git clone https://github.com/InternLM/xtuner.git -
turbo-fieldfare
AI repositoriesGemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook
git clone https://github.com/drumih/turbo-fieldfare.git -
LLM-Hub
AI repositoriesLocal LLM, image&video&music generator
git clone https://github.com/timmyy123/LLM-Hub.git