uzu
A high-performance inference engine for AI models
Open the source (opens github.com) https://github.com/trymirai/uzu
What it is
AI repositories from trymirai.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Get the code
git clone https://github.com/trymirai/uzu.git
Standard git access to a public repository
Setup steps: not provided by the source. Follow the instructions on the source.
Related
-
gpustack
AI repositoriesA GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
git clone https://github.com/gpustack/gpustack.git -
rtp-llm
AI repositoriesRTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.
git clone https://github.com/alibaba/rtp-llm.git -
openlake
AI repositoriesOpenLake is a high performance storage engine for efficient LLM inference and GPU Training
git clone https://github.com/openlake-project/openlake.git -
web-llm
AI repositoriesHigh-performance In-browser LLM Inference Engine
git clone https://github.com/mlc-ai/web-llm.git -
litgpt
AI repositories20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
git clone https://github.com/Lightning-AI/litgpt.git -
chitu
AI repositoriesHigh-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.
git clone https://github.com/thu-pacman/chitu.git