airllm
AirLLM 2.8T LLM inference with single 4GB GPU
Open the source (opens github.com) https://github.com/lyogavin/airllm
What it is
AI repositories from lyogavin.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Get the code
git clone https://github.com/lyogavin/airllm.git
Standard git access to a public repository
Setup steps: not provided by the source. Follow the instructions on the source.
Related
-
LLMs-from-scratch
AI repositoriesImplement a ChatGPT-like LLM in PyTorch from scratch, step by step
git clone https://github.com/rasbt/LLMs-from-scratch.git -
END-TO-END-GENERATIVE-AI-PROJECTS
AI repositoriesEnd to End Generative AI Industry Projects on LLM Models with Deployment_Awesome LLM Projects
git clone https://github.com/GURPREETKAURJETHRA/END-TO-END-GENERATIVE-AI-PROJECTS.git -
h2o-llmstudio
AI repositoriesH2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/
git clone https://github.com/h2oai/h2o-llmstudio.git -
awesome-pretrained-chinese-nlp-models
AI repositoriesAwesome Pretrained Chinese NLP Models,高质量中文预训练模型&大模型&多模态模型&大语言模型集合
git clone https://github.com/lonePatient/awesome-pretrained-chinese-nlp-models.git -
Awesome-Chinese-LLM
AI repositories整理开源的中文大语言模型,以规模较小、可私有化部署、训练成本较低的模型为主,包括底座模型,垂直领域微调及应用,数据集与教程等。
git clone https://github.com/AiHubCN/Awesome-Chinese-LLM.git -
xTuring
AI repositoriesBuild, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6
git clone https://github.com/stochasticai/xTuring.git