Soup
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
Open the source (opens github.com) https://github.com/makazhanalpamys/soup
What it is
AI repositories from MakazhanAlpamys.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Get the code
git clone https://github.com/MakazhanAlpamys/Soup.git
Standard git access to a public repository
Setup steps: not provided by the source. Follow the instructions on the source.
Related
-
oumi
AI repositoriesEasily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!
git clone https://github.com/oumi-ai/oumi.git -
MedicalGPT
AI repositoriesMedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline. 训练医疗大模型,实现了包括增量预训练(PT)、有监督微调(SFT)、RLHF、DPO、ORPO、GRPO。
git clone https://github.com/shibing624/MedicalGPT.git -
peft
AI repositories🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
git clone https://github.com/huggingface/peft.git -
easy-dataset
AI repositoriesA powerful tool for creating datasets for LLM fine-tuning 、RAG and Eval
git clone https://github.com/ConardLi/easy-dataset.git -
LlamaFactory
AI repositoriesUnified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
git clone https://github.com/hiyouga/LlamaFactory.git -
llm-beginner
AI repositories《大模型与智能体》电子书与 6 个编程任务:Transformer、mini-GPT、SFT/DPO、RAG、工具调用与编程智能体。
git clone https://github.com/nndl/llm-beginner.git