InnerVault

Soup

Stale GitHub, MakazhanAlpamys

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

Open the source (opens github.com) https://github.com/makazhanalpamys/soup

What it is

AI repositories from MakazhanAlpamys.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/MakazhanAlpamys/Soup.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. oumi

    AI repositories

    Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!

    Stale GitHub, oumi-ai 9,408 ★Apache-2.0Updated 24 days ago

    git clone https://github.com/oumi-ai/oumi.git
  2. MedicalGPT

    AI repositories

    MedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline. 训练医疗大模型,实现了包括增量预训练(PT)、有监督微调(SFT)、RLHF、DPO、ORPO、GRPO。

    Stale GitHub, shibing624 5,861 ★Apache-2.0Updated 2 months ago

    git clone https://github.com/shibing624/MedicalGPT.git
  3. peft

    AI repositories

    🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

    Indexed GitHub, huggingface 21.9k ★Apache-2.0Updated yesterday

    git clone https://github.com/huggingface/peft.git
  4. easy-dataset

    AI repositories

    A powerful tool for creating datasets for LLM fine-tuning 、RAG and Eval

    Stale GitHub, ConardLi 15.0k ★Custom licence (see repository)Updated 6 months ago

    git clone https://github.com/ConardLi/easy-dataset.git
  5. LlamaFactory

    AI repositories

    Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

    Indexed GitHub, hiyouga 76.1k ★Apache-2.0Updated today

    git clone https://github.com/hiyouga/LlamaFactory.git
  6. llm-beginner

    AI repositories

    《大模型与智能体》电子书与 6 个编程任务:Transformer、mini-GPT、SFT/DPO、RAG、工具调用与编程智能体。

    Stale GitHub, nndl 6,816 ★MITUpdated 2 months ago

    git clone https://github.com/nndl/llm-beginner.git