bitsandbytes
Accessible large language models via k-bit quantization for PyTorch.
Open the source (opens github.com) https://github.com/bitsandbytes-foundation/bitsandbytes
What it is
AI repositories from bitsandbytes-foundation.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Get the code
git clone https://github.com/bitsandbytes-foundation/bitsandbytes.git
Standard git access to a public repository
Setup steps: not provided by the source. Follow the instructions on the source.
Related
-
Soup
AI repositoriesFine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
git clone https://github.com/MakazhanAlpamys/Soup.git -
ml-engineering
AI repositoriesMachine Learning Engineering Open Book
git clone https://github.com/stas00/ml-engineering.git -
Jackrong-llm-finetuning-guide
AI repositoriesgit clone https://github.com/R6410418/Jackrong-llm-finetuning-guide.git -
LLMs-from-scratch
AI repositoriesImplement a ChatGPT-like LLM in PyTorch from scratch, step by step
git clone https://github.com/rasbt/LLMs-from-scratch.git -
transformers
AI repositories🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
git clone https://github.com/huggingface/transformers.git -
higgsfield
AI repositoriesFault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters
git clone https://github.com/higgsfield-ai/higgsfield.git