InnerVault

bitsandbytes

Stale GitHub, bitsandbytes-foundation

Accessible large language models via k-bit quantization for PyTorch.

Open the source (opens github.com) https://github.com/bitsandbytes-foundation/bitsandbytes

What it is

AI repositories from bitsandbytes-foundation.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/bitsandbytes-foundation/bitsandbytes.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. Soup

    AI repositories

    Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

    Stale GitHub, MakazhanAlpamys 10.3k ★Apache-2.0Updated 9 days ago

    git clone https://github.com/MakazhanAlpamys/Soup.git
  2. ml-engineering

    AI repositories

    Machine Learning Engineering Open Book

    Stale GitHub, stas00 19.7k ★CC-BY-SA-4.0Updated 12 days ago

    git clone https://github.com/stas00/ml-engineering.git
  3. Indexed GitHub, R6410418 1,750 ★Apache-2.0Updated today

    git clone https://github.com/R6410418/Jackrong-llm-finetuning-guide.git
  4. LLMs-from-scratch

    AI repositories

    Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

    Stale GitHub, rasbt 108.3k ★Custom licence (see repository)Updated 7 days ago

    git clone https://github.com/rasbt/LLMs-from-scratch.git
  5. transformers

    AI repositories

    🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

    Indexed GitHub, huggingface 169.0k ★Apache-2.0Updated today

    git clone https://github.com/huggingface/transformers.git
  6. higgsfield

    AI repositories

    Fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters

    Stale GitHub, higgsfield-ai 6,021 ★Apache-2.0Updated 40 days ago

    git clone https://github.com/higgsfield-ai/higgsfield.git