InnerVault

LLMs-from-scratch

Stale GitHub, rasbt

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

Open the source (opens github.com) https://github.com/rasbt/llms-from-scratch

What it is

AI repositories from rasbt.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/rasbt/LLMs-from-scratch.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. Synapsa Commons: free, hands-on AI courses that run anywhere (Colab, Kaggle, Binder, Codespaces, Jupyter). EU AI Act conformity evidence, model validation, predictive maintenance, document extraction, retrieval and RAG, AI agents and MCP, a simulated humanoid. Every lesson autograded. From the team building Synapsa.

    Stale GitHub, TarrySingh 4,025 ★Custom licence (see repository)Updated 7 days ago

    git clone https://github.com/TarrySingh/Artificial-Intelligence-Deep-Learning-Machine-Learning-Tutorials.git
  2. litgpt

    AI repositories

    20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

    Stale GitHub, Lightning-AI 13.7k ★Apache-2.0Updated 35 days ago

    git clone https://github.com/Lightning-AI/litgpt.git
  3. datasets

    AI repositories

    🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

    Stale GitHub, huggingface 22.1k ★Apache-2.0Updated 35 days ago

    git clone https://github.com/huggingface/datasets.git
  4. reasoning-from-scratch

    AI repositories

    Implement a reasoning LLM in PyTorch from scratch, step by step

    Stale GitHub, rasbt 5,404 ★Apache-2.0Updated 46 days ago

    git clone https://github.com/rasbt/reasoning-from-scratch.git
  5. llms-from-scratch-cn

    AI repositories

    仅需Python基础,从0构建大语言模型;从0逐步构建GLM4\Llama3\RWKV6, 深入理解大模型原理

    Stale GitHub, datawhalechina 4,410 ★Custom licence (see repository)Updated 2 months ago

    git clone https://github.com/datawhalechina/llms-from-scratch-cn.git
  6. train-llm-from-scratch

    AI repositories

    A straightforward method for training your LLM, from downloading data to generating text.

    Indexed GitHub, FareedKhan-dev 13.2k ★MITUpdated yesterday

    git clone https://github.com/FareedKhan-dev/train-llm-from-scratch.git