LLMs-from-scratch
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
Open the source (opens github.com) https://github.com/rasbt/llms-from-scratch
What it is
AI repositories from rasbt.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Get the code
git clone https://github.com/rasbt/LLMs-from-scratch.git
Standard git access to a public repository
Setup steps: not provided by the source. Follow the instructions on the source.
Related
-
Artificial-Intelligence-Deep-Learning-Machine-Learning-Tutorials
AI repositoriesSynapsa Commons: free, hands-on AI courses that run anywhere (Colab, Kaggle, Binder, Codespaces, Jupyter). EU AI Act conformity evidence, model validation, predictive maintenance, document extraction, retrieval and RAG, AI agents and MCP, a simulated humanoid. Every lesson autograded. From the team building Synapsa.
git clone https://github.com/TarrySingh/Artificial-Intelligence-Deep-Learning-Machine-Learning-Tutorials.git -
litgpt
AI repositories20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
git clone https://github.com/Lightning-AI/litgpt.git -
datasets
AI repositories🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools
git clone https://github.com/huggingface/datasets.git -
reasoning-from-scratch
AI repositoriesImplement a reasoning LLM in PyTorch from scratch, step by step
git clone https://github.com/rasbt/reasoning-from-scratch.git -
llms-from-scratch-cn
AI repositories仅需Python基础,从0构建大语言模型;从0逐步构建GLM4\Llama3\RWKV6, 深入理解大模型原理
git clone https://github.com/datawhalechina/llms-from-scratch-cn.git -
train-llm-from-scratch
AI repositoriesA straightforward method for training your LLM, from downloading data to generating text.
git clone https://github.com/FareedKhan-dev/train-llm-from-scratch.git