Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
train-llm-from-scratch
AI repositoriesA straightforward method for training your LLM, from downloading data to generating text.
git clone https://github.com/FareedKhan-dev/train-llm-from-scratch.git -
llm-action
AI repositories本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)
git clone https://github.com/liguodongiot/llm-action.git -
LLMSurvey
AI repositoriesThe official GitHub page for the survey paper "A Survey of Large Language Models".
git clone https://github.com/RUCAIBox/LLMSurvey.git -
trainer
AI repositoriesDistributed AI Model Training and LLM Fine-Tuning on Kubernetes
git clone https://github.com/kubeflow/trainer.git -
unilm
AI repositoriesLarge-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
git clone https://github.com/microsoft/unilm.git -
LLaSA_training
AI repositoriesLLaSA: Scaling Train-time and Inference-time Compute for LLaMA-based Speech Synthesis
git clone https://github.com/zhenye234/LLaSA_training.git -
ml-engineering
AI repositoriesMachine Learning Engineering Open Book
git clone https://github.com/stas00/ml-engineering.git -
SpecForge
AI repositoriesTrain speculative decoding models effortlessly and port them smoothly to SGLang serving.
git clone https://github.com/sgl-project/SpecForge.git -
openlake
AI repositoriesOpenLake is a high performance storage engine for efficient LLM inference and GPU Training
git clone https://github.com/openlake-project/openlake.git -
Chinese-LLaMA-Alpaca
AI repositories中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
git clone https://github.com/ymcui/Chinese-LLaMA-Alpaca.git -
gitleaks
AI repositoriesFind secrets with Gitleaks 🔑
git clone https://github.com/gitleaks/gitleaks.git -
MedicalGPT
AI repositoriesMedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline. 训练医疗大模型,实现了包括增量预训练(PT)、有监督微调(SFT)、RLHF、DPO、ORPO、GRPO。
git clone https://github.com/shibing624/MedicalGPT.git -
reef
AI repositoriesInfrastructure for continually self‑improving agents
git clone https://github.com/Human-Agent-Society/reef.git -
nncf
AI repositoriesNeural Network Compression Framework for enhanced OpenVINO™ inference
git clone https://github.com/openvinotoolkit/nncf.git -
agent-lightning
AI repositoriesThe absolute trainer to light up AI agents.
git clone https://github.com/microsoft/agent-lightning.git -
SwanLab
AI repositories⚡️SwanLab - an open-source, modern-design AI training tracking and visualization tool. Supports Cloud / Self-hosted use. Integrated with PyTorch / Transformers / verl / LLaMA Factory / ms-swift / Ultralytics / MMEngine / Keras etc.
git clone https://github.com/SwanHubX/SwanLab.git -
metaflow
AI repositoriesBuild, Manage and Deploy AI/ML Systems
git clone https://github.com/Netflix/metaflow.git -
heretic
AI repositoriesTraining-free language model modification: Remove censorship, suppress slop, reduce sycophancy, and more
git clone https://github.com/p-e-w/heretic.git -
data-juicer
AI repositoriesData processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷
git clone https://github.com/datajuicer/data-juicer.git -
llm-datasets
AI repositoriesCurated list of datasets and tools for post-training.
git clone https://github.com/mlabonne/llm-datasets.git -
PaddleNLP
AI repositoriesEasy-to-use and powerful LLM and SLM library with awesome model zoo.
git clone https://github.com/PaddlePaddle/PaddleNLP.git -
awsome-distributed-ai
AI repositoriesBest practices, reference architectures, and examples for distributed AI training and inference on AWS.
git clone https://github.com/awslabs/awsome-distributed-ai.git -
Gym
AI repositoriesEvaluate and improve models and agents using environments
git clone https://github.com/NVIDIA-NeMo/Gym.git -
llm-foundry
AI repositoriesLLM training code for Databricks foundation models
git clone https://github.com/mosaicml/llm-foundry.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.