Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
text generation model by NousResearch · transformers
NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO -
orpo-dpo-mix-40k
Datasets & benchmarksHugging Face dataset by mlabonne
mlabonne/orpo-dpo-mix-40k -
gutenberg-dpo-v0.1
Datasets & benchmarksHugging Face dataset by jondurbin
jondurbin/gutenberg-dpo-v0.1 -
MedicalGPT
AI repositoriesMedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline. 训练医疗大模型,实现了包括增量预训练(PT)、有监督微调(SFT)、RLHF、DPO、ORPO、GRPO。
git clone https://github.com/shibing624/MedicalGPT.git -
Code_Vulnerability_Security_DPO
Datasets & benchmarksHugging Face dataset by CyberNative
CyberNative/Code_Vulnerability_Security_DPO -
orca_dpo_pairs
Datasets & benchmarksHugging Face dataset by Intel
Intel/orca_dpo_pairs -
dpo-mix-7k
Datasets & benchmarksHugging Face dataset by argilla
argilla/dpo-mix-7k -
Human-Like-DPO-Dataset
Datasets & benchmarksHugging Face dataset by HumanLLMs
HumanLLMs/Human-Like-DPO-Dataset -
distilabel-intel-orca-dpo-pairs
Datasets & benchmarksHugging Face dataset by argilla
argilla/distilabel-intel-orca-dpo-pairs -
truthy-dpo-v0.1
Datasets & benchmarksHugging Face dataset by jondurbin
jondurbin/truthy-dpo-v0.1 -
toxic-dpo-v0.2
Datasets & benchmarksHugging Face dataset by unalignment
unalignment/toxic-dpo-v0.2 -
toxic-dpo-v0.1
Datasets & benchmarksHugging Face dataset by unalignment
unalignment/toxic-dpo-v0.1 -
distilabel-capybara-dpo-7k-binarized
Datasets & benchmarksHugging Face dataset by argilla
argilla/distilabel-capybara-dpo-7k-binarized -
Llama3-OpenBioLLM-70B
Modelstext generation model by aaditya · transformers
aaditya/Llama3-OpenBioLLM-70B -
llm-beginner
AI repositories《大模型与智能体》电子书与 6 个编程任务:Transformer、mini-GPT、SFT/DPO、RAG、工具调用与编程智能体。
git clone https://github.com/nndl/llm-beginner.git -
Soup
AI repositoriesFine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
git clone https://github.com/MakazhanAlpamys/Soup.git -
issuerd
MCP serversFast, Keycloak-compatible IAM with DPoP and CIBA
git clone https://github.com/issuerd/issuerd.git -
Hermes-2-Pro-Mistral-7B
Modelstext generation model by NousResearch · transformers
NousResearch/Hermes-2-Pro-Mistral-7B -
oumi
AI repositoriesEasily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!
git clone https://github.com/oumi-ai/oumi.git -
hands-on-modern-rl
Docs & tutorials🚀 An open-source, hands-on curriculum bridging the gap from basic RL concepts to LLM alignment, RLVR, and advanced Agentic systems.
git clone https://github.com/walkinglabs/hands-on-modern-rl.git -
DPOLens
MCP serversPrivacy law your AI assistant can cite: the exact clause and its version. GDPR and UAE PDPL today.
-
hands-on-llm
Agents & frameworks动手学大模型全栈:CS336 中文精讲 · PyTorch 手搓 Transformer · 单卡复现 Pretrain/SFT/LoRA/DPO/GRPO/RLVR · PEFT/Agent/RAG 落地(含真实实验、曲线与复现脚本)
git clone https://github.com/FRS2003/hands-on-llm.git -
Hermes-2-Pro-Llama-3-8B
Modelstext generation model by NousResearch · transformers
NousResearch/Hermes-2-Pro-Llama-3-8B -
OpenHermesPreferences
Datasets & benchmarksHugging Face dataset by argilla
argilla/OpenHermesPreferences
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.