InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. text generation model by NousResearch · transformers

    Stale Hugging Face Hub, NousResearch 460 ♥apache-2.0Updated 2 years ago

    NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO
  2. orpo-dpo-mix-40k

    Datasets & benchmarks

    Hugging Face dataset by mlabonne

    Indexed Hugging Face Hub, mlabonne 318 ♥apache-2.0Updated 2 years ago

    mlabonne/orpo-dpo-mix-40k
  3. gutenberg-dpo-v0.1

    Datasets & benchmarks

    Hugging Face dataset by jondurbin

    Stale Hugging Face Hub, jondurbin 171 ♥cc-by-4.0Updated 2 years ago

    jondurbin/gutenberg-dpo-v0.1
  4. MedicalGPT

    AI repositories

    MedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline. 训练医疗大模型,实现了包括增量预训练(PT)、有监督微调(SFT)、RLHF、DPO、ORPO、GRPO。

    Stale GitHub, shibing624 5,861 ★Apache-2.0Updated 2 months ago

    git clone https://github.com/shibing624/MedicalGPT.git
  5. Code_Vulnerability_Security_DPO

    Datasets & benchmarks

    Hugging Face dataset by CyberNative

    Stale Hugging Face Hub, CyberNative 180 ♥apache-2.0Updated 37 days ago

    CyberNative/Code_Vulnerability_Security_DPO
  6. orca_dpo_pairs

    Datasets & benchmarks

    Hugging Face dataset by Intel

    Indexed Hugging Face Hub, Intel 336 ♥apache-2.0Updated 2 years ago

    Intel/orca_dpo_pairs
  7. dpo-mix-7k

    Datasets & benchmarks

    Hugging Face dataset by argilla

    Stale Hugging Face Hub, argilla 180 ♥mitUpdated 2 years ago

    argilla/dpo-mix-7k
  8. Human-Like-DPO-Dataset

    Datasets & benchmarks

    Hugging Face dataset by HumanLLMs

    Indexed Hugging Face Hub, HumanLLMs 274 ♥llama3Updated 10 months ago

    HumanLLMs/Human-Like-DPO-Dataset
  9. distilabel-intel-orca-dpo-pairs

    Datasets & benchmarks

    Hugging Face dataset by argilla

    Stale Hugging Face Hub, argilla 185 ♥apache-2.0Updated 15 months ago

    argilla/distilabel-intel-orca-dpo-pairs
  10. truthy-dpo-v0.1

    Datasets & benchmarks

    Hugging Face dataset by jondurbin

    Stale Hugging Face Hub, jondurbin 142 ♥cc-by-4.0Updated 2 years ago

    jondurbin/truthy-dpo-v0.1
  11. toxic-dpo-v0.2

    Datasets & benchmarks

    Hugging Face dataset by unalignment

    Stale Hugging Face Hub, unalignment 144 ♥cc-by-4.0Updated 2 years ago

    unalignment/toxic-dpo-v0.2
  12. toxic-dpo-v0.1

    Datasets & benchmarks

    Hugging Face dataset by unalignment

    Stale Hugging Face Hub, unalignment 143 ♥cc-by-4.0Updated 2 years ago

    unalignment/toxic-dpo-v0.1
  13. distilabel-capybara-dpo-7k-binarized

    Datasets & benchmarks

    Hugging Face dataset by argilla

    Stale Hugging Face Hub, argilla 189 ♥apache-2.0Updated 2 years ago

    argilla/distilabel-capybara-dpo-7k-binarized
  14. text generation model by aaditya · transformers

    Stale Hugging Face Hub, aaditya 518 ♥llama3Updated 22 months ago

    aaditya/Llama3-OpenBioLLM-70B
  15. llm-beginner

    AI repositories

    《大模型与智能体》电子书与 6 个编程任务:Transformer、mini-GPT、SFT/DPO、RAG、工具调用与编程智能体。

    Stale GitHub, nndl 6,816 ★MITUpdated 2 months ago

    git clone https://github.com/nndl/llm-beginner.git
  16. Soup

    AI repositories

    Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

    Stale GitHub, MakazhanAlpamys 10.3k ★Apache-2.0Updated 9 days ago

    git clone https://github.com/MakazhanAlpamys/Soup.git
  17. issuerd

    MCP servers

    Fast, Keycloak-compatible IAM with DPoP and CIBA

    Indexed GitHub, issuerd 77 ★Apache-2.0Updated 4 days ago

    git clone https://github.com/issuerd/issuerd.git
  18. text generation model by NousResearch · transformers

    Stale Hugging Face Hub, NousResearch 509 ♥apache-2.0Updated 2 years ago

    NousResearch/Hermes-2-Pro-Mistral-7B
  19. oumi

    AI repositories

    Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!

    Stale GitHub, oumi-ai 9,408 ★Apache-2.0Updated 24 days ago

    git clone https://github.com/oumi-ai/oumi.git
  20. hands-on-modern-rl

    Docs & tutorials

    🚀 An open-source, hands-on curriculum bridging the gap from basic RL concepts to LLM alignment, RLVR, and advanced Agentic systems.

    Stale GitHub, walkinglabs 4,769 ★Custom licence (see repository)Updated 24 days ago

    git clone https://github.com/walkinglabs/hands-on-modern-rl.git
  21. DPOLens

    MCP servers

    Privacy law your AI assistant can cite: the exact clause and its version. GDPR and UAE PDPL today.

    Stale Official MCP Registry, com.dpolens Updated 17 days ago 1 note

  22. hands-on-llm

    Agents & frameworks

    动手学大模型全栈:CS336 中文精讲 · PyTorch 手搓 Transformer · 单卡复现 Pretrain/SFT/LoRA/DPO/GRPO/RLVR · PEFT/Agent/RAG 落地(含真实实验、曲线与复现脚本)

    Stale GitHub, FRS2003 127 ★MITUpdated 2 months ago

    git clone https://github.com/FRS2003/hands-on-llm.git
  23. text generation model by NousResearch · transformers

    Stale Hugging Face Hub, NousResearch 456 ♥llama3Updated 2 years ago

    NousResearch/Hermes-2-Pro-Llama-3-8B
  24. OpenHermesPreferences

    Datasets & benchmarks

    Hugging Face dataset by argilla

    Stale Hugging Face Hub, argilla 221 ♥otherUpdated 2 years ago

    argilla/OpenHermesPreferences

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.