Direct Preference Optimization (DPO) explained: Bradley-Terry model, log probabilities, math
48:46
YouTubeUmar Jamil
Direct Preference Optimization (DPO) explained: Bradley-Terry model, log probabilities, math
In this video I will explain Direct Preference Optimization (DPO), an alignment technique for language models introduced in the paper "Direct Preference Optimization: Your Language Model is Secretly a Reward Model". I start by introducing language models and how they are used for text generation. After briefly introducing the topic of AI ...
36K viewsApr 14, 2024
Direct Preference Optimization Tutorial
Direct Preference Optimization Math
1:00
Direct Preference Optimization Math
YouTubeLEARNSECTOR
74 views1 month ago
Direct Preference Optimization (DPO) in 1 hour
59:40
Direct Preference Optimization (DPO) in 1 hour
YouTubeZachary Huang
2.8K views8 months ago
Direct Preference Optimization (DPO) | Paper Explained
16:57
Direct Preference Optimization (DPO) | Paper Explained
YouTubeOutlier
2.1K views5 months ago
Top videos
Direct Preference Optimization (DPO): Your Language Model is Secretly a Reward Model Explained
36:25
Direct Preference Optimization (DPO): Your Language Model is Secretly a Reward Model Explained
YouTubeGabriel Mongaras
19.4K viewsAug 10, 2023
Direct Preference Optimization (DPO) - How to fine-tune LLMs directly without reinforcement learning
21:15
Direct Preference Optimization (DPO) - How to fine-tune LLMs directly without reinforcement learning
YouTubeLuis Serrano Academy
33.4K viewsJun 21, 2024
Direct Preference Optimization: Your Language Model is Secretly a Reward Model | DPO paper explained
8:55
Direct Preference Optimization: Your Language Model is Secretly a Reward Model | DPO paper explained
YouTubeAI Coffee Break with Letitia
40.4K viewsDec 22, 2023
Direct Preference Optimization Applications
Direct Preference Optimization (DPO) Explained | Train AI with Human Feedback
6:30
Direct Preference Optimization (DPO) Explained | Train AI with Human Feedback
YouTubeTech Pulse Labs
4 views1 month ago
Direct Preference Optimization (DPO) Explained: AI Alignment
2:45
Direct Preference Optimization (DPO) Explained: AI Alignment
YouTubeVLR Software Training
13 views5 months ago
Why Direct Preference Optimization ! Your LLM is Secretly a Reward Model. #ai #llm #researchpaper
1:20
Why Direct Preference Optimization ! Your LLM is Secretly a Reward Model. #ai #llm #researchpaper
YouTubeTamil AI Hub
857 views1 month ago
Direct Preference Optimization (DPO): Your Language Model is Secretly a Reward Model Explained
36:25
Find in video from 11:18Reinforcement Learning
Direct Preference Optimization (DPO): Your Language Model is Secretly a R…
19.4K viewsAug 10, 2023
YouTubeGabriel Mongaras
Direct Preference Optimization (DPO) - How to fine-tune LLMs directly without reinforcement learning
21:15
Find in video from 01:09Recap of Reinforcement Learning with Human Feedback ( RHF)
Direct Preference Optimization (DPO) - How to fine-tune LLMs directly witho…
33.4K viewsJun 21, 2024
YouTubeLuis Serrano Academy
Direct Preference Optimization: Your Language Model is Secretly a Reward Model | DPO paper explained
8:55
Find in video from 00:11Reinforcement Learning from Human Feedback (RLHF)
Direct Preference Optimization: Your Language Model is Secretly a Rewar…
40.4K viewsDec 22, 2023
YouTubeAI Coffee Break with Letitia
RLHF Explained (and DPO!)
19:39
Find in video from 00:52Reinforcement Learning from Huma Feedback
RLHF Explained (and DPO!)
18K viewsJun 12, 2024
YouTubeMark Hennings
Why Direct Preference Optimization ! Your LLM is Secretly a Reward Model. #ai #llm #researchpaper
1:20
Why Direct Preference Optimization ! Your LLM is Secretly a Reward Model…
857 views1 month ago
YouTubeTamil AI Hub
Hands-on 10: Large Language Model Alignment with Direct Preference Optimization
37:16
Hands-on 10: Large Language Model Alignment with Direct Preference Opt…
3.8K views10 months ago
YouTubeBrainOmega
Teach AI to Be Nice (DPO vs. RLHF) 😇
1:01
Teach AI to Be Nice (DPO vs. RLHF) 😇
117 views2 months ago
YouTubeBookSpokify
6:30
Direct Preference Optimization (DPO) Explained | Train AI with Human Feed…
4 views1 month ago
YouTubeTech Pulse Labs
0:33
AI Model Secrets: DPO, RLHF, and Model Merging Explained! #shorts
67 views6 months ago
YouTubeFranksWorld of AI
59:40
Direct Preference Optimization (DPO) in 1 hour
2.8K views8 months ago
YouTubeZachary Huang
58:07
Find in video from 00:13Introduction to Direct Preference Optimization
Aligning LLMs with Direct Preference Optimization
34.4K viewsFeb 8, 2024
YouTubeDeepLearningAI
2:45
Direct Preference Optimization (DPO) Explained: AI Alignment
13 views5 months ago
YouTubeVLR Software Training
1:00
Direct Preference Optimization Math
74 views1 month ago
YouTubeLEARNSECTOR
33:40
POPri: Private Federated Learning using Preference-Optimized Syntheti…
197 views3 months ago
YouTubeGoogle TechTalks
16:57
Direct Preference Optimization (DPO) | Paper Explained
2.1K views5 months ago
YouTubeOutlier
12:30
How does DPO improve the LLM's performance? | Simple Explanation
213 viewsJan 29, 2025
YouTubeMLWorks
43:22
Lec 10 | Reinforcement Learning from Human Feedback: Part 04
363 views7 months ago
YouTubeLCS2
31:31
Lecture 40 : Aligning to User Preferences via Direct Preference Op…
467 views8 months ago
YouTubeNPTEL IIT Kharagpur
10:38
Stop Using RLHF: How to Align & Control LLMs (DPO Guide)
335 views5 months ago
YouTubeShane | LLM Implementation
28:53
Fine-tuning LLMs on Human Feedback (RLHF + DPO)
23K viewsMar 3, 2025
YouTubeShaw Talebi
18:44
W12L53: Direct Preference Optimization (DPO)
1.3K views9 months ago
YouTubeIIT Madras - B.S. Degree Programme
34:49
nlPUG Reading Group (April 2025) - Direct Preference Optimization
14 views2 months ago
YouTubenlPUG
23:02
Rubrics as Rewards: A Technical Guide to DPO, RaR, RLVR, GPRO and …
148 views2 months ago
YouTubeByte Goose AI.
37:38
AI Agents 6 - Memory, Learning, and Adapation
159.1K views7 months ago
YouTubeProf. Ghassemi Lectures and Tutorials
41:28
LLMs | Alignment of Language Models: Contrastive Learning | Lec 1…
1.7K viewsSep 26, 2024
YouTubeLCS2
31:31
Aligning to User Preferences via Direct Preference Optimization #swayampr…
2 months ago
YouTubeCH 19: IIT BOMBAY 03: Electrical Engineering
12:16
Direct Preference Optimization (DPO) explained + OpenAI Fine-tuning exam…
831 viewsDec 26, 2024
YouTubeSimeon Emanuilov
2:16
Overview of Predictive Preference Learning from Human Interventions (…
146 views5 months ago
YouTubeHaoyuan Cai
14:15
Find in video from 01:06Preference Sampling and Reward Learning
Direct Preference Optimization
820 viewsApr 9, 2024
YouTubeData Science Gems
See more videos
Static thumbnail place holder