← Flash PapersDirect Preference Optimization: Your Language Model is Secretly a Reward Model

Share this Flash Paper

Direct Preference Optimization: Your Language Model is Secretly a Reward Model

https://flashpapers.ai/p/u8bs3zpgxe
Post to XPost to BlueskyShare on LinkedInSubmit to Hacker NewsSubmit to RedditEmail a link
Make your own
Rafael Rafailov, Archit Sharma +4 more
cs.LG2023arXiv:2305.18290Code· 2.9k★· updated 2y ago
Details ▸
Win Rate vs Reference Summaries:61.0%· Reddit TL;DRWin Rate vs Chosen Responses:55.0%· Anthropic-HH Dialogue
Concepts:Direct Preference OptimizationRLHF