Direct Preference Optimization

Follow this field Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

8 new papers

A weekly snapshot of new work published in Direct Preference Optimization.

Period ending 2026-09-14

15 new papers

A weekly snapshot of new work published in Direct Preference Optimization.

Period ending 2026-09-07

14 new papers

A weekly snapshot of new work published in Direct Preference Optimization.

Inside this field

Focused directions

Focused topic

Direct Preference Optimization

Within Direct Preference Optimization

85 papersExplore

Focused topic

Pairwise Preferences

Within Direct Preference Optimization

66 papersExplore

Focused topic

Preference Alignment

Within Direct Preference Optimization

58 papersExplore

Focused topic

Preference Learning

Within Direct Preference Optimization

52 papersExplore

Focused topic

Model Preference

Within Direct Preference Optimization

30 papersExplore

Focused topic

Robust Preference Optimization

Within Direct Preference Optimization

21 papersExplore

288 papers

Latest in Direct Preference Optimization

Browse all topics →

Backtranslation Augmented Direct Preference Optimization for Neural Machine Translation
Apr 28, 2026Mehrdad Ghassabi, Spehr Rajabi, Hamidreza Baradaran Kashani +3Neural Machine Translation Models LLM Post-Training Methods
Sparse Personalized Text Generation with Multi-Trajectory Reasoning
Apr 27, 2026Bo Ni, Haowei Fu, Qinwen Ge +10Personalization Preference Alignment
Learning from Noisy Preferences: A Semi-Supervised Learning Approach to Direct Preference Optimization
Apr 27, 2026Xinxin Liu, Ming Li, Zonglin Lyu +2Direct Preference Optimization Pseudo-Labeling
Aligning with Your Own Voice: Self-Corrected Preference Learning for Hallucination Mitigation in LVLMs
Apr 27, 2026Byeonggeuk Lim, JungMin Yun, Junehyoung Kwon +2Large Language Model Hallucination Hallucination Mitigation
On the Existence of an Inverse Solution for Preference-Based Reductions in Argumentation
Apr 24, 2026Alessio Zaninotto, Bruno Yun, Nir Oren +1Abstract Argumentation Pairwise Preferences
Preference Heads in Large Language Models: A Mechanistic Framework for Interpretable Personalization
Apr 24, 2026Weixu Zhang, Ye Yuan, Changjiang Han +7Personalization Pairwise Preferences
Probably Approximately Consensus: On the Learning Theory of Finding Common Ground
Apr 23, 2026Carter Blair, Ben Armstrong, Shiri Alouf-Heffetz +2Consensus Deliberation
Preferences of a Voice-First Nation: Large-Scale Pairwise Evaluation and Preference Analysis for TTS in Indian Languages
Apr 23, 2026Srija Anand, Ashwin Sankar, Ishvinder Sethi +10Multilingual Automatic Speech Recognition Linguistics
MGDA-Decoupled: Geometry-Aware Multi-Objective Optimisation for DPO-based LLM Alignment
Apr 22, 2026Andor Vári-Kakas, Ji Won Park, Natasa TagasovskaLarge Language Model Alignment Direct Preference Optimization
Vibrotactile Preference Learning: Uncertainty-Aware Preference Learning for Personalized Vibration Feedback
Apr 22, 2026Rongtao Zhang, Xin Zhu, Masoume Pourebadi Khotbehsara +3Preference Learning Haptic Feedback
HiPO: Hierarchical Preference Optimization for Adaptive Reasoning in LLMs
Apr 22, 2026Darsh Kachroo, Arjun Prasaath Anbazhagan, Adriana Caraeni +2Large Language Model Reasoning Direct Preference Optimization
PREF-XAI: Preference-Based Personalized Rule Explanations of Black-Box Machine Learning Models
Apr 21, 2026Salvatore Greco, Jacek Karolczak, Roman Słowiński +1Explainable Artificial Intelligence Preference Learning
DT2IT-MRM: Debiased Preference Construction and Iterative Training for Multimodal Reward Modeling
Apr 21, 2026Zhihong Zhang, Jie Zhao, Xiaojian Huang +5Pairwise Preferences Multimodal Dataset
Personalized Benchmarking: Evaluating LLMs by Individual Preferences
Apr 21, 2026Cristina Garbacea, Heran Wang, Chenhao TanPairwise Preferences Late-Stage Ranker
S2H-DPO: Hardness-Aware Preference Optimization for Vision-Language Models
Apr 20, 2026Nitish Shukla, Surgan Jandial, Arun RossVision-Language Alignment Multiple Vision Tasks
SignDPO: Multi-level Direct Preference Optimisation for Skeleton-based Gloss-free Sign Language Translation
Apr 20, 2026Muxin Pu, Xiao-Ming Wu, Mei Kuan Lim +3Sign Language Recognition Sign Language
Cat-DPO: Category-Adaptive Safety Alignment
Apr 19, 2026Tiankai Yang, Yi Nian, Xinyuan Li +3Safety Alignment Large Language Model Alignment
HeadRank: Decoding-Free Passage Reranking via Preference-Aligned Attention Heads
Apr 19, 2026Juyuan Wang, Chenxing Wang, Yuchen Fang +8Reranking Relevance
Comparison Drives Preference: Reference-Aware Modeling for AI-Generated Video Quality Assessment
Apr 18, 2026Minghao Zou, Gen Liu, Guanghui Yue +5Video Quality Cross-Dataset Benchmark
CiPO: Counterfactual Unlearning for Large Reasoning Models through Iterative Preference Optimization
Apr 17, 2026Junyi Li, Yongqiang Chen, Ningning DingLarge Language Model Unlearning Large Reasoning Models
Preference Estimation via Opponent Modeling in Multi-Agent Negotiation
Apr 17, 2026Yuta Konishi, Kento Yamamoto, Eisuke Sonomoto +8Negotiation Pairwise Preferences
GroupDPO: Memory-Efficient Group-Wise Direct Preference Optimization
Apr 17, 2026Jixuan Leng, Si Si, Hsiang-Fu Yu +2Direct Preference Optimization Large Language Model Post-Training
CoPA: Benchmarking Personalized Question Answering with Data-Informed Cognitive Factors
Apr 16, 2026Hang Su, Zequn Liu, Chen Hu +3Multi-Hop Question Answering Benchmarks Model Preference
Uncertainty-aware Generative Learning Path Recommendation with Cognition-Adaptive Diffusion
Apr 16, 2026Xiangrui Xiong, Hang Liang, Baiyang Chen +2Adaptive Learning Curriculum Reinforcement Learning
Relational Preference Encoding in Looped Transformer Internal States
Apr 10, 2026Jan KirinPairwise Preferences Transformer Encoder
Personalized Group Relative Policy Optimization for Heterogenous Preference Alignment
Feb 17, 2026Jialu Wang, Heinrich Peters, Asad A. Butt +6Preference Alignment Group Relative Policy Optimization
Synthetic Interaction Data for Scalable Personalization in Large Language Models
Feb 12, 2026Yuchen Ma, Yue Huang, Wenjie Wang +3Personalization Pairwise Preferences
Aligning Language Model Benchmarks with Pairwise Preferences
Feb 2, 2026Marco Gutierrez, Xinyi Leng, Hannah Cyberey +3Benchmarking Large Language Models Pairwise Preferences
Do Implicit Personalization and Explicit Styles Conflict? PsPLUG: A Lightweight Plug-in for Balancing Personalization and Style in Customized LLMs
Jan 10, 2026Yutong Song, Jiang Wu, Shaofan Yuan +5Personalization Model Preference
Who Laughs with Whom? Disentangling Influential Factors in Humor Preferences across User Clusters and LLMs
Jan 6, 2026Soichiro Murakami, Hidetaka Kamigaito, Hiroya Takamura +1Humor Large Language Model Bias
Multi-dimensional Preference Alignment by Conditioning Reward Itself
Dec 11, 2025Jiho Jang, Jinyoung Kim, Kyungjune Baek +1Training-Free Reward Alignment Preference Alignment
PreferThinker: Reasoning-based Personalized Image Preference Assessment
Nov 1, 2025Shengqi Xu, Xinpeng Zhou, Yabo Zhang +6Model Preference Thinking
GMTRouter: Personalized LLM Router over Multi-turn User Interactions
Oct 29, 2025Yihang Sun, Encheng Xie, Tao Feng +1Large Language Model Routing Model Preference
Learning Peer Influence Probabilities with Linear Contextual Bandits
Oct 21, 2025Ahmed Sayeed Faruk, Mohammad Shahverdikondori, Elena ZhelevaLinear Contextual Bandits Influence
Adaptive Margin RLHF via Preference over Preferences
Sep 26, 2025Yaswanth Chittepu, Prasann Singhal, Greg Durrett +1Reinforcement Learning From Human Feedback Direct Preference Optimization
N2M: Bridging Navigation and Manipulation by Learning Pose Preference from Rollout
Sep 23, 2025Kaixin Chai, Hyunjun Lee, Joseph J. LimRobotic Manipulation Policies Manipulation
Breaking the Mirror: Activation-Based Mitigation of Self-Preference in LLM Evaluators
Sep 3, 2025Dani Roytburg, Matthew Bozoukov, Matthew Nguyen +3Large Language Model Bias Large Language Model Evaluation
FaST: Feature-aware Sampling and Tuning for Personalized Preference Alignment with Limited Data
Aug 6, 2025Thibaut Thonet, Germán Kruszewski, Jos Rozen +2Preference Alignment Limited Data
DPO Unchained: Your Training Algorithm is Secretly Disentangled in Human Choice Theory (and its Loss' Convexity is Dispensable)
Jul 10, 2025Wenxuan Zhou, Shujian Zhang, Brice Magdalou +4Direct Preference Optimization Social Norms
Interactive Multi-Objective Probabilistic Preference Learning with Soft and Hard Bounds
Jun 27, 2025Edward Chen, Sang T. Truong, Natalie Dullerud +2Pareto Frontier Preference Learning
Modeling and Optimizing User Preferences in AI Copilots: A Comprehensive Survey and Taxonomy
May 28, 2025Saleh Afzoon, Ali Shahsavandi, Phuong Thao Huynh +4Model Preference Copilot
Bias Fitting to Mitigate Length Bias of Reward Model in RLHF
May 19, 2025Kangwen Zhao, Jianfeng Cai, Jinhua Zhu +5Reinforcement Learning From Human Feedback Direct Preference Optimization
Dual-Difficulty Curriculum Learning for Direct Preference Optimization
Apr 10, 2025Mengyang Li, Haozhan Geng, Zhong Zhang +1Large Language Model Alignment Direct Preference Optimization
Distributionally Robust Reinforcement Learning with Human Feedback
Mar 1, 2025Debmalya Mandal, Paulius Sasnauskas, Goran RadanovicReinforcement Learning From Human Feedback Direct Preference Optimization
TextAlign: Preference Alignment for Text Rendering with Hierarchical Rewards
Date pendingMingxuan Cui, Jingpu Yang, Fengxian Ji +7Video-Text Alignment Typography Generation
PACIFIC: Can LLMs Discern the Psychometric Traits Influencing Your Preferences? Personality-Driven Preference Alignment in LLMs
Date pendingTianyu Zhao, Siqi Li, Yasser Shoukry +1Preference Alignment Personality
Toward Collective-Centric Evaluation of Preference Inference for Participatory Democracy
Date pendingPierre-Antoine Lequeu, Salim Hafid, Paul Lerner +6Democracy Pairwise Preferences
The C-index illusion: discrimination without calibration in published survival models
Date pendingRafael da Silva, Danilo AlvaresSurvival Predictions Survival Analysis
Beyond Single-Negative Preference: Multi-Negative DPO for LLM-Centric Historical Entity Linking
Date pendingTien Nam Nguyen, Emanuela Boros, Ahmed Hamdi +3History Direct Preference Optimization

Apr 28, 2026 · cs.CLJ/K move · Enter open · S save

Backtranslation Augmented Direct Preference Optimization for Neural Machine Translation

Mehrdad Ghassabi, Spehr Rajabi, Hamidreza Baradaran Kashani, Sadra Hakim+2

Contemporary neural machine translation (NMT) systems are almost exclusively built by training on supervised parallel data. Despite the tremendous progress achieved, these systems still exhibit persistent translation errors. This paper proposes that a post-training paradigm based on reinforcement learning (RL) can effectively rectify such mistakes. We introduce a novel framework that requires only a general text corpus and an expert translator which can be either human or an AI system to provide iterative feedback. In our experiments, we focus specifically on English-to-German translation as a representative high-resource language pair. Crucially, we implement this RL-based post-training using Direct Preference Optimization (DPO). Applying our DPO-driven framework to the gemma3-1b model yields a significant improvement in translation quality, elevating it's COMET score from 0.703 to 0.747 on the English to German task. The results demonstrate that DPO offers an efficient and stable pathway for enhancing pre-trained NMT models through preference-based post-training.

Neural Machine Translation Models LLM Post-Training Methods Direct Preference Optimization German

Open paper Ask about it PDF