Direct Preference Optimization

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

8 new papers

A weekly snapshot of new work published in Direct Preference Optimization.

Period ending 2026-09-14

15 new papers

A weekly snapshot of new work published in Direct Preference Optimization.

Period ending 2026-09-07

14 new papers

A weekly snapshot of new work published in Direct Preference Optimization.

Inside this field

Focused directions

288 papers

Latest in Direct Preference Optimization

Open your feed →
CardsList

  1. A Zeroth-Order Paradigm for LLM Preference Alignment

    Sep 16, 2026Peter Chen, Xi Chen, Wotao Yin +1Preference AlignmentLarge Language Model Post-Training

  2. Too Good to Be Real? Diagnosing and Reducing the Gap Between AI Preference and Real User Engagement

    Sep 16, 2026Xinglang Zhang, Yuanmeng Xiang, Yunyao Zhang +3AnalyticsPairwise Preferences

  3. Learning Heterogeneous Preferences

    Sep 15, 2026Shiwali Mohan, Matt Hong, Dule Shu +3Preference LearningExpected Utility

  4. DiaWhisper-DPO: Role-Attributed Transcription of Clinical Interviews via Failure-Mined Preference Optimization

    Sep 15, 2026Weiming Li, Ana Catarina Fidalgo Barata, Miguel Constante +1Speaker DiarizationDepression Detection

  5. Style-Debiased DPO: Updating LLM Knowledge with Factuality-Aware Synthetic Preference Data

    Sep 15, 2026Takayuki Yamamoto, Daisuke KawaharaLarge Language Model Post-TrainingMultimodal Knowledge Editing

  6. Beyond Safe Answers: Segment-Aware Listwise Alignment for Reasoning Safety in Large Reasoning Models

    Sep 14, 2026JungMin Yun, Junehyoung Kwon, Hayeong Ryu +3Large Reasoning ModelsLarge Language Model Alignment

  7. Direct Preference Density Alignment for Conversational Audio Equalization

    Sep 14, 2026Ioannis Stylianou, Sven Ewan Shepstone, Jon Francombe +2Large Language Model AlignmentPreference Alignment

  8. GUIDE: Generative Utility Inference and Decision Engine

    Sep 14, 2026Anagha Tiwari, Alexander G. Gray, Nick Feamster +3Pairwise PreferencesElicitation

  9. Preference Optimization with LALM Feedback for Continuous Autoregressive Non-Verbal Vocalization Generation

    Sep 11, 2026Jingbin Hu, Qirui Zhan, Yuang Cao +7Preference LearningFeedback Learning

  10. Direct Diversity Optimization for Diverse Successful Trajectories in Preference Post-Training

    Sep 9, 2026Junwon Ko, Dong-Jae Lee, Minchan Kwon +2LLM Post-Training MethodsDirect Preference Optimization

  11. FlowCPO: A Unified Divergence View of Preference Alignment for Flow Models

    Sep 9, 2026Yansen Han, Shengyi Liao, Peng Sun +4Preference AlignmentKullback-Leibler Divergence

  12. A Better Spur Should Start From Each Objective

    Sep 8, 2026Shanwen Mao, Hao Zhang, Guangtao nie +4Constrained Reinforcement LearningTraining-Free Reward Alignment

  13. Bridging the Semantic-Utility Gap in Multimodal RAG via Generator-in-the-Loop Alignment

    Sep 8, 2026Zhan-Lun Chang, Dong-Jun Han, Seyyedali Hosseinalipour +2Multi-Source Retrieval-Augmented GenerationVision-Language Alignment

  14. Inference-Time Nash Alignment

    Sep 8, 2026Hadi Hosseini, Debmalya Mandal, Duohan ZhangPairwise PreferencesMirror Descent

  15. You Can't Prefer Emotions You Don't Sample: Intensity Undershoot in DPO-Tuned LLMs

    Sep 7, 2026Hyunwoo Kim, Usama KhalidValence-Arousal EstimationEmotion

  16. From Deceptive Outputs to Deceptive Mechanisms: A Causal Framework for Language-Model Deception Research

    Sep 3, 2026Yakov Pyotr ShkolnikovDeceptionLarge Language Model Decision-Making

  17. Subspace Inference Enables Efficient Active Reward Learning from Preferences

    Sep 3, 2026Yutai Zhou, Erdem BıyıkReinforcement Learning From Human FeedbackPreference Learning

  18. Ready to Speak: Aligning LLMs for TTS-Friendly Text Generation

    Sep 1, 2026Thibaut Thonet, Jos Rozen, Laurent BesacierZero-Shot Text-To-SpeechText Generation

  19. When Metropolis and Hastings Meet Bradley and Terry: Exact MCMC From Preference Voting

    Sep 1, 2026Ariel Smogorghevski, Nir Rosenfeld, Yaniv RomanoMarkov Chain Monte CarloConditional Distribution

  20. SFAD: Speculative Factuality-Aware Decoding

    Sep 1, 2026Guanqiao Chen, Di Wang, Lijie HuExplanation FaithfulnessLLM Inference Efficiency

  21. Patterning in Practice: Debiasing Reward Models with Susceptibilities

    Sep 1, 2026George Wang, Elizabeth Donoway, Daniel MurfetProcess Reward ModelingImplicit Bias

  22. Towards Effective Structured Context Modeling for Conversational Recommender Systems via Dual-node Monte Carlo Tree Search

    Sep 1, 2026Jincheng Zhang, Chen Huang, Wenqiang Lei +2Recommender SystemsModel Preference

  23. Autoresearch for Marketplace Catalogs: From Legacy Forms to AI-Native Matching

    Aug 31, 2026Kartik Ravisankar, Hojat Abdolanezhad, Daniel Capo +3Agentic CommerceTaxonomy

  24. Low-Resource Preference Adaptation of LLMs via Activation-Based Label Propagation

    Aug 31, 2026Alessio Galatolo, Meriem BeloucifPairwise PreferencesLarge Language Model Adaptation

  25. PLC-DPO: Posterior Label Correction in Noisy and Ambiguous Preference Optimization

    Aug 31, 2026Boryeong Cho, Sumyeong Ahn, Se-Young YunDirect Preference OptimizationRobust Preference Optimization

  26. Balancing Privacy, Utility, and Safety in LLM Alignment through Preference Optimization

    Aug 31, 2026Dishu Yang, Jingjing Liu, Jize LiDirect Preference OptimizationAI Privacy Risks and Protection

  27. MoPLEx: Estimating Plackett-Luce Mixture Models for Multi-Objective Alignment

    Aug 25, 2026Dongyue Li, Ziniu Zhang, Lu Wang +1Preference AlignmentLate-Stage Ranker

  28. SSPO: Structure-Aware Similarity-Weighted Preference Optimization for Neural Combinatorial Optimization

    Aug 12, 2026Yuanyu Li, Jintao Xu, Zijiang Liu +6Combinatorial OptimizationDirect Preference Optimization

  29. Preference Tree Optimization: Enhancing Goal-Oriented Dialogue with Look-Ahead Simulations

    Aug 12, 2026Lior Baruch, Moshe Butman, Kfir Bar +1Conversational Artificial IntelligencePairwise Preferences

  30. Who Would You Vote For? Auditing Political Alignment in LLMs: An Italian Case-Study

    Aug 12, 2026Simone MungariPolitical DiscourseLarge Language Model Decision-Making

  31. FedCGR: Federated Cross-Domain Generative Recommendation

    Aug 11, 2026Zhuodong Liu, Hugen Lv, Xiangyu Li +2Collaborative FilteringFedavg

  32. Se-DPO: Self-Evolving Token Credit for Direct Preference Optimization

    Aug 10, 2026Wenxiao Zhao, Shu Wang, Ying Nian WuDirect Preference OptimizationCredit Assignment

  33. Learning Preference Adaptation for Large Language Model Personalization via Verbal Reinforcement Learning

    Aug 10, 2026Yuting Liu, Wei Wu, Jianzhe Zhao +1Preference AlignmentDeep Reinforcement Learning

  34. LLM Reasoning for Subjective Tasks: Failure Modes, Mitigation, and Dynamic Reasoning Routing

    Aug 9, 2026Juncheng Dong, Ding Tong, Ishan Gupta +1Large Language Model ReasoningVerifier

  35. Linguistically-Aligned and Visually-Grounded Preference Optimization for Clinically-Augmented Medical Report Generation

    Aug 9, 2026Qiang Hu, Yuxuan Luo, Yingjie Guo +4Medical Report GenerationMultimodal Clinical Data

  36. From Product Search to Preference Articulation: The Economics of Agentic Commerce

    Aug 9, 2026Lingxiu Dong, Kaiwen Luo, Fasheng XuAgentic CommerceAgentic Search

  37. BAP-MOS: Bandit-Based Adaptive Prompting for Boundary-Sensitive Multi-Organ Segmentation

    Aug 8, 2026Satvik Praveen, Shengji Jin, Ahmed Lamidi +2Medical Image SegmentationUltrasound

  38. FutureBridge: Token Selection Beyond Local Preference in Collaborative Decoding

    Aug 7, 2026Quanquan Li, Hongbo Zhang, Yihe Chi +9Large Language Model ReasoningSmall Language Models

  39. Explore or Converge? Stage-Guided Per-Step Optimization for Diffusion Models

    Aug 7, 2026Renye Yan, Jikang Cheng, You Wu +4Preference AlignmentGenerative

  40. GRASP: Reinforcing Language Model Anonymizers with Group Relative Policy Optimization

    Aug 6, 2026Sajjad Ghiasvand, Nader SehatbakhshLanguage Model Evasion AttacksAnonymization

  41. Learning When to Trust via Selective Context Preference Optimization

    Aug 6, 2026Xian Sun, Wei Chow, Yingshuo Wang +4Direct Preference Optimization

  42. Sample-Adaptive Latent Rewards for Uncertainty-Guided Diffusion Post-Training

    Aug 6, 2026Rui Li, Yuanzhi Liang, Ke Hao +4Reward GradientsLLM Post-Training Methods

  43. LangChoiceBench: Measuring and Explaining Programming-Language Choice in LLMs

    Aug 6, 2026Lukas Twist, Twm Stone, Helen Yannakoudakis +1Benchmarking Large Language ModelsModel Preference

  44. Cautious Context Steering for Language Model Personalization

    Aug 6, 2026Gihoon Kim, Jeyoung Lee, Suhan Woo +4PersonalizationIn-Context Learning

  45. Positive-Unlabeled Preference Optimization For Chest X-ray Report Generation

    Aug 5, 2026Yuta Kobayashi, Pradyun Ramesh, Muhammad Ahmed Chaudhry +5Chest RadiographyRadiology Report Generation

  46. Interoceptive Attention as Dynamic Homeostatic Prioritization in a Foraging Agent

    Aug 4, 2026St John Grimbly, Nicolas Kuske, Evert A. Boonstra +7PrioritizationPerception-Action Loop

  47. Stuck on "A": Diagnosing and Repairing Interface Injury in Attention-to-KDA Linearization of a 0.6B Language Model

    Aug 3, 2026Ronglong BaoQwen3Quadratic Attention

  48. Know It, Act on It: Investigating Memory Utilization in LLM Personalization

    Jul 31, 2026Zhaoxin Feng, Jianfei Ma, Emmanuele ChersoniModel Preference

  49. An analysis of machine learning approaches for enhancing decision-making in complex discrete choice tasks

    Jul 30, 2026Sheng Lun Christine Cao, Destenie Nock, Alex DavisDiscrete Choice ModelsPreference Learning

  50. Rolling With Resistance: Preference-Optimized LLM Counselors Can Trade Goal Persistence for Relational Attunement in Motivational Interviewing

    Jul 30, 2026Weiying Chen, Junlong Shen, Zhexuan TangCognitive Behavioral TherapyIntrinsic Motivation

  51. When Specifications Conflict: A Symmetry-Based Framework for Measuring LLM Preferences

    Jul 30, 2026Tairan Wang, Liang Zhou, Zikang Zhan +1Pairwise PreferencesCode Generation

  52. Temporal Concentration from Rollout Errors: Implicit Preference Optimization for Text-to-Video Diffusion

    Jul 30, 2026Henglin Liu, Fangyuan Kong, Jing Wang +7Robust Preference OptimizationRollout

  53. Synchronizing Beliefs with Second-Order Theory-of-Mind in Human-Autonomy Teams (Extended Version)

    Jul 29, 2026Jack Mirenzi, Henny AdmoniPreference LearningTeacher

  54. BridgeAlign: Bridging Preference Alignment for Humanities and Social Sciences

    Jul 29, 2026Ru Peng, Haokai Xu, Xijun Gu +11Preference AlignmentComputational Social Science

  55. TELLER: Dual-Path Iterative Preference Optimization for Table Entity Linking

    Jul 29, 2026Yixin Peng, Kehao Li, Stefan DeckerEntitiesTable Reasoning Datasets

  56. DIRECT: Direct Decoding for Efficient and Aligned Sequence Labeling with Large Language Models

    Jul 29, 2026Yilei Wang, Jiaxin Gan, Kexuan Zhang +3Sequence ModelingDirect Preference Optimization

  57. Thinking Under Uncertainty: Evidence Use and Information-Seeking in Language Models

    Jul 29, 2026Hua-Dong Xiong, Xinyuan Yan, Ji-An Li +3Large Language Model UncertaintyLarge Language Model Decision-Making

  58. Learning Dynamic User Personas from Implicit Interaction Streams via Iterative Refinement

    Jul 29, 2026Haifeng WuPersonaPreference Learning

  59. SyRuP: Enhancing System-Prompt Following via Reward-Guided Prediction in LLM Decoding

    Jul 27, 2026Seoyeon Kim, Minjae Kang, Jaehyung KimPrior Prompt Optimization TechniquesPairwise Preferences

  60. PrefReward: Learning User Preference Matrix for Personalized Text Generation

    Jul 23, 2026Yue Wu, Chengbing Wang, Yimeng Bai +3PersonalizationText Generation