Direct Preference Optimization

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

8 new papers

A weekly snapshot of new work published in Direct Preference Optimization.

Period ending 2026-09-14

15 new papers

A weekly snapshot of new work published in Direct Preference Optimization.

Period ending 2026-09-07

14 new papers

A weekly snapshot of new work published in Direct Preference Optimization.

Inside this field

Focused directions

288 papers

Latest in Direct Preference Optimization

Browse all topics →
CardsList

  1. PrefReward: Learning User Preference Matrix for Personalized Text Generation

    Jul 23, 2026Yue Wu, Chengbing Wang, Yimeng Bai +3PersonalizationText Generation

  2. CSPF: A Constrained Shared-Private Fusion Method for Non-Verifiable Preference Evaluation

    Jul 23, 2026Hehao Zhang, Danli Wang, Xinyuan Wang +1Pairwise PreferencesProcess Reward Modeling

  3. EvoThink: Evolving Thinking in Large Reasoning Models via Self-Pruning and Aha-Moment Preference Optimization

    Jul 22, 2026Xinbang Dai, Zheyu Xin, Huikang Hu +7Large Reasoning ModelsAlphaevolve

  4. WearWow: Native 2K Multi-Garment Virtual Try-On via Adaptive Token Packing and Preference Alignment

    Jul 22, 2026Xujie Zhang, Runyan Du, Song Chang +7GarmentsVirtual Try-On

  5. Rewarding Better Thinking for LLM Preference Alignment

    Jul 22, 2026Xubo Liu, Wenya Guo, Ruxue Yan +2Preference AlignmentTrajectory-Level Credit

  6. Conservative Query and Adaptive Regularization for Offline RL Under Uncertainty Estimation

    Jul 21, 2026Li-Rong Zhou, Qin-Wen Luo, Sheng-Jun HuangOffline Reinforcement LearningConservatism

  7. HyCoRec: Hypergraph-Enhanced Multi-Preference Learning for Alleviating Matthew Effect in Conversational Recommendation

    Jul 20, 2026Yongsen Zheng, Ruilin Xu, Ziliang Chen +4Recommender SystemsRecommendation

  8. Toward Anthropomorphic Dialogue: A Closed-Loop Framework for Human-Like Chat Generation, Evaluation, and Preference Alignment

    Jul 19, 2026Wentao Liu, Siyu Song, Xi Chen +4DialogueAnthropomorphism

  9. A Consensus-Based Framework for Relative Preference Evaluation of Large Language Models

    Jul 19, 2026Mohtashim KhanLarge Language Model EvaluationPreference Alignment

  10. When Physical Preferences Meet Semantic Constraints: Physical and Semantic Direct Preference Optimization for Text-to-Video Generation

    Jul 18, 2026Siwei Meng, Yawei Luo, Shu Zhang +1Text-To-Video ModelsDirect Preference Optimization

  11. RIMS: Preference Optimization via Smoothed Multi-pair Aggregation for Small-Scale LLM Retrieval-Augmented Generation

    Jul 17, 2026Pei Tian, Zihan Dong, Tianci Liu +2Retrieval-Augmented Generation SystemsSmall Language Models

  12. TD-DPO: Difference-Aware Preference Optimization for Mitigating Sycophancy in Clinical Autism Intervention Dialogue

    Jul 17, 2026Shuzhong Lai, Junhong Lai, Chenxi Li +5Direct Preference OptimizationSycophancy

  13. Hard Rules, Soft Preferences: Bridging Reasoning, Learning, and Optimization for Personalized Packing Checklist Generation

    Jul 17, 2026Himel Dev, Madhusudan Basak, Tanmoy Sen +2TourModel Preference

  14. Governing Artificial Intelligence: Public Preferences and Regulatory Options

    Jul 16, 2026Magnus Lundgren, Jonas TallbergArtificial Intelligence GovernanceRegulation

  15. Genre Bias or Aesthetic Perception? Identifying and Mitigating Shortcut Learning in Music Evaluation

    Jul 15, 2026Yizhou Zhang, Wangjin Zhou, Yi Zhao +3AestheticsMean Opinion Scores

  16. Groc-PO: Grounded Context Preference Optimization for Truthful Multimodal LLMs

    Jul 15, 2026Zhixiao Zheng, Zheren Fu, Zhiyuan Yao +3Multi-Modal Large Language ModelsDirect Preference Optimization

  17. Normative Alignment of Recommender Systems via Internal Label Shift

    Jul 12, 2026Johannes Kruse, Kasper Lindskow, Michael Riis Andersen +4Recommender SystemsPreference Alignment

  18. Ontology-Amplified Distillation and Contextuality Auditing for Sovereign Enterprise Language Models: A Combined Proof-of-Mechanism and Negative-Results Method Study

    Jul 11, 2026Thanh Luong TuanOntology-Amplified DistillationAlgorithm Auditing

  19. Breaking the Quality--Intelligibility Trade-off in Streaming Target Speaker Extraction via Deep-Feature-Anchored Preference Optimization

    Jul 11, 2026Shuhai Peng, Jinjiang Liu, Hui Lu +5Speaker RecognitionAcoustic Representation

  20. Geometric mean-based pairwise comparison method with the reference values -- statistical approach

    Jul 10, 2026Konrad Kułakowski, Jacek SzybowskiPrioritizationPairwise Preferences

  21. Beyond Time Shifts: Adapting Omni-LLM as a Reference-Free Evaluator for Generative Audio-Visual Models

    Jul 10, 2026Yijie Qian, Juncheng Wang, Chao Xu +6GenerativeCross-Modal Learning

  22. Metadata-Free Meta-Reweighted Direct Preference Optimization under Noisy Preference Labels

    Jul 9, 2026Hua Qu, Yifan Li, Xiaodong YuanDirect Preference OptimizationMeta-Learning

  23. D2PO: Optimizing Diffusion Samplers via Dynamic Preference

    Jul 7, 2026Jinkyu Kim, Jinyoung Choi, Bohyung HanDiffusion SamplingSamplers

  24. Unbiased Alignment for Large Language Models with Noisy Preferences

    Jul 3, 2026Jialiang Wang, Xianming Liu, Xiong Zhou +2Direct Preference OptimizationLarge Language Model Bias

  25. Internal Pluralism and the Limits of Pairwise Comparisons

    Jul 2, 2026Bailey Flanigan, Michelle SiPluralistic AlignmentPairwise Preferences

  26. SPLC: Social Preference Learning for Crowd Robot Navigation

    Jul 2, 2026Zixuan Chen, Hao Fu, Haiwen Hu +1Social Robot NavigationHuman-Robot Collaboration

  27. On the Limits of Steering Vectors for Preference-Aligned Generation

    Jul 2, 2026Melanie Subbiah, Zara Hall, Kathleen McKeownText GenerationPreference Alignment

  28. CoRe: Combined Rewards with Vision-Language Model Feedback for Preference-Aligned Reinforcement Learning

    Jul 2, 2026Hexian Ni, Tao Lu, Yinghao CaiOutcome-Based RewardsPreference Alignment

  29. Distributionally Robust Listwise Preference Optimization

    Jul 2, 2026Xudong Wu, Jian Qian, Pangpang Liu +2Robust Preference OptimizationDirect Preference Optimization

  30. Scaling Trends for Lie Detector Oversight in Preference Learning

    Jul 2, 2026Oskar J. Hollinsworth, Ann-Kathrin Dombrowski, Sam Adam-Day +2DeceptionPreference Learning

  31. PAPA: Online Personalized Active Preference Alignment

    Jul 1, 2026Anindya Sarkar, Nasik Muhammad Nafi, Isaac Lyngaas +2Preference AlignmentTraining-Free Reward Alignment

  32. EPC: A Standardized Protocol for Measuring Evaluator Preference Dynamics in LLM Agent Systems

    Jul 1, 2026Zewen LiuPairwise PreferencesProtocol

  33. Freeform Preference Learning for Robotic Manipulation

    Jun 30, 2026Marcel Torne, Anubha Mahajan, Abhijnya Bhat +1Robot PoliciesPreference Learning

  34. Calibrating the Evaluator: Does Probability Calibration Mitigate Preference Coupling in LLM Agent Feedback Loops?

    Jun 30, 2026Zewen LiuPairwise PreferencesFeedback Learning

  35. Pessimism's Paradox: Conservative Offline Training Amplifies Reward Hacking During Online Adaptation in Reasoning Models

    Jun 29, 2026Subramanyam Sahoo, Aman Chadha, Vinija Jain +1ConservatismPessimism

  36. REAR: Test-time Preference Realignment through Reward Decomposition

    Jun 29, 2026Fuxiang Zhang, Pengcheng Wang, Chenran Li +6Preference AlignmentTest-Time Scaling

  37. Clearer Sight, Fewer Lies: Oriented Pickup Preference Optimization for Multimodal Hallucination Mitigation

    Jun 29, 2026Xin Zou, Haolin Deng, Yibo Yan +5Large Language Model HallucinationMulti-Modal Large Language Models

  38. A Diagnostic Framework and Multi-Evaluator Audit of Evaluator-Driven Preference Dynamics in Self-Adapting LLM Agents

    Jun 29, 2026Liu ZewenPairwise PreferencesLarge Language Model Agents

  39. MAPL: Multi-Objective Preference Learning for Robot Locomotion

    Jun 24, 2026Xiyue Chen, Muhan Lin, Shuyang Shi +1Perceptive Locomotion PoliciesPreference Learning

  40. VA-DPO: Valence-Arousal Direct Preference Optimization for Controllable Emotion Generation in Language Models

    Jun 23, 2026Hyunwoo KimValence-Arousal EstimationDirect Preference Optimization

  41. Towards Spec Learning: Inference-Time Alignment from Preference Pairs

    Jun 22, 2026Dhriti Krishnan, Tejas Goyal, Jaromir SavelkaPreference LearningPairwise Preferences

  42. TailorMind: Towards Preference-Aligned Multimodal Content Generation

    Jun 22, 2026Hengji Zhou, Ye Liu, Yufeng Liu +3Multimodal GenerationPreference Alignment

  43. MORL-A2C: Multi-Objective Reinforcement Learning Reranker for Optimizing Healthiness in MOPI-HFRS

    Jun 22, 2026Aarya Vasantlal, Joshua Zolla, Chuxu ZhangNutrient ReasoningMultimodal Recommendation

  44. Self-Evolution for Multi-Turn Tool-Calling Agents via Divergence-Point Preference Learning

    Jun 22, 2026Jiaqiang TangMulti-Turn Tool-Use AgentSelf-Evolving Agents

  45. Some Results about the Expressivity of Preference-Incomplete Structured Argumentation Frameworks

    Jun 22, 2026Antonio Yuste-GinelAbstract ArgumentationPairwise Preferences

  46. When Preferences Fail to Become Incentives: A Utility-Behavior Gap in Large Language Models

    Jun 22, 2026Yujun Zhou, Christopher M. AckermanPairwise PreferencesIncentives

  47. A Markov Chain Approach to Preference Alignment

    Jun 21, 2026Takuya Koriyama, Tengyuan LiangPreference AlignmentPairwise Preferences

  48. Behavioral and Representational Evidence of Binomial Ordering Preferences in Large Language Models

    Jun 19, 2026Zhiqing Yang, Yilun Liu, Yunpu Ma +2Large Language Model BiasPairwise Preferences

  49. Contagion Networks: Evaluator Preference Propagation in Multi-Agent LLM Systems

    Jun 18, 2026Zewen LiuMulti-Agent Large Language Model SystemsAgentic Evaluations

  50. Through the PRISM: Preference Representation in Intermediate States of Video Diffusion Models

    Jun 18, 2026Haoxuan Wu, Lai Man Po, Mengyang Liu +3Pre-Trained Video Diffusion ModelsPrism

  51. Beyond Uniform Forgetting: A Study of Sequential Direct Preference Optimization Across Preference Settings

    Jun 18, 2026Pranav Bhandari, Nicolas Fay, Amitava Datta +2Direct Preference OptimizationModel Preference

  52. Which Pairs to Compare for LLM Post-Training?

    Jun 17, 2026Jiangze Han, Vineet Goyal, Will MaLarge Language Model Post-TrainingLLM Post-Training Methods

  53. PrefSQA: Pairwise Preference Prediction for Speech Quality Assessment and the Critical Role of High Quality Datasets

    Jun 17, 2026Junyi Fan, Donald S. WilliamsonSpeaker RecognitionPairwise Preferences

  54. Emergent Alignment

    Jun 17, 2026Martin KolářLarge Language Model AlignmentMisalignment

  55. Repeated post-training is not Self-improving: Diagnosing Scientific Amnesia in Continual DPO Pipelines

    Jun 17, 2026Jianzhe Lin, Fei Wang, Xiaolin Li +2Catastrophic ForgettingLLM Post-Training Methods

  56. RouteJudge: An Open Platform for Reproducible and Preference-Aware LLM Routing

    Jun 17, 2026Guannan Lai, Haoran Hu, Han-Jia YeLarge Language Model RoutingExpert Routing

  57. Steerable Cultural Preference Optimization of Reward Models

    Jun 17, 2026Minsik Oh, Advit Deepak, Sophie Wu +2Large Language Model AlignmentRobust Preference Optimization

  58. Prompt Perturbation for Reliable LLM Evaluation over Comparison Graphs

    Jun 16, 2026Dong Huang, Jianbo Sun, Pengkun YangLarge Language Model EvaluationPairwise Preferences

  59. The Value Axis: Language Models Encode Whether They're on the Right Track

    Jun 15, 2026Nick Jiang, Isaac Kauvar, Jack LindseyLarge Language Model UncertaintyTraining Language Models

  60. TuneJury: An Open Metric for Improving Music Generation Preference Alignment

    Jun 15, 2026Yonghyun Kim, Junwon Lee, Haiwen Xia +5Music GenerationPreference Alignment