Preference Optimization

Follow this topic Ask about this topic

Momentum

13 papers in the last four weeks, up 30% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 98

All topics

Hallucination Detection-Guided Preference Optimization for Clinical Summarization
May 27, 2026Shamanth Kuthpadi Seethakantha, Dung Ngoc Thai, Vara Prasad Gudi +6LLM Self-Refinement LLM Hallucination Mitigation
1Manning College of Information and Computer Sciences · 2Ensemble HP · 3Columbia University +1
Beyond Pairwise Preferences: Listwise Reward-Aware Alignment for Diffusion Models
May 26, 2026Austin Wang, Jiaqi Han, Stefano Ermon +1Diffusion Model Alignment Preference Optimization
Caltech · Stanford University
Convex Optimization for Alignment and Preference Learning on a Single GPU
May 22, 2026Miria Feng, Mert PilanciPairwise Preference Learning LLM Alignment
Department of Electrical Engineering, Stanford University, California, United States.
Token-weighted Direct Preference Optimization with Attention
May 21, 2026Chengyu Huang, Zhuohang Li, Sheng-Yen Chou +1Pairwise Preference Learning LLM Alignment
Cornell University · Vanderbilt University
TO-Agents: A Multi-Agent AI Pipeline for Preference-Guided Topology Optimization
May 20, 2026Isabella A. Stewart, Hongrui Chen, Faez AhmedTopology Optimization Multi-Agent System Optimization
Department of Civil and Environmental Engineering Massachusetts Institute of Technology Cambridge, MA, 02139 USA · Department of Mechanical Engineering Massachusetts Institute of Technology Cambridge, MA, 02139 USA
Conditional Equivalence of DPO and RLHF: Implicit Assumption, Failure Modes, and Provable Alignment
May 20, 2026Zhiqin Yang, Yonggang Zhang, Wei Xue +3LLM Alignment Direct Preference Optimization
1The Hong Kong University of Science and Technology · 2LIGHTSPEED · 3Hong Kong Baptist University.
WeCon: An Efficient Weight-Conditioned Neural Solver for Multi-Objective Combinatorial Optimization Problems
May 20, 2026Xuan Wu, Jinbiao Chen, Yang Li +7Preference Optimization Multi-Objective Optimization
Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, College of Computer Science and Technology, Jilin University, Changchun 130012, China · Department of Industrial Systems Engineering and Management, National University of Singapore, Singapore 117576, Singapore · College of Software, Jilin University, Changchun 130012, China +3
Reducing Hallucination in Vision-Language Models via Stage-wise Preference Optimization under Distribution Shift
May 13, 2026Qinwu XuVLM Robustness Hallucination in Language Models
Meta AI
TokenRatio: Principled Token-Level Preference Optimization via Ratio Matching
May 12, 2026Truong Nguyen, Tien-Phat Nguyen, Linh Ngo Van +3Pairwise Preference Learning LLM Alignment
Hanoi University of Science and Technology · University of Stuttgart · German Research Center for Artificial Intelligence +3
YFPO: Yoked Feature Preference Optimization with Neuron-Guided Rewards
May 12, 2026Yifan LePreference Optimization Language Model Post-Training
Independent Researcher
StoicLLM: Preference Optimization for Philosophical Alignment in Small Language Models
May 12, 2026Ishmam Khan, Sindhuja Thogarrati, Shuo ZhangLLM Alignment LLM Fine-Tuning
Tufts University · Bose Corporation
Spurious Correlation Learning in Preference Optimization: Mechanisms, Consequences, and Mitigation via Tie Training
May 11, 2026Christian Moya, Alex Semendinger, Guang Lin +1Pairwise Preference Learning LLM Alignment
Power Reinforcement Post-Training of Text-to-Image Models with Super-Linear Advantage Shaping
May 11, 2026Haoyuan Sun, Jing Wang, Yuxin Song +9Reward Hacking Preference Optimization
Nanyang Technological University · Baidu Inc. · Zhejiang University +3
DGPO: Beyond Pairwise Preferences with Directional Consistent Groupwise Optimization
May 11, 2026Mengyi Deng, Zhiwei Li, Xin Li +4LLM Alignment Reasoning Consistency in Language Models
1Information Hub, The Hong Kong University of Science and Technology (Guangzhou), China · 2The Hong Kong University of Science and Technology, Hong Kong SAR
MASS-DPO: Multi-negative Active Sample Selection for Direct Policy Optimization
May 11, 2026Rohan Surana, Xintong Li, Sheldon Yu +7Direct Preference Optimization Active Learning
1UC San Diego · 2Adobe Research
Mechanistic Analysis of Alignment Algorithms in Language Models
May 9, 2026Aarush Sinha, Ishan Garg, Veeraraju Elluru +2LLM Interpretability Mechanistic Interpretability
University of Copenhagen · Independent · IIT Jodhpur +2
$ξ$ -DPO: Direct Preference Optimization via Ratio Reward Margin
May 9, 2026Zhengyuan Fan, Zhonghua Wu, Yuxuan Du +1Pairwise Preference Learning Direct Preference Optimization
School of Computer Science, Northwestern Polytechnical University
Beyond Pairs: Your Language Model is Secretly Optimizing a Preference Graph
May 8, 2026Ning Liu, Chuanneng Sun, Kristina Klinkner +1Pairwise Preference Learning LLM Alignment
Amazon
Arena as Offline Reward: Efficient Fine-Grained Preference Optimization for Diffusion Models
May 7, 2026Zhikai Li, Yue Zhao, Edward Zhongwei Zhang +4Diffusion Model Alignment Preference Optimization
Institute of Automation, Chinese Academy of Sciences · University of California, Berkeley · University of California, Santa Barbara
Towards General Preference Alignment: Diffusion Models at Nash Equilibrium
May 6, 2026Jiaming Hu, Jiamu Bai, Haoyu Wang +2Diffusion Model Alignment Preference Optimization
Boston University · Penn State University · University at Albany
Replacing Parameters with Preferences: Federated Alignment of Heterogeneous Vision-Language Models
May 5, 2026Shule Lu, Yujing Wang, Hainan Zhang +5Reward Modeling Preference Optimization
Beijing Advanced Innovation Center for Future Blockchain and Privacy Computing · Institute of Artificial Intelligence, Beihang University, China · MAIS, Institute of Automation, Chinese Academy of Sciences, China +2
DynamicPO: Dynamic Preference Optimization for Recommendation
May 1, 2026Xingyu Hu, Kai Zhang, Jiancan Wu +7Hard Negative Mining Preference Optimization
University of Science and Technology of China, Hefei, China · Shanghai Innovation Institute, Shanghai, China · Meituan, Chengdu, China
ViPO: Visual Preference Optimization at Scale
Apr 27, 2026Ming Li, Jie Wu, Justin Cui +3Diffusion Model Alignment Direct Preference Optimization
University of Central Florida · 2ByteDance Seed · ‡ This work was done during the first author’s internship at USA +1
Hindsight Preference Optimization for Financial Time Series Advisory
Apr 27, 2026Yanwei Cui, Guanghui Wang, Xing Zhang +7LLM Alignment Financial Forecasting
1AWS Generative AI Innovation Center · 2HSBC Holdings Plc. HSBC Technology Center China
Align Generative Artificial Intelligence with Human Preferences: A Novel Large Language Model Fine-Tuning Method for Online Review Management
Apr 23, 2026Yanan Wang, Yong GeLLM Hallucination Mitigation LLM Fine-Tuning
Department of Information Systems and Operations Management, The University of Texas at Arlington · Department of Management Information Systems, University of Arizona
HiPO: Hierarchical Preference Optimization for Adaptive Reasoning in LLMs
Apr 22, 2026Darsh Kachroo, Arjun Prasaath Anbazhagan, Adriana Caraeni +2LLM Alignment Direct Preference Optimization
Vellore Institute of Technology, Chennai · Northwestern University · University of Massachusetts Amherst +2
Towards Disentangled Preference Optimization Dynamics: Suppress the Loser, Preserve the Winner
Apr 20, 2026Wei Chen, Yubing Wu, Junmei Yang +5Pairwise Preference Learning LLM Alignment
1South China University of Technology · 2AIP, RIKEN · 3Columbia University +1
GroupDPO: Memory-Efficient Group-Wise Direct Preference Optimization
Apr 17, 2026Jixuan Leng, Si Si, Hsiang-Fu Yu +2LLM Alignment Direct Preference Optimization
Carnegie Mellon University · Google DeepMind · Google
Auditing Multi-Agent LLM Reasoning Trees Outperforms Majority Vote and LLM-as-Judge
Feb 10, 2026Wei Yang, Shixuan Li, Heng Ping +3LLM Auditing Preference Optimization
University of Southern California
Not All Preferences Deserve Gradients: Understanding Gradient Utility in Offline Reasoning Alignment
Feb 1, 2026Hui Wu, Hengyi Cai, Jinman Zhao +6Pairwise Preference Learning Training Data Selection
Baidu Inc. · University of Toronto · School of Intelligence Science and Technology, Peking University +1

May 27, 2026, cs.CLJ/K move · Enter open · S save

Hallucination Detection-Guided Preference Optimization for Clinical Summarization

Shamanth Kuthpadi Seethakantha, Dung Ngoc Thai, Vara Prasad Gudi, Simran Tiwari+5

1Manning College of Information and Computer Sciences · 2Ensemble HP · 3Columbia University+1

LLM Self-Refinement LLM Hallucination Mitigation Healthcare Hallucination in Language Models Text Summarization Preference Optimization

Open paper AskPDF arXiv

Large language models (LLMs) have shown promise on summarization tasks, but they often produce hallucinations, which are unsupported or incorrect statements that limit their reliability in specialized healthcare applications. We introduce Hallucination Detection Guided Self-Refinement (HDSR), an inference-time method that leverages hallucination detectors to guide iterative summary revisions toward factual corrections. Building on this, we propose HDSR for Preference Learning (HDSR-PL), which converts detector-guided refinement trajectories into preference pairs for model finetuning. Extensive experiments show that our methods substantially reduce hallucinations for Llama and Gemma models in summarizing real-world clinical notes from MIMIC-IV-Note v2.2. For example, HDSR reduces 24% and HDSR-PL reduces 48% hallucinations in Llama-3.1-8B-Instruct. Importantly, both methods preserve summary fluency, coherence, and relevance according to human expert and LLM-Jury evaluations. Together, these results demonstrate that detection-informed refinement and preference learning offer an automated solution for improving factual faithfulness in clinical summarization.

Momentum

Related topics

Latest papers 98