Preference Alignment Learning

Follow this topic Ask about this topic

Momentum

52 papers in the last four weeks, up 333% on the four weeks before. 0.5% of all new papers.

Jul 13Week of Sep 28

Latest papers 271

All topics

PrefBench: Evaluating Zero-Shot LLM Agents in Hidden-Preference Personalized Pricing Negotiations
May 19, 2026Yingjie LeiNegotiation Agentic Commerce
University of Aberdeen
General Preference Reinforcement Learning
May 18, 2026Muhammad Umer, Muhammad Ahmed Mohsin, Ahsan Bilal +5Large Language Model Reinforcement Learning Preference Alignment Learning
Stanford University · The University of Oklahoma
GAMMA: Global Bit Allocation for Mixed-Precision Models under Arbitrary Budgets
May 18, 2026Zhangyang Yao, Haiyan Zhao, Haoyu Wang +3Mixed-Precision Quantization Token Budget Allocation
Beihang University · Tsinghua University · ByteDance Inc
ClaHF: A Human Feedback-inspired Reinforcement Learning Framework for Improving Classification Tasks
May 17, 2026Tianxiang Xu, Xiaoyan Zhu, Xin Lai +1Reinforcement Learning From Human Feedback Large Language Model Classification
School of Computer Science and Technology, Xi’an Jiaotong University
Transitivity Meets Cyclicity: Explicit Preference Decomposition for Dynamic Large Language Model Alignment
May 17, 2026Yucong Huang, Xiucheng Li, Kaiqi Zhao +1Preference Alignment Large Language Model Alignment
Harbin Institute of Technology, Shenzhen, China.
Learning What Evaluators Value: A Reliable Approach to Modeling Evaluator Preferences
May 15, 2026Madeline Celi Kitch, Nihar B. ShahPreference Alignment Learning Rater
Carnegie Mellon University
OHP-RL: Online Human Preference as Guidance in Reinforcement Learning for Robot Manipulation
May 15, 2026Yunyang Mo, Jian Li, Qiwei Wu +2Reinforcement Learning From Human Feedback Robotic Manipulation
The Hong Kong University of Science and Technology (Guangzhou)
Contexting as Recommendation: Evolutionary Collaborative Filtering for Context Engineering
May 15, 2026Jiachen Zhu, Zhuoying Ou, Congmin Zheng +9Collaborative Filtering Recommendation
Shanghai Jiao Tong Univ. · Univ. College London · Carnegie Mellon Univ. +1
Active Learners as Efficient PRP Rerankers
May 14, 2026Jeremías Figueiredo Paschmann, Juan Kaplan, Francisco Nattero +3Cross-Encoder Reranking Ranking
ELIAS Lab, Departamento de Ingeniería, Universidad de San Andrés
Direct Preference Optimization for English-Mandarin Code-Switching Speech Recognition in Audio LLMs
May 13, 2026Trung Nguyen Quang, Cheng Yi Lewis Won, Minh Duc Pham +3Code-Switching Large Audio Language Models
Institute for Infocomm Research (I2R), A⋆STAR, Singapore · Nanyang Technological University, Singapore
Probing Persona-Dependent Preferences in Language Models
May 13, 2026Oscar Gilg, Pierre Beckmann, Daniel Paleka +1Preference Alignment Learning
MATS · MATS, EPFL · ETH Zürich +1
Improving Code Translation with Syntax-Guided and Semantic-aware Preference Optimization
May 13, 2026Yuhan Wu, Huan Zhang, Wei Cheng +3Code Generation Preference Alignment Learning
State Key Laboratory for Novel Software Technology, Nanjing University, China · National Institute of Healthcare Data Science, Nanjing University, China
Learning Transferable Latent User Preferences for Human-Aligned Decision Making
May 12, 2026Alina Hyk, Sandhya SaisubramanianLarge Language Model Decisions Preference Alignment Learning
Oregon State University
Variance-aware Reward Modeling with Anchor Guidance
May 12, 2026Shuxing Fang, Ruijian Han, Liangyu Zhang +1Progress Reward Modeling Preference Alignment Learning
Department of Data Science and Artificial Intelligence, Hong Kong Polytechnic University · School of Statistics and Data Science, Shanghai University of Finance and Economics
Explaining and Breaking the Safety-Helpfulness Ceiling via Preference Dimensional Expansion
May 12, 2026ShiYing Huang, Liang Lin, Yuer Li +6Preference Alignment Multi-Objective Reinforcement Learning
Huazhong University of Science and Technology · Nanyang Technological University · Tsinghua University +1
A Theory of Time-Sensitive Language Generation: Sparse Hallucination Beats Mode Collapse
May 11, 2026Atul Ganju, Travis McVoy, Shaddin Dughmi +1Deadlines Inductive Bias
University of Southern California
When to Ask a Question: Understanding Communication Strategies in Generative AI Tools
May 11, 2026Charlotte Park, Kate Donahue, Manish RaghavanGenerative Artificial Intelligence Elicitation
Massachusetts Institute of Technology Cambridge, Massachusetts, USA
DGPO: Beyond Pairwise Preferences with Directional Consistent Groupwise Optimization
May 11, 2026Mengyi Deng, Zhiwei Li, Xin Li +4Backtranslation Augmented Direct Preference Optimization Preference Alignment Learning
1Information Hub, The Hong Kong University of Science and Technology (Guangzhou), China · 2The Hong Kong University of Science and Technology, Hong Kong SAR
Learning the Preferences of a Learning Agent
May 9, 2026Karim Abdel Sadek, Mark Bedaywi, Rhys Gould +1Preference Learning Reinforcement Learning From Human Feedback
University of California, Berkeley
Personalized Alignment Revisited: The Necessity and Sufficiency of User Diversity
May 9, 2026Enoch Hyunwook KangDiversity Preference Alignment Learning
Foster School of Business, University of Washington, Seattle, Washington, USA.
Mechanistic Analysis of Alignment Algorithms in Language Models
May 9, 2026Aarush Sinha, Ishan Garg, Veeraraju Elluru +2Large Language Model Alignment Preference Alignment Learning
University of Copenhagen · Independent · IIT Jodhpur +2
Can Revealed Preferences Clarify LLM Alignment and Steering?
May 8, 2026Khurram Yamin, Jingjing Tang, Eric Horvitz +1Large Language Model Alignment Large Language Model Decisions
1Carnegie Mellon University · 2Microsoft Research
Embeddings for Preferences, Not Semantics
May 8, 2026Carter Blair, Ariel D. Procaccia, Milind TambePreference Alignment Learning Text Embeddings
Harvard University
Auto-Rubric as Reward: From Implicit Preferences to Explicit Multimodal Generative Criteria
May 8, 2026Juanxi Tian, Fengyuan Liu, Jiaming Han +6Progress Reward Modeling Task-Specific Rubrics
1Nanyang Technological University · 2Ant Group · 3MMLab, The Chinese University of Hong Kong +1
Beyond Pairs: Your Language Model is Secretly Optimizing a Preference Graph
May 8, 2026Ning Liu, Chuanneng Sun, Kristina Klinkner +1Backtranslation Augmented Direct Preference Optimization Preference Alignment Learning
Amazon
Nash without Numbers: A Social Choice Approach to Mixed Equilibria in Context-Ordinal Games
May 8, 2026Ian Gemp, Crystal Qian, Marc Lanctot +1Nash Equilibrium Equilibrium
Google DeepMind · New York, NY, USA · New York, NY USA +2
CLIPer: Tailoring Diverse User Preference via Classifier-Guided Inference-Time Personalization
May 8, 2026Jinyan Su, Jinpeng Zhou, Claire Cardie +1Large Language Model Personalization Personalization
Cornell University
Response Time Enhances Alignment with Heterogeneous Preferences
May 7, 2026Federico Echenique, Alireza Fallah, Baihe Huang +1Preference Alignment Learning Large Language Model Personalization
Department of Economics, University of California, Berkeley · Department of Computer Science and Ken Kennedy Institute, Rice University · Departments of Electrical Engineering and Computer Sciences, University of California, Berkeley +2
Preference Instability in Reward Models: Detection and Mitigation via Sparse Autoencoders
May 7, 2026Shunchang Liu, Xin Chen, Belen Martin Urcelay +1Preference Learning Preference Alignment Learning
ETH Zürich · Georgia Institute of Technology · ELLIS Institute Finland +1
Misaligned by Reward: Socially Undesirable Preferences in LLMs
May 6, 2026Gayane Ghazaryan, Esra DönmezLarge Language Model Alignment Large Language Model Bias
Institute for Natural Language Processing, University of Stuttgart · 2Interchange Forum for Reflecting on Intelligent Systems, University of Stuttgart
StoryAlign: Evaluating and Training Reward Models for Story Generation
May 6, 2026Haotian Xia, Hao Peng, Yunjia Qi +4Narrative Generation Narratives
Department of Computer Science and Technology, Tsinghua University
Replacing Parameters with Preferences: Federated Alignment of Heterogeneous Vision-Language Models
May 5, 2026Shule Lu, Yujing Wang, Hainan Zhang +5Vision-Language Alignment Recent Vision-Language Models
Beijing Advanced Innovation Center for Future Blockchain and Privacy Computing · Institute of Artificial Intelligence, Beihang University, China · MAIS, Institute of Automation, Chinese Academy of Sciences, China +2
U-Define: Designing User Workflows for Hard and Soft Constraints in LLM-Based Planning
May 4, 2026Christine P Lee, Xinyu Jessica Wang, Aws Albarghouthi +2Agentic Workflow Design Structural Constraints
University of Wisconsin–Madison, USA · George Mason University, USA
Multi-User Dueling Bandits: A Fair Approach using Nash Social Welfare
May 3, 2026Maheed H. Ahmed, Mahsa GhasemiAlgorithmic Fairness Stochastic Multi-Armed Bandits
Electrical and Computer Engineering Purdue University
RMGAP: Benchmarking the Generalization of Reward Models across Diverse Preferences
May 3, 2026Yangyang Zhou, Yi-Chen LiProgress Reward Modeling Large Language Model Alignment
Beijing University of Posts and Telecommunications · National Key Laboratory for Novel Software Technology, Nanjing University, China · School of Artificial Intelligence, Nanjing University, China
VLA-ATTC: Adaptive Test-Time Compute for VLA Models with Relative Action Critic Model
May 2, 2026Wenhao Li, Xiu Su, Yichao Cao +5Diffusion-Based Vision-Language-Actions Critic-Free Reinforcement Learning
University of Sydney · Central South University · University of Science and Technology of China +2
Mind the Gap: Structure-Aware Consistency in Preference Learning
Apr 30, 2026Mehryar Mohri, Yutao ZhongLarge Language Model Alignment Preference Alignment Learning
Google Research, New York, NY · Courant Institute of Mathematical Sciences, New York, NY
When Agents Shop for You: Role Coherence in AI-Mediated Markets
Apr 29, 2026Soogand Alavi, Salar NozariAgentic Commerce Preference Alignment Learning
Tippie College of Business, University of Iowa
On the Existence of an Inverse Solution for Preference-Based Reductions in Argumentation
Apr 24, 2026Alessio Zaninotto, Bruno Yun, Nir Oren +1Argumentation Frameworks Preference Alignment Learning
1CRIL - Université d’Artois, CNRS · 2Universite Claude Bernard Lyon 1, CNRS, Ecole Centrale de Lyon, INSA Lyon, Université Lumière Lyon 2, LIRIS, UMR5205, 69622 Villeurbanne, France · University of Aberdeen
Preference Heads in Large Language Models: A Mechanistic Framework for Interpretable Personalization
Apr 24, 2026Weixu Zhang, Ye Yuan, Changjiang Han +7Large Language Model Personalization Personalization
McGill University · Mila - Quebec AI Institute · MBZUAI +2
Preferences of a Voice-First Nation: Large-Scale Pairwise Evaluation and Preference Analysis for TTS in Indian Languages
Apr 23, 2026Srija Anand, Ashwin Sankar, Ishvinder Sethi +10Seed-Tts-Eval Benchmark Multilingual Automatic Speech Recognition
Indian Institute of Technology Madras, India · AI4Bharat, India · Josh Talks, India
Align Generative Artificial Intelligence with Human Preferences: A Novel Large Language Model Fine-Tuning Method for Online Review Management
Apr 23, 2026Yanan Wang, Yong GePreference Alignment Learning Review
Department of Information Systems and Operations Management, The University of Texas at Arlington · Department of Management Information Systems, University of Arizona
Where and What: Reasoning Dynamic and Implicit Preferences in Situated Conversational Recommendation
Apr 22, 2026Dongding Lin, Jian Wang, Yongqi Li +1Preference Alignment Learning Multimodal Large Language Models
Department of Computing, The Hong Kong Polytechnic University · College of Computer Science, Sichuan University
Vibrotactile Preference Learning: Uncertainty-Aware Preference Learning for Personalized Vibration Feedback
Apr 22, 2026Rongtao Zhang, Xin Zhu, Masoume Pourebadi Khotbehsara +3Preference Learning Haptic Feedback
Department of Computer Science University of Southern California Los Angeles, California, USA
HiPO: Hierarchical Preference Optimization for Adaptive Reasoning in LLMs
Apr 22, 2026Darsh Kachroo, Arjun Prasaath Anbazhagan, Adriana Caraeni +2Sequential Preference Optimization LLM Reasoning Strategies
Vellore Institute of Technology, Chennai · Northwestern University · University of Massachusetts Amherst +2
DT2IT-MRM: Debiased Preference Construction and Iterative Training for Multimodal Reward Modeling
Apr 21, 2026Zhihong Zhang, Jie Zhao, Xiaojian Huang +5Multimodal Large Language Models Multimodal Dataset
University of Science and Technology of China
From Experience to Skill: Multi-Agent Generative Engine Optimization via Reusable Strategy Learning
Apr 21, 2026Beining Wu, Fuyou Mao, Jiong Lin +7Agentic Optimization Citations
Hangzhou Dianzi University · Central South University · Shanghai Artificial Intelligence Laboratory +3
Personalized Benchmarking: Evaluating LLMs by Individual Preferences
Apr 21, 2026Cristina Garbacea, Heran Wang, Chenhao TanLarge Language Model Personalization Preference Alignment Learning
University of Chicago
HorizonBench: Long-Horizon Personalization with Evolving Preferences
Apr 19, 2026Shuyue Stella Li, Bhargavi Paranjape, Kerem Oktar +9Preference Alignment Learning Interaction History
University of Washington · Meta · OpenAI +1
Beyond Overlap Metrics: Rewarding Reasoning and Preferences for Faithful Multi-Role Dialogue Summarization
Apr 19, 2026Xiaoyong Mei, Tingting Zuo, Da Chen +5Dialogue Benchmarks Summarization
Zhejiang Normal University · Huawei Technologies · HKUST, Hong Kong +2
Comparison Drives Preference: Reference-Aware Modeling for AI-Generated Video Quality Assessment
Apr 18, 2026Minghao Zou, Gen Liu, Guanghui Yue +5Video Quality Generative Video Models
Cardiff University Cardiff, UK · Shandong University of Science and Technology Qingdao, China · Shenzhen University Shenzhen, China +2
From "Strings" to "Things" for Personal Knowledge Graphs: Evaluating LLM Triple Extraction for Recommendation Systems
Apr 18, 2026Abhirup Dasgupta, Fernando Spadea, Oshani SeneviratneRdf Knowledge Graphs
Rensselaer Polytechnic Institute, Troy NY 12180, USA
Preference Estimation via Opponent Modeling in Multi-Agent Negotiation
Apr 17, 2026Yuta Konishi, Kento Yamamoto, Eisuke Sonomoto +8Negotiation Preference Alignment Learning
1Graduate School of Informatics, Kyoto University, Kyoto, Japan · 2Accenture Japan Ltd, Tokyo, Japan
WavAlign: Enhancing Intelligence and Expressiveness in Spoken Dialogue Models via Adaptive Hybrid Post-Training
Apr 16, 2026Yifu Chen, Shengpeng Ji, Qian Chen +9Speech Language Models Preference Alignment Learning
Zhejiang University · Tongyi Fun Team, Alibaba Group · Beijing University of Technology
CoPA: Benchmarking Personalized Question Answering with Data-Informed Cognitive Factors
Apr 16, 2026Hang Su, Zequn Liu, Chen Hu +3Large Language Model Personalization Preference Alignment Learning
East China Normal University, China · Zhongguancun Academy, China
Rater State Bias in RLHF Preference Data: An Audit Framework
Apr 14, 2026Elena Kopteva, Vitaliy Hlynianyi-ZhukReinforcement Learning From Human Feedback Rater
The Grainger College of Engineering, Department of Physics & Illinois Center for Advanced Studies of the Universe, University of Illinois Urbana-Champaign, Urbana, Illinois 61801, USA · Faculty of Applied Mathematics, Oles Honchar Dnipro National University, Dnipro, 49045, Ukraine · Department of Clinical Psychology, Kyiv Institute of Modern Psychology and Psychotherapy, Kyiv, 01133, Ukraine
Relational Preference Encoding in Looped Transformer Internal States
Apr 10, 2026Jan KirinPreference Alignment Learning Transformer Architectures
Coverage-Controlled Preference Mining from Noisy Claim Verification for Evidence-Grounded Generation
Mar 11, 2026Weixin Liu, Congning Ni, Qingyuan Song +4Category-Aware Atomic Claims Evidence-Grounded Questions
Vanderbilt University, Nashville, TN, USA · Vanderbilt University Medical Center, Nashville, TN, USA · Virginia Tech, Blacksburg, VA, USA
Towards Natural Personalization: Evaluating Long-Horizon Preference Following in Personalized User-LLM Interactions
Mar 4, 2026Qianyun Guo, Yibo Li, Yue Liu +1Large Language Model Personalization Preference Alignment Learning
National University of Singapore, Singapore.
MARS: Margin and Semantic-Aware Data Augmentation for Reward Modeling
Feb 19, 2026Payel Bhattacharjee, Osvaldo Simeone, Ravi TandonProgress Reward Modeling Augmentation
University of Arizona · Tucson, AZ, USA · Northeastern University London +1

May 19, 2026, cs.GTJ/K move · Enter open · S save

PrefBench: Evaluating Zero-Shot LLM Agents in Hidden-Preference Personalized Pricing Negotiations

Yingjie Lei

University of Aberdeen

Negotiation Agentic Commerce Large Language Model Agents Preference Alignment Learning Refusals

Open paper AskPDF arXiv

Personalized pricing negotiations are a challenging testbed for LLM agents because successful interaction does not guarantee profitable decision making. A seller may produce valid actions and close many deals while still pricing poorly when buyer willingness to pay and bargaining traits remain hidden. This paper presents PrefBench, a simulator-based benchmark for hidden-preference personalized pricing negotiations. Each episode pairs a simulated buyer with a fixed vehicle-customization bundle; the seller observes public persona descriptors, bundle information, and negotiation history, while latent buyer variables govern valuation, patience, counter-offer behavior, and walkaway decisions. PrefBench evaluates this setting through an LLM-facing state-summary protocol that constrains agents to return strict JSON actions under a fixed hidden-information boundary. We evaluate zero-shot LLM sellers against heuristic references over 7,500 episodes. The tested LLMs follow the protocol reliably and achieve deal rates above 0.99, but their seller-profit outcomes remain weak: the best LLM average profit is only slightly above the random baseline and far below a simple concession heuristic under the same episode stream. These results show that structured action compliance and agreement-seeking behavior can coexist with weak profit-sensitive bargaining. PrefBench provides a controlled benchmark for evaluating pricing-agent behavior under hidden buyer preferences.

Momentum

Related topics

Latest papers 271