Preference Alignment Learning

Ask about this topic

Momentum

52 papers in the last four weeks, up 333% on the four weeks before. 0.5% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 271

All topics
CardsList

  1. Not All Is Lost: Repairing Lossy User Preference States of Personalization Encoders

    Oct 1, 2026Parthiv Chatterjee, Dhiraj Golhar, Ummesalma Diwan +3Preference Alignment LearningRecommendation

    KDM Lab, Dhirubhai Ambani University · Dhirubhai Ambani University · LCS2 Lab, Indian Institute of Technology Delhi

  2. Evaluating LLM-Generated Preference Distributions

    Oct 1, 2026Fan Huang, Minsuk Kim, C. Tyler Diggans +1Preference Alignment LearningDistributions

    Indiana University Bloomington Bloomington, IN, USA · Massachusetts Institute of Technology Cambridge, MA, USA · Root Dynamix LLC Sewickley, PA, USA

  3. Robust Nash Alignment under Preference Uncertainty

    Sep 30, 2026Shihab Ahmed, Debamita Ghosh, David Tang +3Preference AlignmentNash Equilibrium

    University of Central Florida · Arizona State University · University of Colorado Boulder

  4. Where's Waldo? Query-language Preference under Cross-lingual Knowledge Disparities

    Sep 30, 2026Dayeon Ki, Ruochen Zhang, Silviu Cucerzan +2Cross-Lingual ConsistencyPreference Alignment Learning

    University of Maryland · Microsoft

  5. Discrete Annotation, Continuous Preference: Rethinking Supervision for Accurate and Generalizable Aesthetic Image Cropping

    Sep 30, 2026Ziqing Zhang, Xiao Liu, Kai Liu +4CroppingPreference Alignment Learning

    Shanghai Jiao Tong University · Institute of Media Technology and Experience Design, Huawei

  6. Fenchel Tilting: Weighted Correction for Efficient Finetuning of Generative Models

    Sep 30, 2026Maksim Bobrin, Maksim Zhdanov, Dmitry DylovGenerative Flow NetworksGenerative Models

    AXXX · Applied AI Institute · MBZUAI

  7. Patient-Centered Treatment Planning for Chronic Multimorbidity: A Hierarchical Reinforcement Learning Framework for Preference Modeling

    Sep 30, 2026Nafiseh Payani, Soham Das, G. Anthony Wilson +1MultimorbidityTreatment

    Department of Industrial and Systems Engineering at the University of Tennessee, Knoxville, TN, USA · Department of Industrial Engineering at the University of Arkansas, Fayetteville, AR, USA

  8. Belief-Based Maximum Occupancy Principle and Active Inference

    Sep 30, 2026Manolis Mylonas, Rubén Moreno BoteStochastic ExplorationGoal-Directed Behavior

    Center for Brain and Cognition & Department of Engineering Universitat Pompeu Fabra Barcelona, Spain

  9. How Reliable Are Predicted MOS for Reproducing Human System-Level Preferences in Speech Enhancement?

    Sep 30, 2026Nahomi Kusunoki, Tsubasa Ochiai, Naohiro Tawara +4Mean Opinion ScoresSpeech Enhancement

    Waseda University, Japan · NTT, Inc., Japan

  10. Efficient Multi-Modal Planning with Reward-Guided Preference Optimization for Autonomous Driving

    Sep 30, 2026Chenglin Chen, Lujia Wang, Xinhu Zheng +2Causality-Aware End-To-End Autonomous DrivingAutonomous Driving

  11. Optimal Design for Active Preference Learning with Biased LLM Judges

    Sep 30, 2026Zhongman Du, Huiming Zhang, Haodong Zhu +1Preference LearningPreference Alignment Learning

    Beihang University · Zhongguancun Academy · Hangzhou Innovation Institute of Beihang University

  12. Uncertainty-Normalized Margins for Direct Preference Optimization

    Sep 29, 2026Sadegh Khorasani, Petrus Mikkola, Matthias GrossglauserBacktranslation Augmented Direct Preference OptimizationPreference Alignment Learning

    School of Computer and Communication Sciences, EPFL, Lausanne, Switzerland · University of Helsinki, Helsinki, Finland

  13. Demographic Pluralism: Inference-Time Modeling of Pluralistic Human Preference Distributions

    Sep 29, 2026Meng-Chen Wu, Qipin Chen, Ansh Jain +3Internal PluralismDemographics

    Amazon Science

  14. ArgGYM: A Procedural, Engine-Verified Benchmark for Structured Defeasible Reasoning

    Sep 29, 2026İbrahim Ethem Deveci, Funda Tan Çalık, Barış Deniz Sağlam +1Reasoning BenchmarkLLM Reasoning Strategies

    Graduate School of Informatics Middle East Technical University Ankara, Türkiye

  15. EVOKE: Eliciting World Knowledge in Agents for Transferable Decision-Making

    Sep 29, 2026Yuhan Guo, Jinming Liu, Liang Xu +8WorldPost-Training

    Shanghai Jiaotong University · Eastern Institute of Technology, Ningbo · Zhongguancun Academy, Beijing, China +1

  16. PreferenceFlow: Test-Time Guidance of Flow-Matching Robot Policies from Human Interventions

    Sep 29, 2026Yiqi Tang, Diyuan Shi, Runze Li +1Flow PoliciesRobot Policies

    Westlake University

  17. Language Models Act on Hidden Valence

    Sep 28, 2026Cameron Berg, Caspar KaiserHidden StatesLanguage Model Computes

    Reciprocal Research · University of Warwick

  18. How Well Can LLMs Simulate Real Learner Evaluations of Educational Feedback?

    Sep 28, 2026Momoka Furuhashi, Kouta Nakayama, Takashi Kodama +2Large Language Model EvaluationFeedback

    Tohoku University · Research and Development Center for Large Language Models, National Institute of Informatics · National Institute of Informatics +2

  19. From Normative Frameworks to Alignment Data: Constructing and Evaluating SFT and Preference Data

    Sep 28, 2026Husrev Taha Sencar, Rezart Beka, Danish Naeem +6Large Language Model AlignmentSocial Norms

    Qatar Computing Research Institute, HBKU, Qatar. · College of Islamic Studies, HBKU, Qatar. · Argumentation and Conflict Studies, Ibn Haldun University, Turkiye. +1

  20. Using Context Is Not Enough: Test-Time Training for Personalized Reward Modeling

    Sep 28, 2026Bohao Wang, Xiaoyan Zhao, Yang Zhang +4Large Language Model PersonalizationPreference Alignment Learning

    Zhejiang University · National University of Singapore

  21. BA-DPO: Bias-Adjusted Direct Preference Optimization for Language Model Alignment

    Sep 28, 2026Antonio Ferrara, Alberto Rumi, Francesco BonchiLarge Language Model AlignmentBacktranslation Augmented Direct Preference Optimization

    Intesa Sanpaolo AI Research

  22. From Soft Targets to Reward Signals: How Assignment and Reward Objectives Interact

    Sep 28, 2026Jiangtao Lin, Bangyang Wei, Siyi Liu +2Response-Level RewardsReward Signal

    Tsinghua Shenzhen International Graduate School, Tsinghua University · School of Vehicle and Mobility, Tsinghua University · Tencent Holdings Limited +1

  23. From Preference to Reciprocity: Decentralized Matching with Empirically Grounded LLM-agent Based Modeling

    Sep 28, 2026Wangxuan Fan, Xiaoyu Nie, Zhoutian Shi +5Distribution MatchingGame Theory

    The Chinese University of Hong Kong, Shenzhen

  24. FestDPO: Few-step Generator Alignment with Direct Preference Optimization

    Sep 28, 2026Jaewoo Lee, Kyuil Sim, Hyeongyu Kang +3Generative ModelsDiffusion Alignment

    KAIST · MongooseAI · Omelet

  25. A General Harness for Protein Foundation Model Fitness Prediction

    Sep 28, 2026Yang Tan, Qijia Tian, Gangyu Sun +5Wireless Foundation ModelsSirus

    Shanghai Jiao Tong University · Shanghai Innovation Institute · Shanghai Artificial Intelligence Laboratory

  26. SpeechCritic: Learning a Diagnostic Speech Judge from Limited Human Preferences

    Sep 28, 2026Mingyue Huo, Shivam Mehta, Bhavin Jawade +2Large Audio Language ModelsCritic

    University of Illinois Urbana-Champaign · Netflix

  27. PairPref: When Should Memory Guide the Answer? A Benchmark for Contextual Preference Use

    Sep 28, 2026Mingfei Lu, Mengjia Wu, Yi ZhangPreference Alignment LearningConversational Memory

    AAII, University of Technology Sydney

  28. Over-Personalization Is a Decision Failure: Generation-Induced Apply Bias in LLMs

    Sep 28, 2026Haeun Jang, Yonghyun Jun, Hwanhee LeeLarge Language Model PersonalizationLarge Language Model Bias

    Department of Artificial Intelligence, Chung-Ang University

  29. PrefLUT: Reusable and Refinable Personalized Color Editing from Pairwise Preferences

    Sep 28, 2026Chuanzhi Xu, Langyi Chen, Chengkun Yue +5Image EditingPreference Alignment Learning

    The University of Sydney · Indiana University · The University of Hong Kong

  30. Direct Hidden-State Alignment: Mapping and Controlling Preference Expression in LLMs

    Sep 27, 2026Fansheng Zhang, Shengran Guo, Zexiao Wang +3Preference Alignment LearningReinforcement Learning From Human Feedback

    Chengdu University · North Carolina State University · Fudan University +2

  31. Knowing Is Not Choosing: What Explicit Verification Adds Beyond Generative Preference

    Sep 27, 2026Yilong Li, Chengpo Yan, Aayan Arish +1Large Language Model ResponsesFactual Recall

    Department of Computer Science University of Wisconsin-Madison Madison, WI 53703, USA

  32. On Preference Coverage Collapse from Hindsight Relabeling in Multi-Objective Reinforcement Learning

    Sep 22, 2026Baptiste Bonin, Caro Strickland, Audrey DurandMulti-Objective Reinforcement LearningHindsight

    Mila (Quebec AI Institute) · Université Laval · CIFAR AI Chair

  33. Error Bounds for Statistical Estimators in BTL Model with Parametric Multivariate Utility Functions

    Sep 22, 2026Yicheng Li, Huifu XuMaximum LikelihoodFinite-Sample

    Department of Systems Engineering and Engineering Management, The Chinese University of Hong Kong.

  34. COPE: Continual Personalization of LLMs under Sparse User Feedback via User Embeddings and Self-Evaluation

    Sep 22, 2026Ruike Cao, Fugen Yao, Liang Dong +3Large Language Model PersonalizationPersonalization

    University of Science and Technology of China · Qwen Business Unit of Alibaba

  35. Deflecting the Value Compass: Interacting with Large Language Models Temporarily Shifts Human Value Priorities Toward Personal Focus

    Sep 22, 2026Hasibur Rahman, Malak Sadek, Smit DesaiLarge Language Model DecisionsMulti-Turn Large Language Model Conversations

    Northeastern University, Boston, Massachusetts, USA · Centre for Human-Inspired Artificial Intelligence (CHIA) University of Cambridge, Cambridge, United Kingdom

  36. A Behavioral Trait Leaks into Preferences: Diagnosing Trait Interference in LLM User Simulators

    Sep 22, 2026Chaehyun Kim, Sein Kim, Hongseok Kang +1User SimulationPreference Alignment Learning

    KAIST Daejeon, Republic of Korea

  37. Measuring the Assistant's Harmlessness Preferences on the User Turn

    Sep 20, 2026Jord NguyenChatbotsPreference Alignment Learning

  38. Characterizing Web Search by Conversational LLM Agents: From Search Decisions and Strategies to Results and Responses

    Sep 16, 2026Mahsa Amani, Seungeon Lee, Abhisek Dash +9Agentic SearchResponses

    Max Planck Institute for Software Systems · Saarland University · Laboratoire d’Informatique de l’École Polytechnique +3

  39. Too Good to Be Real? Diagnosing and Reducing the Gap Between AI Preference and Real User Engagement

    Sep 16, 2026Xinglang Zhang, Yuanmeng Xiang, Yunyao Zhang +3AnalyticsPreference Alignment Learning

    Huazhong University of Science and Technology

  40. Re2A: Situated Conversational Recommendation via Rubric-based Preference Reasoning and Alignment

    Sep 16, 2026Dongding Lin, Jian Wang, Xiaoyan Zhao +1RecommendationPreference Alignment Learning

    Department of Computing, The Hong Kong Polytechnic University · College of Computer Science, Sichuan University · The Chinese University of Hong Kong

  41. Learning Heterogeneous Preferences

    Sep 15, 2026Shiwali Mohan, Matt Hong, Dule Shu +3Preference LearningPreference Alignment Learning

    Human-Centered AI Toyota Research Institute Los Altos, CA

  42. Style-Debiased DPO: Updating LLM Knowledge with Factuality-Aware Synthetic Preference Data

    Sep 15, 2026Takayuki Yamamoto, Daisuke KawaharaBacktranslation Augmented Direct Preference OptimizationParaphrasing

    Waseda University

  43. StalePO: Anchored Token-Level Preference Optimization using Legacy Post-Edits in Machine Translation

    Sep 14, 2026Rohit Dhaipule, Sukhdeep Singh Kharbanda, Prasanth Bathala +2Machine Translation QualityPreference Alignment Learning

    Translation Services, Amazon

  44. Understanding User Preferences of a Slope-Aware Variable-Admittance Filter for a Robot Guide Dog

    Sep 14, 2026Federico Esposito, Mario Selvaggio, Aaron Link +1Equivariant FilterRobot Systems

    Federico Esposito, Mario Selvaggio, Aaron Link, and Fabio Ruggiero

  45. Steering Generative Robot Policies with Lexicographic Preferences

    Sep 14, 2026Yixuan Jia, Jonathan P. HowRobot PoliciesRobot Systems

    Department of Aeronautics and Astronautics, Massachusetts Institute of Technology, Cambridge, MA 02319 USA

  46. Distortion of AI Alignment Revisited: RLHF is a Decent Utilitarian Aligner

    Sep 14, 2026Kazusato Oko, Annie Ulichney, Nika Haghtalab +1Reinforcement Learning From Human FeedbackArtificial Intelligence Alignment

  47. GUIDE: Generative Utility Inference and Decision Engine

    Sep 14, 2026Anagha Tiwari, Alexander G. Gray, Nick Feamster +3Preference Alignment LearningElicitation

    Department of Computer Science, University of Chicago · Centaur AI Institute, University of Chicago · Heinz College & School of Computer Science, Carnegie Mellon University +1

  48. Deep and shallow biases in language models

    Sep 9, 2026An Vo, Vy Tuong Dang, Khai-Nguyen Nguyen +4Large Language Model BiasBiases

    MBZUAI · University of Michigan · KAIST +2

  49. HyperTrace: Hypothesis-Based Preference Tracing for Online LLM Personalization

    Sep 9, 2026Jianzhi Shen, Keyu Mao, Minghao Shao +7Large Language Model PersonalizationPersonalization

    Johns Hopkins University · Institute of Science Tokyo · NYU Tandon +1

  50. Same Values, Different Languages? From Multilingual Probing to Steering LLMs Toward Chinese Social Values

    Sep 8, 2026Yuemei Xu, Kexin Xu, Jian Zhou +3Human ValuesLanguage Pairs

    School of Information Science and Technology, Beijing Foreign Studies University · Beijing Academy of Artificial Intelligence · The State Key Lab of Software Development Environment, Beihang University

  51. Do Reviewers Still Reward Lexical Complexity? A Frozen-Rater Study of Preference Drift in 124K ICLR Reviews

    Sep 8, 2026Jiabin ZhengRaterReviewer

    School of Computer Science, Peking University

  52. Bridging the Semantic-Utility Gap in Multimodal RAG via Generator-in-the-Loop Alignment

    Sep 8, 2026Zhan-Lun Chang, Dong-Jun Han, Seyyedali Hosseinalipour +2Multimodal Retrieval Augmented GenerationVision-Language Alignment

    Elmore Family School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN 47907, USA · Department of Computer Science and Engineering, Yonsei University, Seoul 03722, Republic of Korea · Department of Electrical Engineering, University at Buffalo–SUNY, Buffalo, NY 14260, USA

  53. From Deceptive Outputs to Deceptive Mechanisms: A Causal Framework for Language-Model Deception Research

    Sep 3, 2026Yakov Pyotr ShkolnikovDeceptionPreference Alignment Learning

    Independent Researcher

  54. ToPO: Token-Conditioned Preference Routing for Attention-Based Latent Diffusion Models

    Sep 3, 2026Juntao Xu, Shihong Li, Hoi Fan Au +1Identity-Conditioned Latent Diffusion ModelsDiffusion Models

    Tsinghua University · University of Electronic Science and Technology of China · Stanford University

  55. The Gradient Does Not See Rank: Rank-Indifference in Matrix-CODI on ProsQA

    Sep 2, 2026Samuel LarsonLow-Rank StructureMatrix

    Pebble ML

  56. VIBE-Bench: Evaluating Personalized Large Language Models When Profiles Don't Mean Preferences

    Sep 1, 2026Yiwen Jiang, Yang Deng, Stephanie Fong +9Large Language Model PersonalizationPreference Alignment Learning

    1Monash University · 2Singapore Management University · University of Liverpool +1

  57. Patterning in Practice: Debiasing Reward Models with Susceptibilities

    Sep 1, 2026George Wang, Elizabeth Donoway, Daniel MurfetProgress Reward ModelingPreference Alignment Learning

    Resolution

  58. Towards Effective Structured Context Modeling for Conversational Recommender Systems via Dual-node Monte Carlo Tree Search

    Sep 1, 2026Jincheng Zhang, Chen Huang, Wenqiang Lei +2Preference Alignment LearningMonte Carlo Tree Search

    College of Computer Science, Sichuan University · Engineering Research Center of Machine Learning and Industry Intelligence, Ministry of Education, China · Institute of Data Science, National University of Singapore +1

  59. Autoresearch for Marketplace Catalogs: From Legacy Forms to AI-Native Matching

    Aug 31, 2026Kartik Ravisankar, Hojat Abdolanezhad, Daniel Capo +3Agentic CommerceTaxonomy

    Thumbtack · San Francisco, CA, USA

  60. Hypotheses-Guided Self Distillation for Continual Personalization

    Aug 31, 2026EunJeong Hwang, Kushan Mitra, Dan Zhang +2PersonalizationPreference Alignment Learning

    University of British Columbia · Work done as an intern at Megagon Labs. · Megagon Labs, USA