Human Preference Modeling

Follow this topic Ask about this topic

Momentum

7 papers in the last four weeks, against 2 the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 43

All topics

Perceptually Aligned Evaluation of Style Transfer
Oct 7, 2026Yang Deng, Eleftherios Ioannou, David Mould +3Image Style Transfer Automated Evaluation
Cardiff University, UK · The Cyprus Institute, Cyprus · Carleton University, Canada +1
Logic-Logit: A Logic-Based Approach to Choice Modeling
Oct 4, 2026Shuhan Zhang, Wendi Ren, Shuang LiHuman Preference Modeling Interpretable ML
CUHK-Shenzhen
Verifiable, Articulable, and Tacit Components of Preference
Oct 2, 2026Alexander Spangher, Sheldon S. Huang, Andreas Haupt +4Human Preference Modeling Preference Learning
Stanford University · University of Toronto
Demographic Pluralism: Inference-Time Modeling of Pluralistic Human Preference Distributions
Sep 29, 2026Meng-Chen Wu, Qipin Chen, Ansh Jain +3Human Preference Modeling Inference-Time Language Model Alignment
Amazon Science
PreferenceFlow: Test-Time Guidance of Flow-Matching Robot Policies from Human Interventions
Sep 29, 2026Yiqi Tang, Diyuan Shi, Runze Li +1Flow Matching Robot Policy Learning
Westlake University
SpeechCritic: Learning a Diagnostic Speech Judge from Limited Human Preferences
Sep 28, 2026Mingyue Huo, Shivam Mehta, Bhavin Jawade +2Audio-Language Model Evaluation Human Preference Modeling
University of Illinois Urbana-Champaign · Netflix
Learning Heterogeneous Preferences
Sep 15, 2026Shiwali Mohan, Matt Hong, Dule Shu +3Pairwise Preference Learning Human Preference Modeling
Human-Centered AI Toyota Research Institute Los Altos, CA
InterSocialBench: Benchmarking Human and LLM Preferences for Companion-Robot Social Behavior
Sep 14, 2026Yaodan Xu, Boyang Guo, Yuqing Gu +4Human Preference Modeling AI Agent Benchmarks
Xdream Robotics
SVG-Score: Human-Aligned Evaluation of Text-to-SVG Generation
Sep 3, 2026Marco Cipriano, Leonardo Zini, Alexandra Schild +5VLM Evaluation Human Preference Modeling
Hasso-Plattner Institute, Germany · University of Modena and Reggio Emilia, Italy
VA-Judger: Reward Modeling from Human Preference Feedback for Joint Video-Audio Generation
Aug 19, 2026Yinming Huang, Shuyuan Tu, Xi Yan +6Reward Modeling Audio-Video Generation
Fudan University · Shanghai Innovation Institution · Yinwang Intelligent Technology Co., Ltd +1
PALMs: Using Multi Construct-Grounded Rationales for Modeling Population Preferences in LLMs
Aug 2, 2026Priyanka Dey, Brihi Joshi, Preyashi Poddar +2LLM Alignment Human Preference Modeling
University of Southern California · Information Sciences Institute
What do Reward Models Memorize?
Jul 27, 2026Ivo Verhoeven, Pushkar Mishra, Ekaterina ShutovaReward Modeling Pairwise Preference Evaluation
ILLC, University of Amsterdam, The Netherlands · Google DeepMind, London, United Kingdom
StARS: Socially Appropriate Robot Actions via a Recommender System-Driven Approach
Jul 23, 2026Erencem Ozbey, Fethiye Irmak Dogan, Jin Huang +1Human Preference Modeling Human-Robot Interaction
Bogazici University, Istanbul, Turkiye · University of Cambridge, Cambridge, United Kingdom
Co-design of LLM-based preference agents: participation may drive overtrust
Jul 23, 2026Michael J. FellHuman Preference Modeling Preference Alignment
University College London, London, UK
Rushes: A Human Preference Dataset for Pluralistic Alignment
Jul 22, 2026Michael Xu, Jorge Leandro, Sudha Rao +5Sequential Decision Making Human Preference Modeling
Microsoft Research
Step-Level Preference Learning for Generative Agents in Social Simulations
Jul 16, 2026Wenchang Gao, Pingyue Sheng, Lanlan Qiu +7Human Preference Modeling Human Behavior Simulation
Shanghai Qi Zhi Institute · Tsinghua University · Xiongan AI Institute +3
Consensus vs. Dissent: Dynamic LLM Modeling of Subjective Preferences in Group Recommenders
Jul 11, 2026Cedric Waterschoot, Nava Tintarev, Francesco BarileHuman Preference Modeling Recommender Systems
Maastricht University Maastricht, The Netherlands
A Bayesian framework for the uncanny valley in humanoid robot design
Jul 7, 2026Shimon Honda, Rin Shibano, Hideyoshi YanagisawaHuman Preference Modeling Hierarchical Bayesian Modeling
Department of Mechanical Engineering, Graduate School of Engineering, The University of Tokyo, Tokyo, Japan.
Human-Centric Reflective Architecture for Human-AI Collaborative Decision-Making
Jul 3, 2026Andreas Kouridakis, Dimitrios Patiniotis Spyropoulos, George VourosHuman Preference Modeling Human-in-the-Loop AI
University of Piraeus Piraeus, Greece
Internal Pluralism and the Limits of Pairwise Comparisons
Jul 2, 2026Bailey Flanigan, Michelle SiPairwise Preference Learning Pairwise Comparison
MIT, USA · Harvard, USA
LLM Consumer Behavior Theory: Foundations of a Novel Research Field
Jun 16, 2026Manon Reusens, Sofie Goethals, David MartensHuman Preference Modeling LLM Decision-Making
Department of Engineering Management, University of Antwerp
City landscape in sight: A crowdsourced framework for unlocking urban-scale window view perceptions from real estate imagery
Jun 13, 2026Chucai Peng, Sijie Yang, Ang Liu +3Human Preference Modeling Urban Planning
Department of Architecture, National University of Singapore, Singapore · College of Horticulture and Forestry Sciences / Hubei Engineering Technology Research Centre for Forestry Information, Huazhong Agricultural University, Wuhan, 430070, China · School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, 19104, USA +2
LLMs Can Better Capture Human Judgments--With the Right Prompts
Jun 10, 2026Danica Dillion, Chen Cecilia Liu, Baihui Wang +5Human Preference Evaluation LLM Alignment
Complexity Science Hub, Vienna · The Ohio State University · University of Cambridge +2
Nonslop: A Gamified Experiment in Human-AI Collaborative Writing
Jun 10, 2026Maria Edwards, Julian TogeliusHuman Preference Modeling Human-AI Interaction
New York University New York, USA
Hidden Consensus:Preference-Validity Compression in Human Feedback
Jun 9, 2026Dorcas Chia Ern Chua, Karen Myn Hui Lee, Jia Yue Tan +9Human Preference Modeling Preference Alignment
1YTL AI Labs · 2Universiti Malaya
Whose Norms? Disentangling Cultural and Personal Alignment in Large Language Models
Jun 5, 2026Angana Borah, Isabelle Augenstein, Rada MihalceaLLM Alignment Normative Conformity in Language Models
University of Michigan - Ann Arbor · University of Copenhagen
What Do People Actually Want From AI? Mapping Preference Plurality
Jun 4, 2026Julia Sepúlveda Coelho, Scott A. HaleLLM Alignment Human Preference Modeling
Oxford Internet Institute, University of Oxford, United Kingdom · Meedan, United States
Can We Predict The Human Preference For Text-to-Image Content Prior To Generation And Is It Even Useful To Do So?
Jun 3, 2026Joong Ho Kim, Keith G. MillsHuman Preference Modeling T2I Generation Evaluation
LSU ATHENA Lab Baton Rouge, LA, U.S.A. 70803
Coherence Maximization Improves Pluralistic Alignment
Jun 2, 2026Taslim Mahbub, Yiding Pei, Shi FengLLM Alignment Human Preference Modeling
George Washington University
Large Language Models Should Learn Personalized Rather Than Aggregated Human Preferences
May 30, 2026Cristina GarbaceaLLM Alignment Social Choice Theory
University of Chicago, Data Science Institute, Chicago, USA.
In-Context Reward Adaptation for Robust Preference Modeling
May 28, 2026Zhenyu Sun, Zheng Xu, Ermin WeiHuman Preference Modeling In-Context Learning
Northwestern University · Meta Superintelligence Labs
Learning What Evaluators Value: A Reliable Approach to Modeling Evaluator Preferences
May 15, 2026Madeline Celi Kitch, Nihar B. ShahHuman Preference Modeling Preference Learning
Carnegie Mellon University
PRISM-X: Experiments on Personalised Fine-Tuning with Human and Simulated Users
May 13, 2026Hannah Rose Kirk, Liu Leqi, Fanzhi Zeng +4LLM Evaluation LLM Sycophancy
University of Oxford · UK AI Security Institute · University of Texas at Austin +2
Response Time Enhances Alignment with Heterogeneous Preferences
May 7, 2026Federico Echenique, Alireza Fallah, Baihe Huang +1Pairwise Preference Learning LLM Alignment
Department of Economics, University of California, Berkeley · Department of Computer Science and Ken Kennedy Institute, Rice University · Departments of Electrical Engineering and Computer Sciences, University of California, Berkeley +2
Mitigating Cognitive Bias in RLHF by Altering Rationality
May 7, 2026Tiffany Horter, Andrew Markham, Niki Trigoni +1Human Preference Modeling RL from Human Feedback
University of Oxford · Brown University
StoryAlign: Evaluating and Training Reward Models for Story Generation
May 6, 2026Haotian Xia, Hao Peng, Yunjia Qi +4Reward Modeling Language Model Generation Evaluation
Department of Computer Science and Technology, Tsinghua University
Putting HUMANS first: Efficient LAM Evaluation with Human Preference Alignment
Apr 20, 2026Woody Haosheng Gan, William Held, Diyi YangAudio-Language Model Evaluation Human Preference Modeling
University of Southern California · Stanford University · OpenAthena
Efficient Personalization of Generative User Interfaces
Apr 10, 2026Yi-Hao Peng, Jeffrey P. Bigham, Jason WuPairwise Preference Learning Human Preference Modeling
Massachusetts Institute of Technology · Carnegie Mellon University · Purdue University
Who Laughs with Whom? Disentangling Influential Factors in Humor Preferences across User Clusters and LLMs
Jan 6, 2026Soichiro Murakami, Hidetaka Kamigaito, Hiroya Takamura +1LLM Evaluation Human Preference Modeling
CyberAgent · Nara Institute of Science and Technology · Institute of Science Tokyo
HAL: Inducing Human-likeness in LLMs with Alignment
Jan 6, 2026Masum Hasan, Junjie Zhao, Ehsan HoqueReward Modeling LLM Alignment
University of Rochester
Harmonious Color Pairings: Insights from Human Preference and Natural Hue Statistics
Aug 3, 2025Ortensia Forni, Alexandre Darmon, Michael BenzaquenHuman Preference Evaluation Human Preference Modeling
Econophysics Lab, Institut Louis Bachelier, 28 Pl. de la Bourse, Palais Brongniart, 75002 Paris, France · LadHyX UMR CNRS 7646, École Polytechnique, Institut Polytechnique de Paris, 91128 Palaiseau Cedex, France · Art in Research, 33 rue Censier, 75005 Paris, France +1
DPO Unchained: Your Training Algorithm is Secretly Disentangled in Human Choice Theory (and its Loss' Convexity is Dispensable)
Jul 10, 2025Wenxuan Zhou, Shujian Zhang, Brice Magdalou +4Direct Preference Optimization Human Preference Modeling
Google DeepMind · CEE-M, Univ Montpellier, CNRS, INRAE, Institut Agro · Work done while at Google DeepMind +1
A Probabilistic Approach for Model Alignment with Human Comparisons
Mar 16, 2024Junyu Cao, Mohsen BayatiHuman Preference Modeling Statistical Learning Theory
McCombs School of Business, The University of Texas at Austin · Graduate School of Business, Stanford University
KTO: Model Alignment as Prospect Theoretic Optimization
Feb 2, 2024Kawin Ethayarajh, Winnie Xu, Niklas Muennighoff +2LLM Alignment Human Preference Modeling
Stanford University · Contextual AI

Oct 7, 2026, cs.CVJ/K move · Enter open · S save

Perceptually Aligned Evaluation of Style Transfer

Yang Deng, Eleftherios Ioannou, David Mould, Steve Maddock+2

Cardiff University, UK · The Cyprus Institute, Cyprus · Carleton University, Canada+1

Image Style Transfer Automated Evaluation Human Preference Modeling

Open paper AskPDF arXiv

Style transfer lacks a reliable evaluation standard: ground truth is inherently ill-defined, and existing automatic metrics often fail to reflect human preference. This paper introduces ASTRA (Assessment of Style TRansfer Algorithms), an approach for automatic evaluation of style transfer algorithms; it contains two components, ASTRA-Data and ASTRA-Score. ASTRA-Data consists of a benchmark image set of content and style references, a collection of style transfer results generated on the benchmark set, and user study data capturing human judgements through a two-stage pairwise comparison protocol. From these annotations, we derive ranking-based ground truth for content preservation, style fidelity, and overall preference. Based on ASTRA-Data, we construct ASTRA-Score, a learnt evaluator that predicts preference-aligned scores from content-style-stylization image triplets, enabling automatic and scalable evaluation of new models applied to the benchmark set. Experimental results demonstrate that ASTRA-Score achieves substantially higher correlation with human rankings compared to prior metrics. Overall, ASTRA establishes a robust mechanism for standardised evaluation of style transfer methods.

Momentum

Related topics

Latest papers 43