Human Preference Modeling

Follow this topic Ask about this topic

Momentum

7 papers in the last four weeks, against 2 the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 44

All topics

Perceptually Aligned Evaluation of Style Transfer
Oct 7, 2026Yang Deng, Eleftherios Ioannou, David Mould +3Image Style Transfer Automated Evaluation
Cardiff University, UK · The Cyprus Institute, Cyprus · Carleton University, Canada +1
Logic-Logit: A Logic-Based Approach to Choice Modeling
Oct 4, 2026Shuhan Zhang, Wendi Ren, Shuang LiHuman Preference Modeling Interpretable ML
CUHK-Shenzhen
Verifiable, Articulable, and Tacit Components of Preference
Oct 2, 2026Alexander Spangher, Sheldon S. Huang, Andreas Haupt +4Human Preference Modeling Preference Learning
Stanford University · University of Toronto
Demographic Pluralism: Inference-Time Modeling of Pluralistic Human Preference Distributions
Sep 29, 2026Meng-Chen Wu, Qipin Chen, Ansh Jain +3Human Preference Modeling Inference-Time Language Model Alignment
Amazon Science
PreferenceFlow: Test-Time Guidance of Flow-Matching Robot Policies from Human Interventions
Sep 29, 2026Yiqi Tang, Diyuan Shi, Runze Li +1Flow Matching Robot Policy Learning
Westlake University
SpeechCritic: Learning a Diagnostic Speech Judge from Limited Human Preferences
Sep 28, 2026Mingyue Huo, Shivam Mehta, Bhavin Jawade +2Audio-Language Model Evaluation Human Preference Modeling
University of Illinois Urbana-Champaign · Netflix
Learning Heterogeneous Preferences
Sep 15, 2026Shiwali Mohan, Matt Hong, Dule Shu +3Pairwise Preference Learning Human Preference Modeling
Human-Centered AI Toyota Research Institute Los Altos, CA
InterSocialBench: Benchmarking Human and LLM Preferences for Companion-Robot Social Behavior
Sep 14, 2026Yaodan Xu, Boyang Guo, Yuqing Gu +4Human Preference Modeling AI Agent Benchmarks
Xdream Robotics
SVG-Score: Human-Aligned Evaluation of Text-to-SVG Generation
Sep 3, 2026Marco Cipriano, Leonardo Zini, Alexandra Schild +5VLM Evaluation Human Preference Modeling
Hasso-Plattner Institute, Germany · University of Modena and Reggio Emilia, Italy
VA-Judger: Reward Modeling from Human Preference Feedback for Joint Video-Audio Generation
Aug 19, 2026Yinming Huang, Shuyuan Tu, Xi Yan +6Reward Modeling Audio-Video Generation
Fudan University · Shanghai Innovation Institution · Yinwang Intelligent Technology Co., Ltd +1
PALMs: Using Multi Construct-Grounded Rationales for Modeling Population Preferences in LLMs
Aug 2, 2026Priyanka Dey, Brihi Joshi, Preyashi Poddar +2LLM Alignment Human Preference Modeling
University of Southern California · Information Sciences Institute
What do Reward Models Memorize?
Jul 27, 2026Ivo Verhoeven, Pushkar Mishra, Ekaterina ShutovaReward Modeling Pairwise Preference Evaluation
ILLC, University of Amsterdam, The Netherlands · Google DeepMind, London, United Kingdom
StARS: Socially Appropriate Robot Actions via a Recommender System-Driven Approach
Jul 23, 2026Erencem Ozbey, Fethiye Irmak Dogan, Jin Huang +1Human Preference Modeling Human-Robot Interaction
Bogazici University, Istanbul, Turkiye · University of Cambridge, Cambridge, United Kingdom
Co-design of LLM-based preference agents: participation may drive overtrust
Jul 23, 2026Michael J. FellHuman Preference Modeling Preference Alignment
University College London, London, UK
Rushes: A Human Preference Dataset for Pluralistic Alignment
Jul 22, 2026Michael Xu, Jorge Leandro, Sudha Rao +5Sequential Decision Making Human Preference Modeling
Microsoft Research
Step-Level Preference Learning for Generative Agents in Social Simulations
Jul 16, 2026Wenchang Gao, Pingyue Sheng, Lanlan Qiu +7Human Preference Modeling Human Behavior Simulation
Shanghai Qi Zhi Institute · Tsinghua University · Xiongan AI Institute +3
Consensus vs. Dissent: Dynamic LLM Modeling of Subjective Preferences in Group Recommenders
Jul 11, 2026Cedric Waterschoot, Nava Tintarev, Francesco BarileHuman Preference Modeling Recommender Systems
Maastricht University Maastricht, The Netherlands
A Bayesian framework for the uncanny valley in humanoid robot design
Jul 7, 2026Shimon Honda, Rin Shibano, Hideyoshi YanagisawaHuman Preference Modeling Hierarchical Bayesian Modeling
Department of Mechanical Engineering, Graduate School of Engineering, The University of Tokyo, Tokyo, Japan.
Human-Centric Reflective Architecture for Human-AI Collaborative Decision-Making
Jul 3, 2026Andreas Kouridakis, Dimitrios Patiniotis Spyropoulos, George VourosHuman Preference Modeling Human-in-the-Loop AI
University of Piraeus Piraeus, Greece
Internal Pluralism and the Limits of Pairwise Comparisons
Jul 2, 2026Bailey Flanigan, Michelle SiPairwise Preference Learning Pairwise Comparison
MIT, USA · Harvard, USA
LLM Consumer Behavior Theory: Foundations of a Novel Research Field
Jun 16, 2026Manon Reusens, Sofie Goethals, David MartensHuman Preference Modeling LLM Decision-Making
Department of Engineering Management, University of Antwerp
City landscape in sight: A crowdsourced framework for unlocking urban-scale window view perceptions from real estate imagery
Jun 13, 2026Chucai Peng, Sijie Yang, Ang Liu +3Human Preference Modeling Urban Planning
Department of Architecture, National University of Singapore, Singapore · College of Horticulture and Forestry Sciences / Hubei Engineering Technology Research Centre for Forestry Information, Huazhong Agricultural University, Wuhan, 430070, China · School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, 19104, USA +2
LLMs Can Better Capture Human Judgments--With the Right Prompts
Jun 10, 2026Danica Dillion, Chen Cecilia Liu, Baihui Wang +5Human Preference Evaluation LLM Alignment
Complexity Science Hub, Vienna · The Ohio State University · University of Cambridge +2
Nonslop: A Gamified Experiment in Human-AI Collaborative Writing
Jun 10, 2026Maria Edwards, Julian TogeliusHuman Preference Modeling Human-AI Interaction
New York University New York, USA
Hidden Consensus:Preference-Validity Compression in Human Feedback
Jun 9, 2026Dorcas Chia Ern Chua, Karen Myn Hui Lee, Jia Yue Tan +9Human Preference Modeling Preference Alignment
1YTL AI Labs · 2Universiti Malaya
Whose Norms? Disentangling Cultural and Personal Alignment in Large Language Models
Jun 5, 2026Angana Borah, Isabelle Augenstein, Rada MihalceaLLM Alignment Normative Conformity in Language Models
University of Michigan - Ann Arbor · University of Copenhagen
What Do People Actually Want From AI? Mapping Preference Plurality
Jun 4, 2026Julia Sepúlveda Coelho, Scott A. HaleLLM Alignment Human Preference Modeling
Oxford Internet Institute, University of Oxford, United Kingdom · Meedan, United States
Can We Predict The Human Preference For Text-to-Image Content Prior To Generation And Is It Even Useful To Do So?
Jun 3, 2026Joong Ho Kim, Keith G. MillsHuman Preference Modeling T2I Generation Evaluation
LSU ATHENA Lab Baton Rouge, LA, U.S.A. 70803
Coherence Maximization Improves Pluralistic Alignment
Jun 2, 2026Taslim Mahbub, Yiding Pei, Shi FengLLM Alignment Human Preference Modeling
George Washington University
Large Language Models Should Learn Personalized Rather Than Aggregated Human Preferences
May 30, 2026Cristina GarbaceaLLM Alignment Social Choice Theory
University of Chicago, Data Science Institute, Chicago, USA.

Oct 7, 2026, cs.CVJ/K move · Enter open · S save

Perceptually Aligned Evaluation of Style Transfer

Yang Deng, Eleftherios Ioannou, David Mould, Steve Maddock+2

Cardiff University, UK · The Cyprus Institute, Cyprus · Carleton University, Canada+1

Image Style Transfer Automated Evaluation Human Preference Modeling

Open paper AskPDF arXiv

Style transfer lacks a reliable evaluation standard: ground truth is inherently ill-defined, and existing automatic metrics often fail to reflect human preference. This paper introduces ASTRA (Assessment of Style TRansfer Algorithms), an approach for automatic evaluation of style transfer algorithms; it contains two components, ASTRA-Data and ASTRA-Score. ASTRA-Data consists of a benchmark image set of content and style references, a collection of style transfer results generated on the benchmark set, and user study data capturing human judgements through a two-stage pairwise comparison protocol. From these annotations, we derive ranking-based ground truth for content preservation, style fidelity, and overall preference. Based on ASTRA-Data, we construct ASTRA-Score, a learnt evaluator that predicts preference-aligned scores from content-style-stylization image triplets, enabling automatic and scalable evaluation of new models applied to the benchmark set. Experimental results demonstrate that ASTRA-Score achieves substantially higher correlation with human rankings compared to prior metrics. Overall, ASTRA establishes a robust mechanism for standardised evaluation of style transfer methods.

Momentum

Related topics

Latest papers 44