Overview

User preference modeling studies how to infer and represent people’s priorities from choices, interaction histories, ratings, and direct feedback so systems can make more relevant recommendations and decisions. Common approaches include choice and reward models, latent factors and user profiles, Bayesian questioning, and language-model memory; recommendation systems also use temporal models to track changing interests. A central challenge is separating stable preferences from short-term intent while learning from sparse, noisy, or biased behavior, often using online feedback or shared patterns across users. Benchmarks increasingly test whether systems update preferences over long interactions and apply them only in the right context, where reliable inference does not yet guarantee appropriate action.

Latest papers

CardsList

290 papers26 papers in the last four weeks, down 42% on the four weeks before. 0.2% of all new papers.

  1. How Web Research Agents Interpret User Priorities

    Nov 17, 2026Robin Sharma, Parisa SuchdevWeb AgentsAutonomous Research Agents

  2. Sample-efficient Personalization of Large Language Model Alignment with Multidimensional User Preference Data

    Nov 17, 2026Zhen-Yu Zhang, Jerry Huang, Gang Niu +2Preference Learning for LLMsPersonalized Language Model Alignment

  3. Enhancing Preference Detection using Eye Movement Cascade and Multilayer Combinatorial Fusion

    Nov 12, 2026Yuanhong Wu, Mary Tsaryk, Sam Watson +3User Preference ModelingClassification

  4. Can the Remaining Answers Change the Prediction? Worst-Case Stability Checks for Personalized Rating Models

    Nov 9, 2026Priyanka Siddappa, Muntaqim Ahmed Raju, Shifat Haider Al Amin +1Certified RobustnessLearning with Missing Data

  5. Not Yet in the Profile: Uncertainty-Aware Dynamic User Profiling by Learning from Future Interactions

    Nov 8, 2026Jieyong Kim, Neil Shah, Dong WangUser ModelingUser Preference Modeling

  6. TransMem: Transition-Aware Retrieval for Evolving Personal Memory

    Nov 7, 2026Shigeng Chen, Linhao Luo, Changlong Shi +2Long-Term Conversational MemoryGraph-Based Agent Memory

  7. Not Your Diary, Just Your Topic: Grading the Wrong-User Control

    Nov 6, 2026Karina Romanova, Igor Kiselev, Vladimir Platonov +5Personalized Language Model EvaluationPersonalized Language Models

  8. UPSHIFT: User Preference Steering from Human-AI Interaction Feedback Traces

    Nov 2, 2026Jingping Wang, Zhanhao Li, Shao Zhang +1Personalized Language ModelsLanguage Model Steering

  9. Think Globally, Generate Personally: Multi-View Thinking with Adaptive Generation for Generative Recommendation

    Nov 2, 2026Yuxuan Hu, Yingyi Zhang, Wenlin Zhang +11Generative RecommendationSemantic ID Recommendation

  10. DualClusterNet: Personalized Pattern-Space Composition for Next-POI Recommendation

    Nov 1, 2026Ziyang Su, Guanjie Zheng, Jilin Hu +1Sequential RecommendationUser Preference Modeling

  11. Fuzzy selective state model for forecasting the dynamics of consumer preferences

    Oct 30, 2026P. A. Golovinski, A. A. Drobyshev, A. O. ShatalovaTime Series ForecastingUser Preference Modeling

  12. Adaptive Personalization Under Preference Epistemic Uncertainty

    Oct 29, 2026Priyanka Dey, Rajarshi Das, Vikas Bahirwani +3Personalized Language ModelsPersonalized Language Model Alignment

  13. PRISM: Personalized Item Representations in User History

    Oct 29, 2026Renzhi Wu, Zikun Cui, Junjie Yang +6Sequential RecommendationRepresentation Learning

  14. Modeling Preference Dependencies with Directed Acyclic Graphs for Narrative-Driven Recommendation

    Oct 27, 2026Mingzhe Lu, Jian Qin, Ruize Qin +3Recommender SystemsPreference Modeling

  15. BehaviorMem: Building and Evaluating User Memory from Real-World E-Commerce Behavior Streams

    Oct 26, 2026Sizhe Wang, Xinghao Fang, Rui Qiu +4Agent MemoryMemory Agent Benchmarks

  16. Jev-DLC: Decision-Level Continual Learning from Typed Feedback

    Oct 22, 2026Yangyang Feng, Jianle Gan, Zhuoyan Feng +1User Preference Modeling

  17. Memory-Aware Reward Modeling: Learning Human Preferences for LLM Memory Use

    Oct 22, 2026Yijiang River Dong, Zexue He, Cheng Yu +9Memory-Augmented Language ModelsReward Modeling

  18. Abstract Priorities, Concrete Rewards: How Stated Preferences Relate to What People Reward in AI Responses

    Oct 22, 2026Zihan Chen, Lei Nico Zheng, Di ZhuUser Preference ModelingPreference Elicitation

  19. Diagnosing Personalization Failures in Mobile GUI Agents

    Oct 22, 2026Zhixin Lin, Dongliang Xu, Jungang Li +6GUI AgentsMobile GUI Agents

  20. Why Bother Me Again? Benchmarking Personal Agent Memory for Interaction Preferences

    Oct 21, 2026Jialin Li, Zhenhao Chen, Hanjun Luo +1Memory Agent BenchmarksPersonal AI Agents

  21. PerSPL: Personalized Semi-supervised Preference Learning

    Oct 21, 2026Xiaoan Xu, Tingzhou Wei, Juncheng Dong +3Personalized Reward ModelingUser Preference Modeling

  22. Steerable Pluralistic Policy Alignment from Anonymized Crowd Feedback

    Oct 17, 2026Akansha Kalra, Ellen R. Novoseller, Vernon J. Lawhern +1Pluralistic AlignmentUser Preference Modeling

  23. Bridging Exploration and Persona: Information-Directed Dueling for Test-Time Agent Personalization

    Oct 17, 2026Jie Mao, Pingchen Lu, Xiangyi Wang +4LLM PersonalizationUser Preference Modeling