Overview

User preference modeling studies how to infer and represent people’s priorities from choices, interaction histories, ratings, and direct feedback so systems can make more relevant recommendations and decisions. Common approaches include choice and reward models, latent factors and user profiles, Bayesian questioning, and language-model memory; recommendation systems also use temporal models to track changing interests. A central challenge is separating stable preferences from short-term intent while learning from sparse, noisy, or biased behavior, often using online feedback or shared patterns across users. Benchmarks increasingly test whether systems update preferences over long interactions and apply them only in the right context, where reliable inference does not yet guarantee appropriate action.

Latest papers

CardsList

271 papers42 papers in the last four weeks, up 45% on the four weeks before. 0.2% of all new papers.

  1. StoryLens: Preference-Aligned Story Rewriting via Context-Aware Narrative Enrichment

    May 27, 2026Hanwen Cui, Yuting Mei, Yuhang Fu +2Reward ModelingPersonalized Text Generation

  2. VitaBench 2.0: Evaluating Personalized and Proactive Agents in Long-Term User Interactions

    May 26, 2026Yuxin Chen, Yi Zhang, Zhengzhou Cai +11LLM Agent MemoryAI Agent Evaluation

  3. L2Rec: Towards Dual-View Understanding of LLMs for Personalized Recommendation

    May 26, 2026Pingjun Pan, Tingting Zhou, Peiyao Lu +3Mixture-of-Experts Language ModelsLLM Personalization

  4. LATTE: Forecasting Peer Anchored Preference Trajectories for Personalized LLM Generation

    May 26, 2026Jinze Li, Xiaoyan Yang, Shuo Yang +5LLM PersonalizationPersonalized Language Models

  5. StreamProfileBench: A Benchmark for Fine-Grained User Profile Inference in Real-World Streaming Scenarios

    May 25, 2026Sizhe Wang, Feiyu Duan, Juelin Wang +2LLM EvaluationUser Modeling

  6. Ocean4Rec: Offline LLM-Derived OCEAN Profiles for Request-Time VOD Reranking

    May 22, 2026Wonkyun Kim, Sehyun Bae, Kwanki Ahn +5Recommender SystemsLarge Language Model-Based Recommendation

  7. Truthful Online Preference Aggregation for LLM Fine-Tuning in Mobile Crowdsourcing

    May 22, 2026Shugang Hao, Lingjie DuanMechanism DesignLLM Fine-Tuning

  8. AttuneBench: A Conversation-Based Benchmark for LLM Emotional Intelligence

    May 20, 2026Kate M. Lubrano, Faisal Sayed, Ankita Rathod +4LLM EvaluationEmotion Recognition in Conversations

  9. APM: Evaluating Style Personalization in LLMs with Arbitrary Preference Mappings

    May 20, 2026Philipp Spohn, Leander Girrbach, Zeynep AkataLLM EvaluationLLM Personalization

  10. Spectral Souping: A Unified Framework for Online Preference Alignment

    May 19, 2026Yinlam Chow, Guy Tennenholtz, Ted Yun +4Multi-Objective Language Model AlignmentPreference Alignment

  11. From Volume to Value: Preference-Aligned Memory Construction for On-Device RAG

    May 18, 2026Changmin Lee, Jaemin Kim, Taesik GongRetrieval-Augmented GenerationMemory-Augmented Language Models

  12. Generative Long-term User Interest Modeling for Click-Through Rate Prediction

    May 15, 2026Jiangli Shao, Kaifu Zheng, Hao Fang +5CTR PredictionUser Modeling

  13. Agentic Recommender System with Hierarchical Belief-State Memory

    May 14, 2026Xiang Shen, Yuhang Zhou, Yifan Wu +8LLM Agent MemoryRecommender Systems

  14. Variance-aware Reward Modeling with Anchor Guidance

    May 12, 2026Shuxing Fang, Ruijian Han, Liangyu Zhang +1Pairwise Preference LearningReward Modeling

  15. When to Ask a Question: Understanding Communication Strategies in Generative AI Tools

    May 11, 2026Charlotte Park, Kate Donahue, Manish RaghavanSocial Bias in Language ModelsAlgorithmic Fairness

  16. Personalizing LLMs with Binary Feedback: A Preference-Corrected Optimization Framework

    May 11, 2026Xilai Ma, Liye Zhao, Weijun Yao +3LLM PersonalizationUser Preference Modeling

  17. Personalized Alignment Revisited: The Necessity and Sufficiency of User Diversity

    May 9, 2026Enoch Hyunwook KangLLM AlignmentPersonalized Language Model Alignment

  18. UxSID: Semantic-Aware User Interests Modeling for Ultra-Long Sequence

    May 9, 2026Hongwei Zhang, Qiqiang Zhong, Junfeng Shu +8Semantic ID RecommendationSequential Recommendation

  19. Embeddings for Preferences, Not Semantics

    May 8, 2026Carter Blair, Ariel D. Procaccia, Milind TambeText EmbeddingsWord Embeddings

  20. Bridging Textual Profiles and Latent User Embeddings for Personalization

    May 7, 2026Zhaoxuan Tan, Xiang Zhai, Yan Zhu +2Sequential RecommendationRL for Recommendation

  21. PREFER: Personalized Review Summarization with Online Preference Learning

    May 7, 2026Millend Roy, Agostino Capponi, Vineet GoyalText SummarizationE-Commerce

  22. FEDIN: Frequency-Enhanced Deep Interest Network for Click-Through Rate Prediction

    May 3, 2026Zenan Dai, Jinpeng Wang, Junwei Pan +3Sequential RecommendationFrequency-Domain Feature Learning

  23. Adaptive Querying with AI Persona Priors

    May 1, 2026Kaizheng Wang, Yuhang Wu, Assaf ZeeviLatent Variable ModelsBayesian Experimental Design

  24. DynamicPO: Dynamic Preference Optimization for Recommendation

    May 1, 2026Xingyu Hu, Kai Zhang, Jiancan Wu +7Hard Negative MiningPreference Optimization

  25. When Agents Shop for You: Role Coherence in AI-Mediated Markets

    Apr 29, 2026Soogand Alavi, Salar NozariPrivacy Leakage in Language ModelsAgentic Commerce

  26. Action-Aware Generative Sequence Modeling for Short Video Recommendation

    Apr 28, 2026Wenhao Li, Zihan Lin, Zhengxiao Guo +7Sequential RecommendationUser Preference Modeling