cs.LGNov 8, 2026

Not Yet in the Profile: Uncertainty-Aware Dynamic User Profiling by Learning from Future Interactions

Authors: Jieyong Kim, Neil Shah, Dong Wang

Organizations: University of Illinois, Urbana-Champaign Champaign, USA · Pinterest Bellevue, USA

Abstract

On the Web, user profiling builds compact user representations from interaction histories for efficient personalization, and dynamic user profiling updates them as users' behavior and preferences change. However, new user behavior can be ambiguous, and its interpretation differs across users. To address this, we introduce Uncertainty-aware Adaptive Profile Manager (UAPM), which separates the claims in a user profile from interpretations of new behavior that are not yet confirmed, through a Profile, a Buffer, and a Rulebook. UAPM records user-specific interpretation and update rules in the Rulebook, keeps ambiguous evidence in the Buffer outside the Profile as evidence for later decisions, and writes supported general and situational characteristics to the Profile. We train UAPM with Privileged On-Policy Distillation with Dual Specialization (POPD-DS), which learns from recorded future interactions during training without access to them at deployment. Its first stage, Dual Specialization, distills a stronger model into a current-only Student and a future-informed model that becomes the Teacher. In the second stage, privileged on-policy distillation (POPD), only the fixed Teacher receives future interactions and guides the Student's own management decisions alongside task rewards. Experiments on three Web personalization tasks show that UAPM outperforms multiple baselines under the same downstream input budget, improving on the best same-budget baseline by up to 5%.

Figures & tables

Appendix figures & tables1 asset

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. StreamProfileBench: A Benchmark for Fine-Grained User Profile Inference in Real-World Streaming Scenarios

    May 25, 2026Sizhe Wang, Feiyu Duan, Juelin Wang +2LLM EvaluationUser Modeling

  2. Vision: "What Don't I Know About User's Preferences?" How Uncertainty Estimation Improves Proactive Assistant Alignment

    Oct 11, 2026Zhiyu An, Ziyi Xuan, Yu Yang +1Proactive AgentsUser Preference Modeling

  3. Self-supervised User Profile Generation for Personalization

    Jun 3, 2026Clark Mingxuan Ju, Yuwei Qiu, Tong Zhao +1LLM PersonalizationSelf-Supervised Learning