cs.IRMar 23, 2026

PreferRec: Learning and Transferring Pareto Preferences for Multi-objective Re-ranking

Authors: Wei Zhou, Wuyang Li, Junkai Ji, Xueliang Li, Wenjing Hong, Zexuan Zhu, Xing Tang, Xiuqiang He

Organizations: Shenzhen University, Shenzhen, China · Shenzhen Technology University, Shenzhen, China

Abstract

Multi-objective re-ranking has become a critical component of modern multi-stage recommender systems, as it tasked to balance multiple conflicting objectives such as accuracy, diversity, and fairness. Existing multi-objective re-ranking methods typically optimize aggregate objectives at the item level using static or handcrafted preference weights. This design overlooks that users inherently exhibit Pareto-optimal preferences at the intent level, reflecting personalized trade-offs among objectives rather than fixed weight combinations. Moreover, most approaches treat re-ranking task for each user as an isolated problem, and repeatedly learn the preferences from scratch. Such a paradigm not only incurs high computational cost, but also ignores the fact that users often share similar preference trade-off structures across objectives. Inspired by the existence of homogeneous multi-objective optimization spaces where Pareto-optimal patterns are transferable, we propose PreferRec, a novel framework that explicitly models and transfers Pareto preferences across users. Specifically, PreferRec is built upon three tightly coupled components: Preference-Aware Pareto Learning aims to capture user intrinsic trade-offs among multiple conflicting objectives at the intent level. By learning Pareto preference representations from re-ranking populations, this component explicitly models how users prioritize different objectives under diverse contexts. Knowledge-Guided Transfer facilitates efficient cross-user knowledge transfer by distilling shared optimization patterns across homogeneous optimization spaces. The transferred knowledge is then used to guide solution selection and personalized re-ranking, biasing the optimization process toward high-quality regions of the Pareto front while preserving user-specific preference characteristics.

Figures & tables

Appendix figures & tables6 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. RecSoup: Efficient Model Merging Approach for Controllable Multi-Objective Recommendation

    Oct 15, 2026Zidong Jia, Guofu Xie, Xiao ZhangRecommender SystemsModel Merging

  2. Breaking the Filter Bubble: A Semantic Pareto-DQN Framework for Multi-Objective Recommendation

    Jun 23, 2026Cláudio Lúcio Do Val Lopes, Lucca Machado da Silva, André de Oliveira BrandãoMulti-Objective Reinforcement LearningAlgorithmic Fairness

  3. DeepMTL2R: A Library for Deep Multi-task Learning to Rank

    Feb 16, 2026Chaosheng Dong, Peiyao Xiao, Yijia Wang +1Learning to RankMulti-Task Learning