cs.IRFeb 28, 2026

RAIE: Region-Aware Incremental Preference Editing with LoRA for LLM-based Recommendation

Authors: Jin Zeng, Yupeng Qi, Hui Li, Chengming Li, Ziyu Lyu, Lixin Cui, Lu Bai

Organizations: School of Cyber Science and Technology, Shenzhen Campus of Sun Yat-sen University, Shenzhen, Guangdong, China · Department of Computer Science and Technology, Xiamen University, Xiamen, Fujian, China · Artificial Intelligence Research Institute, Shenzhen MSU-BIT University, Shenzhen, Guangdong, China · School of Information, Central University of Finance and Economics, Beijing, China · 

Abstract

Large language models (LLMs) are increasingly adopted as the backbone of recommender systems. However, user-item interactions in real-world scenarios are non-stationary, making preference drift over time inevitable. Existing model update strategies mainly rely on global fine-tuning or pointwise editing, but they face two fundamental challenges: (i) imbalanced update granularity, where global updates perturb behaviors unrelated to the target while pointwise edits fail to capture broader preference shifts; (ii) unstable incremental updates, where repeated edits interfere with prior adaptations, leading to catastrophic forgetting and inconsistent recommendations. To address these issues, we propose Region-Aware Incremental Editing (RAIE), a plug-in framework that freezes the backbone model and performs region-level updates. RAIE first constructs semantically coherent preference regions via spherical k-means in the representation space. It then assigns incoming sequences to regions via confidence-aware gating and performs three localized edit operations - Update, Expand, and Add - to dynamically revise the affected region. Each region is equipped with a dedicated Low-Rank Adaptation (LoRA) module, which is trained only on the region's updated data. During inference, RAIE routes each user sequence to its corresponding region and activates the region-specific adapter for prediction. Experiments on two benchmark datasets under a time-sliced protocol that segments data into Set-up (S), Finetune (F), and Test (T) show that RAIE significantly outperforms state-of-the-art baselines while effectively mitigating forgetting. These results demonstrate that region-aware editing offers an accurate and scalable mechanism for continual adaptation in dynamic recommendation scenarios. Our code is available at https://github.com/fengaogao/RAIE.

Figures & tables

Explore similar work

CardsList
  1. CRAMER: Control via Request-Aware Masking for Editing Recommenders

    Aug 26, 2026Zhiyuan Julian Su, Naihe Feng, Zhen Luther Qin +1Recommender SystemsSequential Recommendation

  2. REPREC: Representation Driven Parameter-Efficient Recommendation System

    Jul 24, 2026Harshini Kavuru, Dwipam Katariya, Giri Iyengar +3Sequential RecommendationLarge Language Model-Based Recommendation

  3. FlexRec: Adapting LLM-based Recommenders for Flexible Needs via Reinforcement Learning

    Mar 12, 2026Yijun Pan, Weikang Qiu, Qiyao Ma +4RL for RecommendationRecommender Systems