RAIE: Region-Aware Incremental Preference Editing with LoRA for LLM-based Recommendation
Organizations: School of Cyber Science and Technology, Shenzhen Campus of Sun Yat-sen University, Shenzhen, Guangdong, China · Department of Computer Science and Technology, Xiamen University, Xiamen, Fujian, China · Artificial Intelligence Research Institute, Shenzhen MSU-BIT University, Shenzhen, Guangdong, China · School of Information, Central University of Finance and Economics, Beijing, China ·
Abstract
Large language models (LLMs) are increasingly adopted as the backbone of recommender systems. However, user-item interactions in real-world scenarios are non-stationary, making preference drift over time inevitable. Existing model update strategies mainly rely on global fine-tuning or pointwise editing, but they face two fundamental challenges: (i) imbalanced update granularity, where global updates perturb behaviors unrelated to the target while pointwise edits fail to capture broader preference shifts; (ii) unstable incremental updates, where repeated edits interfere with prior adaptations, leading to catastrophic forgetting and inconsistent recommendations. To address these issues, we propose Region-Aware Incremental Editing (RAIE), a plug-in framework that freezes the backbone model and performs region-level updates. RAIE first constructs semantically coherent preference regions via spherical k-means in the representation space. It then assigns incoming sequences to regions via confidence-aware gating and performs three localized edit operations - Update, Expand, and Add - to dynamically revise the affected region. Each region is equipped with a dedicated Low-Rank Adaptation (LoRA) module, which is trained only on the region's updated data. During inference, RAIE routes each user sequence to its corresponding region and activates the region-specific adapter for prediction. Experiments on two benchmark datasets under a time-sliced protocol that segments data into Set-up (S), Finetune (F), and Test (T) show that RAIE significantly outperforms state-of-the-art baselines while effectively mitigating forgetting. These results demonstrate that region-aware editing offers an accurate and scalable mechanism for continual adaptation in dynamic recommendation scenarios. Our code is available at https://github.com/fengaogao/RAIE.
Figures & tables
| Stage | Metric | MovieLens-10M | Yelp |
| Set-up (S) | #Users | 43,021 | 41,072 |
| #Items | 4,784 | 28,404 | |
| #Interactions | 2,502,840 | 702,212 | |
| Finetune (F) | #Users | 18,168 | 39,631 |
| #Items | 8,305 | 29,657 | |
| #Interactions | 1,501,707 | 421,328 |
Recommender Systems
Recommender systems predict and rank items for people using interaction histories, content, context, and feedback.
See all 502 papers