RAIE: Region-Aware Incremental Preference Editing with LoRA for LLM-based Recommendation
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are increasingly adopted as the backbone of recommender systems. However, user-item interactions in real-world scenarios are non-stationary, making preference drift over time inevitable. Existing model update strategies mainly rely on global fine-tuning or pointwise editing, but they face two fundamental challenges: (i) imbalanced update granularity, where global updates perturb behaviors unrelated to the target while pointwise edits fail to capture broader preference shifts; (ii) unstable incremental updates, where repeated edits interfere with prior adaptations, leading to catastrophic forgetting and inconsistent recommendations. To address these issues, we propose Region-Aware Incremental Editing (RAIE), a plug-in framework that freezes the backbone model and performs region-level updates. RAIE first constructs semantically coherent preference regions via spherical k-means in the representation space. It then assigns incoming sequences to regions via confidence-aware gating and performs three localized edit operations - Update, Expand, and Add - to dynamically revise the affected region. Each region is equipped with a dedicated Low-Rank Adaptation (LoRA) module, which is trained only on the region's updated data. During inference, RAIE routes each user sequence to its corresponding region and activates the region-specific adapter for prediction. Experiments on two benchmark datasets under a time-sliced protocol that segments data into Set-up (S), Finetune (F), and Test (T) show that RAIE significantly outperforms state-of-the-art baselines while effectively mitigating forgetting. These results demonstrate that region-aware editing offers an accurate and scalable mechanism for continual adaptation in dynamic recommendation scenarios. Our code is available at https://github.com/fengaogao/RAIE.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 23 of its 39 references that are in the map. First posted on arXiv 28 Feb 2026.
Builds on
23 of 39 references.
References · 23
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
- 2022Locating and Editing Factual Associations in GPTcited by 2,609
- 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,313
- 2018Self-Attentive Sequential Recommendationcited by 1,169
- 2017Continual Learning with Deep Generative Replaycited by 1,152
- 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 952
- 2022Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)cited by 396
- 2023TALLRec: An Effective and Efficient Tuning Framework to Align Large Language Model with Recommendationcited by 336
- 2018Explicit Inductive Bias for Transfer Learning with Convolutional Networkscited by 226
11 more
- 2023Recommender Systems with Generative Retrievalcited by 191
- 2022Knowledge Graph Contrastive Learning for Recommendationcited by 69
- 2023RecRanker: Instruction Tuning Large Language Model as Ranker for Top-k Recommendationcited by 36
- 2024Customizing Language Models with Instance-wise LoRA for Sequential Recommendationcited by 32
- 2023LLMRec: Benchmarking Large Language Models on Recommendation Taskcited by 29
- 2024Editing Conceptual Knowledge for Large Language Modelscited by 21
- 2022Learn the Time to Learn: Replay Scheduling in Continual Learningcited by 11
- 2023A Self-Correcting Sequential Recommendercited by 9
- 2024ELDER: Enhancing Lifelong Model Editing with Mixture-of-LoRAcited by 8
- 2023Preliminary Study on Incremental Learning for Large Language Model-based Recommender Systemscited by 7
- 2024Better Late Than Never: Formulating and Benchmarking Recommendation Editingcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Selective LLM-Guided Regularization for Enhancing Recommendation Models
- 2025Balancing Fine-tuning and RAG: A Hybrid Strategy for Dynamic LLM Recommendation Updates
- 2025What Makes LLMs Effective Sequential Recommenders? A Study on Preference Intensity and Temporal Context
- 2024Direct Preference Optimization for LLM-Enhanced Recommendation Systems
- 2025User Feedback Alignment for LLM-powered Exploration in Large-scale Recommendation Systems
- 2026P3Rec: Distilling Prior--Posterior Preference Reasoning for LLM-based Recommendation
- 2023Large Language Models are Competitive Near Cold-start Recommenders for Language- and Item-based Preferences
- 2026Toward User Preference Alignment in LLM Recommendation via Explicit Context Feedback