mlsanityData to 7 Oct 2026

RAIE: Region-Aware Incremental Preference Editing with LoRA for LLM-based Recommendation

arXiv 2603.00638 ↗First posted 28 Feb 2026cs.IR cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) are increasingly adopted as the backbone of recommender systems. However, user-item interactions in real-world scenarios are non-stationary, making preference drift over time inevitable. Existing model update strategies mainly rely on global fine-tuning or pointwise editing, but they face two fundamental challenges: (i) imbalanced update granularity, where global updates perturb behaviors unrelated to the target while pointwise edits fail to capture broader preference shifts; (ii) unstable incremental updates, where repeated edits interfere with prior adaptations, leading to catastrophic forgetting and inconsistent recommendations. To address these issues, we propose Region-Aware Incremental Editing (RAIE), a plug-in framework that freezes the backbone model and performs region-level updates. RAIE first constructs semantically coherent preference regions via spherical k-means in the representation space. It then assigns incoming sequences to regions via confidence-aware gating and performs three localized edit operations - Update, Expand, and Add - to dynamically revise the affected region. Each region is equipped with a dedicated Low-Rank Adaptation (LoRA) module, which is trained only on the region's updated data. During inference, RAIE routes each user sequence to its corresponding region and activates the region-specific adapter for prediction. Experiments on two benchmark datasets under a time-sliced protocol that segments data into Set-up (S), Finetune (F), and Test (T) show that RAIE significantly outperforms state-of-the-art baselines while effectively mitigating forgetting. These results demonstrate that region-aware editing offers an accurate and scalable mechanism for continual adaptation in dynamic recommendation scenarios. Our code is available at https://github.com/fengaogao/RAIE.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 23 of its 39 references that are in the map. First posted on arXiv 28 Feb 2026.

Builds on

23 of 39 references.

References · 23

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  3. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  4. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
  5. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  6. 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,313
  7. 2018Self-Attentive Sequential Recommendationcited by 1,169
  8. 2017Continual Learning with Deep Generative Replaycited by 1,152
  9. 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 952
  10. 2022Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)cited by 396
  11. 2023TALLRec: An Effective and Efficient Tuning Framework to Align Large Language Model with Recommendationcited by 336
  12. 2018Explicit Inductive Bias for Transfer Learning with Convolutional Networkscited by 226
11 more
  1. 2023Recommender Systems with Generative Retrievalcited by 191
  2. 2022Knowledge Graph Contrastive Learning for Recommendationcited by 69
  3. 2023RecRanker: Instruction Tuning Large Language Model as Ranker for Top-k Recommendationcited by 36
  4. 2024Customizing Language Models with Instance-wise LoRA for Sequential Recommendationcited by 32
  5. 2023LLMRec: Benchmarking Large Language Models on Recommendation Taskcited by 29
  6. 2024Editing Conceptual Knowledge for Large Language Modelscited by 21
  7. 2022Learn the Time to Learn: Replay Scheduling in Continual Learningcited by 11
  8. 2023A Self-Correcting Sequential Recommendercited by 9
  9. 2024ELDER: Enhancing Lifelong Model Editing with Mixture-of-LoRAcited by 8
  10. 2023Preliminary Study on Incremental Learning for Large Language Model-based Recommender Systemscited by 7
  11. 2024Better Late Than Never: Formulating and Benchmarking Recommendation Editingcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Selective LLM-Guided Regularization for Enhancing Recommendation Models
  2. 2025Balancing Fine-tuning and RAG: A Hybrid Strategy for Dynamic LLM Recommendation Updates
  3. 2025What Makes LLMs Effective Sequential Recommenders? A Study on Preference Intensity and Temporal Context
  4. 2024Direct Preference Optimization for LLM-Enhanced Recommendation Systems
  5. 2025User Feedback Alignment for LLM-powered Exploration in Large-scale Recommendation Systems
  6. 2026P3Rec: Distilling Prior--Posterior Preference Reasoning for LLM-based Recommendation
  7. 2023Large Language Models are Competitive Near Cold-start Recommenders for Language- and Item-based Preferences
  8. 2026Toward User Preference Alignment in LLM Recommendation via Explicit Context Feedback