mlsanityData to 14 Oct 2026

CURE:Circuit-Aware Unlearning for LLM-based Recommendation

arXiv 2604.04982 ↗First posted 4 Apr 2026cs.IR cs.AI cs.CLcited by 6

On the map: LLM safety and security → Membership inference attacks

also in 1 more
Abstract (arXiv)

Recent advances in large language models (LLMs) have opened new opportunities for recommender systems by enabling rich semantic understanding and reasoning about user interests and item attributes. However, as privacy regulations tighten, incorporating user data into LLM-based recommendation (LLMRec) introduces significant privacy risks, making unlearning algorithms increasingly crucial for practical deployment. Despite growing interest in LLMRec unlearning, most existing approaches formulate unlearning as a weighted combination of forgetting and retaining objectives while updating model parameters in a uniform manner. Such formulations inevitably induce gradient conflicts between the two objectives, leading to unstable optimization and resulting in either ineffective unlearning or severe degradation of model utility. Moreover, the unlearning procedure remains largely black-box, undermining its transparency and trustworthiness. To tackle these challenges, we propose CURE, a circuit-aware unlearning framework that disentangles model components into functionally distinct subsets and selectively updates them. Here, a circuit refers to a computational subgraph that is causally responsible for task-specific behaviors. Specifically, we extract the core circuits underlying item recommendation and analyze how individual modules within these circuits contribute to the forget and retain objectives. Based on this analysis, these modules are categorized into forget-specific, retain-specific, and task-shared groups, each subject to function-specific update rules to mitigate gradient conflicts during unlearning. Experiments on real-world datasets show that our approach achieves more effective unlearning than existing baselines.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Membership inference attacks, one of 12 directions in LLM safety and security. Builds on 18 of its 34 references that are in the map. First posted on arXiv 4 Apr 2026.

Builds on

18 of 34 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024CURE4Rec: A Benchmark for Recommendation Unlearning with Deeper Influence26 Aug

Other references · 17

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2022Locating and Editing Factual Associations in GPTcited by 2,691
  3. 2020Gradient Surgery for Multi-Task Learningcited by 1,256
  4. 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,165
  5. 2019Machine Unlearningcited by 1,061
  6. 2023Towards Automated Circuit Discovery for Mechanistic Interpretabilitycited by 724
  7. 2023Attribution Patching Outperforms Automated Circuit Discoverycited by 209
  8. 2024Have Faith in Faithfulness: Going Beyond Circuit Overlap When Finding Model Mechanismscited by 149
  9. 2021Low-Complexity Probing via Finding Subnetworkscited by 64
  10. 2025Parameter-Efficient Fine-Tuning for Foundation Modelscited by 45
  11. 2025BLUR: A Bi-Level Optimization Approach for LLM Unlearningcited by 23
  12. 2024Efficient Algorithms for Personalized PageRank Computation: A Surveycited by 21
5 more
  1. 2025Learning to Unlearn while Retaining: Combating Gradient Conflicts in Machine Unlearningcited by 19
  2. 2024Exact and Efficient Unlearning for Large Language Model-based Recommendationcited by 17
  3. 2025Tool Unlearning for Tool-Augmented LLMscited by 17
  4. 2025Gradient Surgery for Safe LLM Fine-Tuningcited by 11
  5. 2026A Mechanistic Perspective and Circuit-Guided Difficulty Metric for Unlearningcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Towards Efficient and Effective Unlearning of Large Language Models for Recommendation
  2. 2025Pre-training for Recommendation Unlearning
  3. 2026Obliviate: Efficient Unlearning in Recommender Systems
  4. 2024Machine Unlearning for Recommendation Systems: An Insight
  5. 2025EAGER-LLM: Enhancing Large Language Models as Recommenders through Exogenous Behavior-Semantic Integration
  6. 2025Scaling Down, Serving Fast: Compressing and Deploying Efficient LLMs for Recommendation Systems
  7. 2023LLMRec: Large Language Models with Graph Augmentation for Recommendation
  8. 2024Unified Parameter-Efficient Unlearning for LLMs