Making Recommender Systems Forget: Learning and Unlearning for Erasable Recommendation
On the map: LLM safety and security → Membership inference attacks
Abstract (arXiv)
Privacy laws and regulations enforce data-driven systems, e.g., recommender systems, to erase the data that concern individuals. As machine learning models potentially memorize the training data, data erasure should also unlearn the data lineage in models, which raises increasing interest in the problem of Machine Unlearning (MU). However, existing MU methods cannot be directly applied into recommendation. The basic idea of most recommender systems is collaborative filtering, but existing MU methods ignore the collaborative information across users and items. In this paper, we propose a general erasable recommendation framework, namely LASER, which consists of Group module and SeqTrain module. Firstly, Group module partitions users into balanced groups based on their similarity of collaborative embedding learned via hypergraph. Then SeqTrain module trains the model sequentially on all groups with curriculum learning. Both theoretical analysis and experiments on two real-world datasets demonstrate that LASER can not only achieve efficient unlearning, but also outperform the state-of-the-art unlearning framework in terms of model utility.
Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). Placed in Membership inference attacks, one of 12 directions in LLM safety and security. Builds on 19 of its 55 references that are in the map. First posted on arXiv 22 Mar 2022.
Builds on
19 of 55 references.
References · 19
- 2017Understanding Black-box Predictions via Influence Functionscited by 1,714
- 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,134
- 2017Neural Collaborative Filteringcited by 1,108
- 2019Machine Unlearningcited by 1,020
- 2016Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filteringcited by 517
- 2019Making AI Forget You: Data Deletion in Machine Learningcited by 447
- 2021Remember What You Want to Forget: Algorithms for Machine Unlearningcited by 360
- 2020Amnesiac Machine Learningcited by 305
- 2019On The Power of Curriculum Learning in Training Deep Networkscited by 285
- 2019On the Accuracy of Influence Functions for Measuring Group Effectscited by 146
- 2021Graph Unlearningcited by 129
- 2020Neural Collaborative Filtering vs. Matrix Factorization Revisitedcited by 123
7 more
- 2016Higher-order organization of complex networkscited by 109
- 2020Machine Unlearning: Linear Filtration for Logit-based Classifierscited by 89
- 2016Data Poisoning Attacks on Factorization-Based Collaborative Filteringcited by 78
- 2022Recommendation Unlearningcited by 71
- 2022PUMA: Performance Unchanged Model Augmentation for Training Data Removalcited by 56
- 2019Random Walks on Hypergraphs with Edge-Dependent Vertex Weightscited by 45
- 2021Rethinking Neural vs. Matrix-Factorization Collaborative Filtering: the Theoretical Perspectivescited by 8
Built on by
Citing papers per year: 2022: 1; 2023: 9; 2024: 10; 2025: 6; 2026: 1.
27 papers.
Sort:
By area:
- 2024MUSE: Machine Unlearning Six-Way Evaluation for Language Modelscited by 251
- 2024Rethinking Machine Unlearning for Large Language Modelscited by 247
- 2023Exploring the Landscape of Machine Unlearning: A Comprehensive Survey and Taxonomycited by 44
- 2023GNNDelete: A General Strategy for Unlearning in Graph Neural Networkscited by 43
- 2024A Review on Machine Unlearningcited by 30
- 2023MultiDelete for Multimodal Machine Unlearningcited by 20
- 2023Machine Unlearning: A Surveycited by 18
- 2024Towards Efficient and Effective Unlearning of Large Language Models for Recommendationcited by 16
- 2024MEOW: MEMOry Supervised LLM Unlearning Via Inverted Factscited by 16
- 2023Making Users Indistinguishable: Attribute-wise Unlearning in Recommender Systemscited by 15
- 2025Exact Unlearning of Finetuning Data via Model Merging at Scalecited by 14
- 2023Netflix and Forget: Efficient and Exact Machine Unlearning from Bi-linear Recommendationscited by 12
15 more
- 2025BLUR: A Benchmark for LLM Unlearning Robust to Forget-Retain Overlapcited by 12
- 2024Machine Unlearning for Recommendation Systems: An Insightcited by 9
- 2024A Survey on Recommendation Unlearning: Fundamentals, Taxonomy, Evaluation, and Open Questionscited by 7
- 2023Class-wise Federated Unlearning: Harnessing Active Forgetting with Teacher-Student Memory Generationcited by 6
- 2023Recommendation Unlearning via Matrix Correctioncited by 6
- 2024Multi-Modal Recommendation Unlearning for Legal, Licensing, and Modality Constraintscited by 5
- 2024Controllable Unlearning for Image-to-Image Generative Models via varepsilon-Constrained Optimizationcited by 5
- 2023On the Effectiveness of Unlearning in Session-Based Recommendationcited by 4
- 2024Privacy in LLM-based Recommendation: Recent Advances and Future Directionscited by 2
- 2025Membership Inference Attacks on Recommender System: A Surveycited by 2
- 2025Customized Retrieval-Augmented Generation with LLM for Debiasing Recommendation Unlearningcited by 1
- 2026U-CAN: Utility-Aware Contrastive Attenuation for Efficient Unlearning in Generative Recommendationcited by 1
- 2022Recommendation with User Active Disclosing Willingnesscited by 0
- 2025Pre-training for Recommendation Unlearningcited by 0
- 2025LEGO: A Lightweight and Efficient Multiple-Attribute Unlearning Framework for Recommender Systemscited by 0
- 2026U-CAN: Utility-Aware Contrastive Attenuation for Efficient Unlearning in Generative Recommendation26 Feb 2026
- 2025LEGO: A Lightweight and Efficient Multiple-Attribute Unlearning Framework for Recommender Systems23 Oct 2025
- 2025Membership Inference Attacks on Recommender System: A Survey14 Sep 2025
- 2025Customized Retrieval-Augmented Generation with LLM for Debiasing Recommendation Unlearning10 Sep 2025
- 2025BLUR: A Benchmark for LLM Unlearning Robust to Forget-Retain Overlap28 May 2025
- 2025Pre-training for Recommendation Unlearning28 May 2025
- 2025Exact Unlearning of Finetuning Data via Model Merging at Scale6 Apr 2025
- 2024A Survey on Recommendation Unlearning: Fundamentals, Taxonomy, Evaluation, and Open Questions17 Dec 2024
- 2024A Review on Machine Unlearning18 Nov 2024
- 2024MEOW: MEMOry Supervised LLM Unlearning Via Inverted Facts18 Sep 2024
- 2024Controllable Unlearning for Image-to-Image Generative Models via varepsilon-Constrained Optimization3 Aug 2024
- 2024MUSE: Machine Unlearning Six-Way Evaluation for Language Models8 Jul 2024
15 more
- 2024Privacy in LLM-based Recommendation: Recent Advances and Future Directions3 Jun 2024
- 2024Multi-Modal Recommendation Unlearning for Legal, Licensing, and Modality Constraints24 May 2024
- 2024Towards Efficient and Effective Unlearning of Large Language Models for Recommendation6 Mar 2024
- 2024Rethinking Machine Unlearning for Large Language Models13 Feb 2024
- 2024Machine Unlearning for Recommendation Systems: An Insight17 Jan 2024
- 2023On the Effectiveness of Unlearning in Session-Based Recommendation22 Dec 2023
- 2023MultiDelete for Multimodal Machine Unlearning18 Nov 2023
- 2023Making Users Indistinguishable: Attribute-wise Unlearning in Recommender Systems6 Oct 2023
- 2023Recommendation Unlearning via Matrix Correction29 Jul 2023
- 2023Class-wise Federated Unlearning: Harnessing Active Forgetting with Teacher-Student Memory Generation7 Jul 2023
- 2023Machine Unlearning: A Survey6 Jun 2023
- 2023Exploring the Landscape of Machine Unlearning: A Comprehensive Survey and Taxonomy10 May 2023
- 2023GNNDelete: A General Strategy for Unlearning in Graph Neural Networks26 Feb 2023
- 2023Netflix and Forget: Efficient and Exact Machine Unlearning from Bi-linear Recommendations13 Feb 2023
- 2022Recommendation with User Active Disclosing Willingness25 Oct 2022
- 2024MUSE: Machine Unlearning Six-Way Evaluation for Language Modelscited by 251
- 2023Exploring the Landscape of Machine Unlearning: A Comprehensive Survey and Taxonomycited by 44
- 2024A Review on Machine Unlearningcited by 30
- 2023MultiDelete for Multimodal Machine Unlearningcited by 20
- 2023Machine Unlearning: A Surveycited by 18
- 2024Towards Efficient and Effective Unlearning of Large Language Models for Recommendationcited by 16
- 2024MEOW: MEMOry Supervised LLM Unlearning Via Inverted Factscited by 16
- 2023Making Users Indistinguishable: Attribute-wise Unlearning in Recommender Systemscited by 15
- 2025Exact Unlearning of Finetuning Data via Model Merging at Scalecited by 14
- 2023Netflix and Forget: Efficient and Exact Machine Unlearning from Bi-linear Recommendationscited by 12
- 2025BLUR: A Benchmark for LLM Unlearning Robust to Forget-Retain Overlapcited by 12
- 2024Machine Unlearning for Recommendation Systems: An Insightcited by 9
12 most cited of 18 All 18 (JSON)
- 2026U-CAN: Utility-Aware Contrastive Attenuation for Efficient Unlearning in Generative Recommendation26 Feb 2026
- 2025LEGO: A Lightweight and Efficient Multiple-Attribute Unlearning Framework for Recommender Systems23 Oct 2025
- 2025Membership Inference Attacks on Recommender System: A Survey14 Sep 2025
- 2025BLUR: A Benchmark for LLM Unlearning Robust to Forget-Retain Overlap28 May 2025
- 2025Pre-training for Recommendation Unlearning28 May 2025
- 2025Exact Unlearning of Finetuning Data via Model Merging at Scale6 Apr 2025
- 2024A Review on Machine Unlearning18 Nov 2024
- 2024MEOW: MEMOry Supervised LLM Unlearning Via Inverted Facts18 Sep 2024
- 2024Controllable Unlearning for Image-to-Image Generative Models via varepsilon-Constrained Optimization3 Aug 2024
- 2024MUSE: Machine Unlearning Six-Way Evaluation for Language Models8 Jul 2024
- 2024Towards Efficient and Effective Unlearning of Large Language Models for Recommendation6 Mar 2024
- 2024Machine Unlearning for Recommendation Systems: An Insight17 Jan 2024
12 newest of 18 All 18 (JSON)
- 2024Rethinking Machine Unlearning for Large Language Modelscited by 247
- 2024Rethinking Machine Unlearning for Large Language Models13 Feb 2024
- 2023GNNDelete: A General Strategy for Unlearning in Graph Neural Networkscited by 43
- 2024A Survey on Recommendation Unlearning: Fundamentals, Taxonomy, Evaluation, and Open Questionscited by 7
- 2023Recommendation Unlearning via Matrix Correctioncited by 6
- 2024Multi-Modal Recommendation Unlearning for Legal, Licensing, and Modality Constraintscited by 5
- 2023On the Effectiveness of Unlearning in Session-Based Recommendationcited by 4
- 2024Privacy in LLM-based Recommendation: Recent Advances and Future Directionscited by 2
- 2022Recommendation with User Active Disclosing Willingnesscited by 0
- 2024A Survey on Recommendation Unlearning: Fundamentals, Taxonomy, Evaluation, and Open Questions17 Dec 2024
- 2024Privacy in LLM-based Recommendation: Recent Advances and Future Directions3 Jun 2024
- 2024Multi-Modal Recommendation Unlearning for Legal, Licensing, and Modality Constraints24 May 2024
- 2023On the Effectiveness of Unlearning in Session-Based Recommendation22 Dec 2023
- 2023Recommendation Unlearning via Matrix Correction29 Jul 2023
- 2023GNNDelete: A General Strategy for Unlearning in Graph Neural Networks26 Feb 2023
- 2022Recommendation with User Active Disclosing Willingness25 Oct 2022