mlsanityData to 14 Oct 2026

How Secure is Forgetting? Linking Machine Unlearning to Machine Learning Attacks

arXiv 2503.20257 ↗First posted 26 Mar 2025cs.CRcited by 4

On the map: LLM safety and security → Machine unlearning

Abstract (arXiv)

As Machine Learning (ML) evolves, the complexity and sophistication of security threats against this paradigm continue to grow as well, threatening data privacy and model integrity. In response, Machine Unlearning (MU) is a recent technology that aims to remove the influence of specific data from a trained model, enabling compliance with privacy regulations and user requests. This can be done for privacy compliance (e.g., GDPR's right to be forgotten) or model refinement. However, the intersection between classical threats in ML and MU remains largely unexplored. In this Systematization of Knowledge (SoK), we provide a structured analysis of security threats in ML and their implications for MU. We analyze four major attack classes, namely, Backdoor Attacks, Membership Inference Attacks (MIA), Adversarial Attacks, and Inversion Attacks, we investigate their impact on MU and propose a novel classification based on how they are usually used in this context. Finally, we identify open challenges, including ethical considerations, and explore promising future research directions, paving the way for future research in secure and privacy-preserving Machine Unlearning.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 50 of its 80 references that are in the map. First posted on arXiv 26 Mar 2025.

Builds on

50 of 80 references.

Closest ancestors · 18

Same direction, newest first

  1. 2025CRFU: Compressive Representation Forgetting Against Privacy Leakage on Machine Unlearning27 Feb
  2. 2025Data Duplication: A Novel Multi-Purpose Attack Paradigm in Machine Unlearning28 Jan
  3. 2024Towards Robust Knowledge Unlearning: An Adversarial Framework for Assessing and Improving Unlearning Robustness in Large Language Models20 Aug
  4. 2024Reconstruction Attacks on Machine Unlearning: Simple Models are Vulnerable30 May
  5. 2024Learn What You Want to Unlearn: Unlearning Inversion Attacks against Machine Unlearning4 Apr
  6. 2024Digital Forgetting in Large Language Models: A Survey of Unlearning Methods2 Apr
  7. 2024Threats, Attacks, and Defenses in Machine Unlearning: A Survey20 Mar
  8. 2024Rethinking Machine Unlearning for Large Language Models13 Feb
  9. 2023Large Language Model Unlearning14 Oct
  10. 2023A Duty to Forget, a Right to be Assured? Exposing Vulnerabilities in Machine Unlearning Services15 Sep
  11. 2023Machine Unlearning: Solutions and Challenges14 Aug
  12. 2023Exploring the Landscape of Machine Unlearning: A Comprehensive Survey and Taxonomy10 May
6 more
  1. 2023Model Sparsity Can Simplify Machine Unlearning11 Apr
  2. 2023Towards Unbounded Machine Unlearning20 Feb
  3. 2022Zero-Shot Machine Unlearning14 Jan
  4. 2021Hard to Forget: Poisoning Attacks on Certified Machine Unlearning17 Sep
  5. 2021Machine Unlearning of Features and Labels26 Aug
  6. 2021Adaptive Machine Unlearning8 Jun

Other references · 32

  1. 2016Membership Inference Attacks against Machine Learning Modelscited by 2,281
  2. 2019Machine Unlearningcited by 1,061
  3. 2021Membership Inference Attacks From First Principlescited by 878
  4. 2017ZOO: Zeroth Order Optimization based Black-box Attacks to Deep Neural Networks without Training Substitute Modelscited by 666
  5. 2019Certified Data Removal from Machine Learning Modelscited by 535
  6. 2021Membership Inference Attacks on Machine Learning: A Surveycited by 321
  7. 2020Amnesiac Machine Learningcited by 319
  8. 2019The Secret Revealer: Generative Model-Inversion Attacks Against Deep Neural Networkscited by 246
  9. 2023Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificitycited by 206
  10. 2020When Machine Unlearning Jeopardizes Privacycited by 198
  11. 2020Forgetting Outside the Box: Scrubbing Deep Networks of Information Accessible from Input-Output Observationscited by 180
  12. 2020Mixed-Privacy Forgetting in Deep Networkscited by 163
20 more
  1. 2024Soft Prompt Threats: Attacking Safety Alignment and Unlearning in Open-Source LLMs through the Embedding Spacecited by 91
  2. 2024RLHF Deciphered: A Critical Analysis of Reinforcement Learning from Human Feedback for LLMscited by 90
  3. 2022Recommendation Unlearningcited by 80
  4. 2020Knowledge-Enriched Distributional Model Inversion Attackscited by 67
  5. 2022Backdoor Defense with Machine Unlearningcited by 65
  6. 2023A Survey on Federated Unlearning: Challenges, Methods, and Future Directionscited by 63
  7. 2020Learn to Forget: Machine Unlearning via Neuron Maskingcited by 62
  8. 2023Reconstructive Neuron Pruning for Backdoor Defensecited by 59
  9. 2020Improving Robustness to Model Inversion Attacks via Mutual Information Regularizationcited by 52
  10. 2022Federated Unlearning for On-Device Recommendationcited by 43
  11. 2023Shared Adversarial Unlearning: Backdoor Mitigation by Unlearning Shared Adversarial Examplescited by 43
  12. 2022A Survey on Gradient Inversion: Attacks, Defenses and Future Directionscited by 40
  13. 2024Federated Unlearning: A Survey on Methods, Design Guidelines, and Evaluation Metricscited by 27
  14. 2023Recommendation Unlearning via Influence Functioncited by 22
  15. 2022Unlearning Protected User Attributes in Recommendations with Adversarial Trainingcited by 20
  16. 2024Towards Unified Robustness Against Both Backdoor and Adversarial Attackscited by 10
  17. 2024Vertical Federated Unlearning via Backdoor Certificationcited by 6
  18. 2025FedMUA: Exploring the Vulnerabilities of Federated Learning to Malicious Unlearning Attackscited by 5
  19. 2024Efficient Federated Unlearning with Adaptive Differential Privacy Preservationcited by 4
  20. 2024Efficient Federated Unlearning under Plausible Deniabilitycited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 3.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023Learn to Unlearn: A Survey on Machine Unlearning
  2. 2022A Survey of Machine Unlearning
  3. 2024A Survey on Machine Unlearning: Techniques and New Emerged Privacy Risks
  4. 2024A Review on Machine Unlearning
  5. 2025Recalling The Forgotten Class Memberships: Unlearned Models Can Be Noisy Labelers to Leak Privacy
  6. 2024Machine Unlearning: Taxonomy, Metrics, Applications, Challenges, and Prospects
  7. 2024Silver Linings in the Shadows: Harnessing Membership Inference for Machine Unlearning
  8. 2025Apollo: A Posteriori Label-Only Membership Inference Attack Towards Machine Unlearning