mlsanityData to 7 Oct 2026

Exploring the Landscape of Machine Unlearning: A Comprehensive Survey and Taxonomy

arXiv 2305.06360 ↗First posted 10 May 2023cs.LG cs.AIcited by 44

On the map: LLM safety and security → Machine unlearning

Abstract (arXiv)

Machine unlearning (MU) is gaining increasing attention due to the need to remove or modify predictions made by machine learning (ML) models. While training models have become more efficient and accurate, the importance of unlearning previously learned information has become increasingly significant in fields such as privacy, security, and fairness. This paper presents a comprehensive survey of MU, covering current state-of-the-art techniques and approaches, including data deletion, perturbation, and model updates. In addition, commonly used metrics and datasets are also presented. The paper also highlights the challenges that need to be addressed, including attack sophistication, standardization, transferability, interpretability, training data, and resource constraints. The contributions of this paper include discussions about the potential benefits of MU and its future directions. Additionally, the paper emphasizes the need for researchers and practitioners to continue exploring and refining unlearning techniques to ensure that ML models can adapt to changing circumstances while maintaining user trust. The importance of unlearning is further highlighted in making Artificial Intelligence (AI) more trustworthy and transparent, especially with the increasing importance of AI in various domains that involve large amounts of personal user data.

Key facts. Cited by 44 papers in the map (data through 7 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 156 of its 357 references that are in the map. First posted on arXiv 10 May 2023.

Builds on

156 of 357 references.

Closest ancestors · 30

Same direction, newest first

  1. 2023SAFE: Machine Unlearning With Shard Graphs25 Apr
  2. 2023Model Sparsity Can Simplify Machine Unlearning11 Apr
  3. 2023To Be Forgotten or To Be Fair: Unveiling Fairness Implications of Machine Unlearning Methods7 Feb
  4. 2023Learning to Unlearn: Instance-wise Unlearning for Pre-trained Classifiers27 Jan
  5. 2022Privacy Adhering Machine Un-learning in NLP19 Dec
  6. 2022Proof of Unlearning: Definitions and Instantiation20 Oct
  7. 2022Verifiable and Provably Secure Machine Unlearning17 Oct
  8. 2022Forget Unlearning: Towards True Data-Deletion in Machine Learning17 Oct
  9. 2022Deep Regression Unlearning15 Oct
  10. 2022A Survey of Machine Unlearning6 Sep
  11. 2022An Introduction to Machine Unlearning2 Sep
  12. 2022Evaluating Machine Unlearning via Epistemic Uncertainty23 Aug
18 more
  1. 2022Adversarial Unlearning: Reducing Confidence Along Adversarial Directions3 Jun
  2. 2022Few-Shot Unlearning by Model Inversion31 May
  3. 2022Can Bad Teaching Induce Forgetting? Unlearning in Deep Networks using an Incompetent Teacher17 May
  4. 2022Deep Unlearning via Randomized Conditionally Independent Hessians15 Apr
  5. 2022Markov Chain Monte Carlo-Based Machine Unlearning: Unlearning What Needs to be Forgotten28 Feb
  6. 2022Deletion Inference, Reconstruction, and Compliance in Machine (Un)Learning7 Feb
  7. 2022Zero-Shot Machine Unlearning14 Jan
  8. 2021Machine unlearning via GAN22 Nov
  9. 2021Fast Yet Effective Machine Unlearning17 Nov
  10. 2021Lightweight machine unlearning in neural network10 Nov
  11. 2021On the Necessity of Auditable Algorithmic Definitions for Machine Unlearning22 Oct
  12. 2021Unrolling SGD: Understanding Factors Influencing Machine Unlearning27 Sep
  13. 2021Hard to Forget: Poisoning Attacks on Certified Machine Unlearning17 Sep
  14. 2021Machine Unlearning of Features and Labels26 Aug
  15. 2021Adaptive Machine Unlearning8 Jun
  16. 2021DeepObliviate: A Powerful Charm for Erasing Data Residual Memory in Deep Neural Networks13 May
  17. 2021Remember What You Want to Forget: Algorithms for Machine Unlearning4 Mar
  18. 2021Machine Unlearning via Algorithmic Stability25 Feb

Other references · 126

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  3. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
  4. 2022Generative Adversarial Networkscited by 5,603
  5. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  6. 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,283
  7. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  8. 2023A Survey of Large Language Modelscited by 2,537
  9. 2015Character-level Convolutional Networks for Text Classificationcited by 2,293
  10. 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,250
  11. 2016Matching Networks for One Shot Learningcited by 2,246
  12. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
38 more
  1. 2020Extracting Training Data from Large Language Modelscited by 2,144
  2. 2017EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classificationcited by 1,488
  3. 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,350
  4. 2018Relational inductive biases, deep learning, and graph networkscited by 1,341
  5. 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,313
  6. 2014How transferable are features in deep neural networks?cited by 1,216
  7. 2019Machine Unlearningcited by 1,020
  8. 2019An Introduction to Variational Autoencoderscited by 997
  9. 2017Federated Multi-Task Learningcited by 669
  10. 2019Eternal Sunshine of the Spotless Net: Selective Forgetting in Deep Networkscited by 599
  11. 2021Knowledge Neurons in Pretrained Transformerscited by 590
  12. 2018Learning to Learn without Forgetting by Maximizing Transfer and Minimizing Interferencecited by 511
  13. 2020Pruning neural networks without any data by iteratively conserving synaptic flowcited by 475
  14. 2019Making AI Forget You: Data Deletion in Machine Learningcited by 447
  15. 2020Backdoor Learning: A Surveycited by 412
  16. 2017On Fairness and Calibrationcited by 406
  17. 2021Neural Attention Distillation: Erasing Backdoor Triggers from Deep Neural Networkscited by 313
  18. 2020Knowledge Distillation and Student-Teacher Learning for Visual Intelligence: A Review and New Outlookscited by 312
  19. 2021Membership Inference Attacks on Machine Learning: A Surveycited by 306
  20. 2020Amnesiac Machine Learningcited by 305
  21. 2023Forget-Me-Not: Learning to Forget in Text-to-Image Diffusion Modelscited by 297
  22. 2020Approximate Data Deletion from Machine Learning Modelscited by 250
  23. 2017Improving the Adversarial Robustness and Interpretability of Deep Neural Networks by Regularizing their Input Gradientscited by 236
  24. 2020Dataset Security for Machine Learning: Data Poisoning, Backdoor Attacks, and Defensescited by 171
  25. 2020Mixed-Privacy Forgetting in Deep Networkscited by 158
  26. 2023Large-scale Multi-Modal Pre-trained Models: A Comprehensive Surveycited by 153
  27. 2020Probing the Probing Paradigm: Does Probing Accuracy Entail Task Relevance?cited by 144
  28. 2020DeltaGrad: Rapid retraining of machine learning modelscited by 143
  29. 2021Graph Unlearningcited by 129
  30. 2020Machine Unlearning for Random Forestscited by 125
  31. 2020A Survey on Negative Transfercited by 120
  32. 2019Unlearn Dataset Bias in Natural Language Inference by Fitting the Residualcited by 119
  33. 2019TBT: Targeted Neural Network Attack with Bit Trojancited by 112
  34. 2022The Right to be Forgotten in Federated Learning: An Efficient Realization with Rapid Retrainingcited by 109
  35. 2018A high-bias, low-variance introduction to Machine Learning for physicistscited by 108
  36. 2021Federated Unlearning via Class-Discriminative Pruningcited by 108
  37. 2019Analysis of Explainers of Black Box Deep Neural Networks for Computer Vision: A Surveycited by 93
  38. 2023SCALE-UP: An Efficient Black-box Input-level Backdoor Detection via Analyzing Scaled Prediction Consistencycited by 93

50 most cited of 126 All 126 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 4; 2024: 12; 2025: 15; 2026: 13.

44 papers.

Sort:

By area:

  1. 2024Eight Methods to Evaluate Robust Unlearning in LLMscited by 153
  2. 2024Large Language Model Unlearning via Embedding-Corrupted Promptscited by 112
  3. 2024Benchmarking Vision Language Model Unlearning via Fictitious Facial Identity Datasetcited by 29
  4. 2025Learning to Unlearn while Retaining: Combating Gradient Conflicts in Machine Unlearningcited by 19
  5. 2024Is Retain Set All You Need in Machine Unlearning? Restoring Performance of Unlearned Models with Out-Of-Distribution Imagescited by 18
  6. 2025Data Unlearning in Diffusion Modelscited by 18
  7. 2024Targeted Unlearning with Single Layer Unlearning Gradientcited by 16
  8. 2023DUCK: Distance-based Unlearning via Centroid Kinematicscited by 13
  9. 2023FRAMU: Attention-based Machine Unlearning using Federated Reinforcement Learningcited by 12
  10. 2023GraphGuard: Detecting and Counteracting Training Data Misuse in Graph Neural Networkscited by 8
  11. 2024Deep Unlearn: Benchmarking Machine Unlearning for Image Classificationcited by 8
  12. 2024Model Integrity when Unlearning with T2I Diffusion Modelscited by 7
32 more
  1. 2024A Survey on Recommendation Unlearning: Fundamentals, Taxonomy, Evaluation, and Open Questionscited by 7
  2. 2025DualOptim: Enhancing Efficacy and Stability in Machine Unlearning with Dual Optimizerscited by 6
  3. 2024Verifying Machine Unlearning with Explainable AIcited by 5
  4. 2026FG-OrIU: Towards Better Forgetting via Feature-Gradient Orthogonality for Incremental Unlearningcited by 5
  5. 2024Composable Interventions for Language Modelscited by 4
  6. 2025Unlearning Comparator: A Visual Analytics System for Comparative Evaluation of Machine Unlearning Methodscited by 4
  7. 2025CoUn: Empowering Machine Unlearning via Contrastive Learningcited by 4
  8. 2023Adaptive Multi-Agent Deep Reinforcement Learning for Timely Healthcare Interventionscited by 3
  9. 2025Unlearning's Blind Spots: Over-Unlearning and Prototypical Relearning Attackcited by 3
  10. 2026FaLW: A Forgetting-aware Loss Reweighting for Long-tailed Unlearningcited by 3
  11. 2026RAZOR: Ratio-Aware Layer Editing for Targeted Unlearning in Vision Transformers and Diffusion Modelscited by 3
  12. 2025Exploring Incremental Unlearning: Techniques, Challenges, and Future Directionscited by 2
  13. 2025FALCON: Fine-grained Activation Manipulation by Contrastive Orthogonal Unalignment for Large Language Modelcited by 1
  14. 2025Federated Unlearning Made Practical: Seamless Integration via Negated Pseudo-Gradientscited by 1
  15. 2025Apollo: A Posteriori Label-Only Membership Inference Attack Towards Machine Unlearningcited by 1
  16. 2025ZIUM: Zero-Shot Intent-Aware Adversarial Attack on Unlearned Modelscited by 1
  17. 2025Improving Unlearning with Model Updates Probably Aligned with Gradientscited by 1
  18. 2025Feature-Selective Representation Misdirection for Machine Unlearningcited by 1
  19. 2026SPARE: Self-distillation for PARameter-Efficient Removalcited by 1
  20. 2026A SISA-based Machine Unlearning Framework for Power Transformer Inter-Turn Short-Circuit Fault Localizationcited by 1
  21. 2026Designing to Forget: Deep Semi-parametric Models for Unlearningcited by 1
  22. 2026GDGU: A Gradient Difference-based Graph Unlearning Method for Cyberattack Localization in Electric Vehicle Charging Networkscited by 1
  23. 2024A Survey on Federated Unlearning: Challenges and Opportunitiescited by 0
  24. 2024Review of Digital Asset Development with Graph Neural Network Unlearningcited by 0
  25. 2025How to Protect Models against Adversarial Unlearning?cited by 0
  26. 2025Protecting the Neural Networks against FGSM Attack Using Machine Unlearningcited by 0
  27. 2026MeGU: Machine-Guided Unlearning with Target Feature Disentanglementcited by 0
  28. 2026Inducing Artificial Uncertainty in Language Modelscited by 0
  29. 2026AI Security Research Should Better Incentivize Defense Researchcited by 0
  30. 2026Characterizing Privacy-Audit Alignment in Behavioral Audit of Machine Unlearningcited by 0
  31. 2026Cross-Domain Generalization in Machine Unlearning via Label-Conditioned Energy Magnitude Regularizationcited by 0
  32. 2026CUNO: Curriculum and Preference Optimization for Stable Graph Unlearning under Mass Deletioncited by 0