Exploring the Landscape of Machine Unlearning: A Comprehensive Survey and Taxonomy
On the map: LLM safety and security → Machine unlearning
Abstract (arXiv)
Machine unlearning (MU) is gaining increasing attention due to the need to remove or modify predictions made by machine learning (ML) models. While training models have become more efficient and accurate, the importance of unlearning previously learned information has become increasingly significant in fields such as privacy, security, and fairness. This paper presents a comprehensive survey of MU, covering current state-of-the-art techniques and approaches, including data deletion, perturbation, and model updates. In addition, commonly used metrics and datasets are also presented. The paper also highlights the challenges that need to be addressed, including attack sophistication, standardization, transferability, interpretability, training data, and resource constraints. The contributions of this paper include discussions about the potential benefits of MU and its future directions. Additionally, the paper emphasizes the need for researchers and practitioners to continue exploring and refining unlearning techniques to ensure that ML models can adapt to changing circumstances while maintaining user trust. The importance of unlearning is further highlighted in making Artificial Intelligence (AI) more trustworthy and transparent, especially with the increasing importance of AI in various domains that involve large amounts of personal user data.
Key facts. Cited by 44 papers in the map (data through 7 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 156 of its 357 references that are in the map. First posted on arXiv 10 May 2023.
Builds on
156 of 357 references.
Closest ancestors · 30
Same direction, newest first
- 2023SAFE: Machine Unlearning With Shard Graphs25 Apr
- 2023Model Sparsity Can Simplify Machine Unlearning11 Apr
- 2023To Be Forgotten or To Be Fair: Unveiling Fairness Implications of Machine Unlearning Methods7 Feb
- 2023Learning to Unlearn: Instance-wise Unlearning for Pre-trained Classifiers27 Jan
- 2022Privacy Adhering Machine Un-learning in NLP19 Dec
- 2022Proof of Unlearning: Definitions and Instantiation20 Oct
- 2022Verifiable and Provably Secure Machine Unlearning17 Oct
- 2022Forget Unlearning: Towards True Data-Deletion in Machine Learning17 Oct
- 2022Deep Regression Unlearning15 Oct
- 2022A Survey of Machine Unlearning6 Sep
- 2022An Introduction to Machine Unlearning2 Sep
- 2022Evaluating Machine Unlearning via Epistemic Uncertainty23 Aug
18 more
- 2022Adversarial Unlearning: Reducing Confidence Along Adversarial Directions3 Jun
- 2022Few-Shot Unlearning by Model Inversion31 May
- 2022Can Bad Teaching Induce Forgetting? Unlearning in Deep Networks using an Incompetent Teacher17 May
- 2022Deep Unlearning via Randomized Conditionally Independent Hessians15 Apr
- 2022Markov Chain Monte Carlo-Based Machine Unlearning: Unlearning What Needs to be Forgotten28 Feb
- 2022Deletion Inference, Reconstruction, and Compliance in Machine (Un)Learning7 Feb
- 2022Zero-Shot Machine Unlearning14 Jan
- 2021Machine unlearning via GAN22 Nov
- 2021Fast Yet Effective Machine Unlearning17 Nov
- 2021Lightweight machine unlearning in neural network10 Nov
- 2021On the Necessity of Auditable Algorithmic Definitions for Machine Unlearning22 Oct
- 2021Unrolling SGD: Understanding Factors Influencing Machine Unlearning27 Sep
- 2021Hard to Forget: Poisoning Attacks on Certified Machine Unlearning17 Sep
- 2021Machine Unlearning of Features and Labels26 Aug
- 2021Adaptive Machine Unlearning8 Jun
- 2021DeepObliviate: A Powerful Charm for Erasing Data Residual Memory in Deep Neural Networks13 May
- 2021Remember What You Want to Forget: Algorithms for Machine Unlearning4 Mar
- 2021Machine Unlearning via Algorithmic Stability25 Feb
Other references · 126
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2022Generative Adversarial Networkscited by 5,603
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,283
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
- 2023A Survey of Large Language Modelscited by 2,537
- 2015Character-level Convolutional Networks for Text Classificationcited by 2,293
- 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,250
- 2016Matching Networks for One Shot Learningcited by 2,246
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,148
38 more
- 2020Extracting Training Data from Large Language Modelscited by 2,144
- 2017EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classificationcited by 1,488
- 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,350
- 2018Relational inductive biases, deep learning, and graph networkscited by 1,341
- 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,313
- 2014How transferable are features in deep neural networks?cited by 1,216
- 2019Machine Unlearningcited by 1,020
- 2019An Introduction to Variational Autoencoderscited by 997
- 2017Federated Multi-Task Learningcited by 669
- 2019Eternal Sunshine of the Spotless Net: Selective Forgetting in Deep Networkscited by 599
- 2021Knowledge Neurons in Pretrained Transformerscited by 590
- 2018Learning to Learn without Forgetting by Maximizing Transfer and Minimizing Interferencecited by 511
- 2020Pruning neural networks without any data by iteratively conserving synaptic flowcited by 475
- 2019Making AI Forget You: Data Deletion in Machine Learningcited by 447
- 2020Backdoor Learning: A Surveycited by 412
- 2017On Fairness and Calibrationcited by 406
- 2021Neural Attention Distillation: Erasing Backdoor Triggers from Deep Neural Networkscited by 313
- 2020Knowledge Distillation and Student-Teacher Learning for Visual Intelligence: A Review and New Outlookscited by 312
- 2021Membership Inference Attacks on Machine Learning: A Surveycited by 306
- 2020Amnesiac Machine Learningcited by 305
- 2023Forget-Me-Not: Learning to Forget in Text-to-Image Diffusion Modelscited by 297
- 2020Approximate Data Deletion from Machine Learning Modelscited by 250
- 2017Improving the Adversarial Robustness and Interpretability of Deep Neural Networks by Regularizing their Input Gradientscited by 236
- 2020Dataset Security for Machine Learning: Data Poisoning, Backdoor Attacks, and Defensescited by 171
- 2020Mixed-Privacy Forgetting in Deep Networkscited by 158
- 2023Large-scale Multi-Modal Pre-trained Models: A Comprehensive Surveycited by 153
- 2020Probing the Probing Paradigm: Does Probing Accuracy Entail Task Relevance?cited by 144
- 2020DeltaGrad: Rapid retraining of machine learning modelscited by 143
- 2021Graph Unlearningcited by 129
- 2020Machine Unlearning for Random Forestscited by 125
- 2020A Survey on Negative Transfercited by 120
- 2019Unlearn Dataset Bias in Natural Language Inference by Fitting the Residualcited by 119
- 2019TBT: Targeted Neural Network Attack with Bit Trojancited by 112
- 2022The Right to be Forgotten in Federated Learning: An Efficient Realization with Rapid Retrainingcited by 109
- 2018A high-bias, low-variance introduction to Machine Learning for physicistscited by 108
- 2021Federated Unlearning via Class-Discriminative Pruningcited by 108
- 2019Analysis of Explainers of Black Box Deep Neural Networks for Computer Vision: A Surveycited by 93
- 2023SCALE-UP: An Efficient Black-box Input-level Backdoor Detection via Analyzing Scaled Prediction Consistencycited by 93
50 most cited of 126 All 126 (JSON)
Built on by
Citing papers per year: 2023: 4; 2024: 12; 2025: 15; 2026: 13.
44 papers.
Sort:
By area:
- 2024Eight Methods to Evaluate Robust Unlearning in LLMscited by 153
- 2024Large Language Model Unlearning via Embedding-Corrupted Promptscited by 112
- 2024Benchmarking Vision Language Model Unlearning via Fictitious Facial Identity Datasetcited by 29
- 2025Learning to Unlearn while Retaining: Combating Gradient Conflicts in Machine Unlearningcited by 19
- 2024Is Retain Set All You Need in Machine Unlearning? Restoring Performance of Unlearned Models with Out-Of-Distribution Imagescited by 18
- 2025Data Unlearning in Diffusion Modelscited by 18
- 2024Targeted Unlearning with Single Layer Unlearning Gradientcited by 16
- 2023DUCK: Distance-based Unlearning via Centroid Kinematicscited by 13
- 2023FRAMU: Attention-based Machine Unlearning using Federated Reinforcement Learningcited by 12
- 2023GraphGuard: Detecting and Counteracting Training Data Misuse in Graph Neural Networkscited by 8
- 2024Deep Unlearn: Benchmarking Machine Unlearning for Image Classificationcited by 8
- 2024Model Integrity when Unlearning with T2I Diffusion Modelscited by 7
32 more
- 2024A Survey on Recommendation Unlearning: Fundamentals, Taxonomy, Evaluation, and Open Questionscited by 7
- 2025DualOptim: Enhancing Efficacy and Stability in Machine Unlearning with Dual Optimizerscited by 6
- 2024Verifying Machine Unlearning with Explainable AIcited by 5
- 2026FG-OrIU: Towards Better Forgetting via Feature-Gradient Orthogonality for Incremental Unlearningcited by 5
- 2024Composable Interventions for Language Modelscited by 4
- 2025Unlearning Comparator: A Visual Analytics System for Comparative Evaluation of Machine Unlearning Methodscited by 4
- 2025CoUn: Empowering Machine Unlearning via Contrastive Learningcited by 4
- 2023Adaptive Multi-Agent Deep Reinforcement Learning for Timely Healthcare Interventionscited by 3
- 2025Unlearning's Blind Spots: Over-Unlearning and Prototypical Relearning Attackcited by 3
- 2026FaLW: A Forgetting-aware Loss Reweighting for Long-tailed Unlearningcited by 3
- 2026RAZOR: Ratio-Aware Layer Editing for Targeted Unlearning in Vision Transformers and Diffusion Modelscited by 3
- 2025Exploring Incremental Unlearning: Techniques, Challenges, and Future Directionscited by 2
- 2025FALCON: Fine-grained Activation Manipulation by Contrastive Orthogonal Unalignment for Large Language Modelcited by 1
- 2025Federated Unlearning Made Practical: Seamless Integration via Negated Pseudo-Gradientscited by 1
- 2025Apollo: A Posteriori Label-Only Membership Inference Attack Towards Machine Unlearningcited by 1
- 2025ZIUM: Zero-Shot Intent-Aware Adversarial Attack on Unlearned Modelscited by 1
- 2025Improving Unlearning with Model Updates Probably Aligned with Gradientscited by 1
- 2025Feature-Selective Representation Misdirection for Machine Unlearningcited by 1
- 2026SPARE: Self-distillation for PARameter-Efficient Removalcited by 1
- 2026A SISA-based Machine Unlearning Framework for Power Transformer Inter-Turn Short-Circuit Fault Localizationcited by 1
- 2026Designing to Forget: Deep Semi-parametric Models for Unlearningcited by 1
- 2026GDGU: A Gradient Difference-based Graph Unlearning Method for Cyberattack Localization in Electric Vehicle Charging Networkscited by 1
- 2024A Survey on Federated Unlearning: Challenges and Opportunitiescited by 0
- 2024Review of Digital Asset Development with Graph Neural Network Unlearningcited by 0
- 2025How to Protect Models against Adversarial Unlearning?cited by 0
- 2025Protecting the Neural Networks against FGSM Attack Using Machine Unlearningcited by 0
- 2026MeGU: Machine-Guided Unlearning with Target Feature Disentanglementcited by 0
- 2026Inducing Artificial Uncertainty in Language Modelscited by 0
- 2026AI Security Research Should Better Incentivize Defense Researchcited by 0
- 2026Characterizing Privacy-Audit Alignment in Behavioral Audit of Machine Unlearningcited by 0
- 2026Cross-Domain Generalization in Machine Unlearning via Label-Conditioned Energy Magnitude Regularizationcited by 0
- 2026CUNO: Curriculum and Preference Optimization for Stable Graph Unlearning under Mass Deletioncited by 0
- 2026CUNO: Curriculum and Preference Optimization for Stable Graph Unlearning under Mass Deletion8 Sep 2026
- 2026Cross-Domain Generalization in Machine Unlearning via Label-Conditioned Energy Magnitude Regularization18 Aug 2026
- 2026GDGU: A Gradient Difference-based Graph Unlearning Method for Cyberattack Localization in Electric Vehicle Charging Networks17 Jun 2026
- 2026Characterizing Privacy-Audit Alignment in Behavioral Audit of Machine Unlearning12 Jun 2026
- 2026AI Security Research Should Better Incentivize Defense Research22 May 2026
- 2026Inducing Artificial Uncertainty in Language Models13 May 2026
- 2026Designing to Forget: Deep Semi-parametric Models for Unlearning24 Mar 2026
- 2026RAZOR: Ratio-Aware Layer Editing for Targeted Unlearning in Vision Transformers and Diffusion Models16 Mar 2026
- 2026A SISA-based Machine Unlearning Framework for Power Transformer Inter-Turn Short-Circuit Fault Localization7 Mar 2026
- 2026MeGU: Machine-Guided Unlearning with Target Feature Disentanglement19 Feb 2026
- 2026SPARE: Self-distillation for PARameter-Efficient Removal4 Feb 2026
- 2026FaLW: A Forgetting-aware Loss Reweighting for Long-tailed Unlearning26 Jan 2026
32 more
- 2026FG-OrIU: Towards Better Forgetting via Feature-Gradient Orthogonality for Incremental Unlearning20 Jan 2026
- 2025Feature-Selective Representation Misdirection for Machine Unlearning18 Dec 2025
- 2025Improving Unlearning with Model Updates Probably Aligned with Gradients4 Nov 2025
- 2025Protecting the Neural Networks against FGSM Attack Using Machine Unlearning3 Nov 2025
- 2025CoUn: Empowering Machine Unlearning via Contrastive Learning19 Sep 2025
- 2025Unlearning Comparator: A Visual Analytics System for Comparative Evaluation of Machine Unlearning Methods18 Aug 2025
- 2025ZIUM: Zero-Shot Intent-Aware Adversarial Attack on Unlearned Models29 Jul 2025
- 2025How to Protect Models against Adversarial Unlearning?15 Jul 2025
- 2025Apollo: A Posteriori Label-Only Membership Inference Attack Towards Machine Unlearning11 Jun 2025
- 2025Unlearning's Blind Spots: Over-Unlearning and Prototypical Relearning Attack2 Jun 2025
- 2025DualOptim: Enhancing Efficacy and Stability in Machine Unlearning with Dual Optimizers22 Apr 2025
- 2025Federated Unlearning Made Practical: Seamless Integration via Negated Pseudo-Gradients8 Apr 2025
- 2025Learning to Unlearn while Retaining: Combating Gradient Conflicts in Machine Unlearning8 Mar 2025
- 2025Data Unlearning in Diffusion Models2 Mar 2025
- 2025Exploring Incremental Unlearning: Techniques, Challenges, and Future Directions23 Feb 2025
- 2025FALCON: Fine-grained Activation Manipulation by Contrastive Orthogonal Unalignment for Large Language Model3 Feb 2025
- 2024A Survey on Recommendation Unlearning: Fundamentals, Taxonomy, Evaluation, and Open Questions17 Dec 2024
- 2024Verifying Machine Unlearning with Explainable AI20 Nov 2024
- 2024Benchmarking Vision Language Model Unlearning via Fictitious Facial Identity Dataset5 Nov 2024
- 2024Model Integrity when Unlearning with T2I Diffusion Models4 Nov 2024
- 2024Deep Unlearn: Benchmarking Machine Unlearning for Image Classification2 Oct 2024
- 2024Review of Digital Asset Development with Graph Neural Network Unlearning27 Sep 2024
- 2024Targeted Unlearning with Single Layer Unlearning Gradient16 Jul 2024
- 2024Composable Interventions for Language Models9 Jul 2024
- 2024Large Language Model Unlearning via Embedding-Corrupted Prompts12 Jun 2024
- 2024Is Retain Set All You Need in Machine Unlearning? Restoring Performance of Unlearned Models with Out-Of-Distribution Images19 Apr 2024
- 2024A Survey on Federated Unlearning: Challenges and Opportunities4 Mar 2024
- 2024Eight Methods to Evaluate Robust Unlearning in LLMs26 Feb 2024
- 2023GraphGuard: Detecting and Counteracting Training Data Misuse in Graph Neural Networks13 Dec 2023
- 2023DUCK: Distance-based Unlearning via Centroid Kinematics4 Dec 2023
- 2023Adaptive Multi-Agent Deep Reinforcement Learning for Timely Healthcare Interventions20 Sep 2023
- 2023FRAMU: Attention-based Machine Unlearning using Federated Reinforcement Learning19 Sep 2023
- 2024Eight Methods to Evaluate Robust Unlearning in LLMscited by 153
- 2024Large Language Model Unlearning via Embedding-Corrupted Promptscited by 112
- 2025Learning to Unlearn while Retaining: Combating Gradient Conflicts in Machine Unlearningcited by 19
- 2024Is Retain Set All You Need in Machine Unlearning? Restoring Performance of Unlearned Models with Out-Of-Distribution Imagescited by 18
- 2024Targeted Unlearning with Single Layer Unlearning Gradientcited by 16
- 2023DUCK: Distance-based Unlearning via Centroid Kinematicscited by 13
- 2023FRAMU: Attention-based Machine Unlearning using Federated Reinforcement Learningcited by 12
- 2024Deep Unlearn: Benchmarking Machine Unlearning for Image Classificationcited by 8
- 2025DualOptim: Enhancing Efficacy and Stability in Machine Unlearning with Dual Optimizerscited by 6
- 2024Verifying Machine Unlearning with Explainable AIcited by 5
- 2026FG-OrIU: Towards Better Forgetting via Feature-Gradient Orthogonality for Incremental Unlearningcited by 5
- 2024Composable Interventions for Language Modelscited by 4
12 most cited of 29 All 29 (JSON)
- 2026Cross-Domain Generalization in Machine Unlearning via Label-Conditioned Energy Magnitude Regularization18 Aug 2026
- 2026Characterizing Privacy-Audit Alignment in Behavioral Audit of Machine Unlearning12 Jun 2026
- 2026Designing to Forget: Deep Semi-parametric Models for Unlearning24 Mar 2026
- 2026MeGU: Machine-Guided Unlearning with Target Feature Disentanglement19 Feb 2026
- 2026FaLW: A Forgetting-aware Loss Reweighting for Long-tailed Unlearning26 Jan 2026
- 2026FG-OrIU: Towards Better Forgetting via Feature-Gradient Orthogonality for Incremental Unlearning20 Jan 2026
- 2025Feature-Selective Representation Misdirection for Machine Unlearning18 Dec 2025
- 2025Improving Unlearning with Model Updates Probably Aligned with Gradients4 Nov 2025
- 2025Protecting the Neural Networks against FGSM Attack Using Machine Unlearning3 Nov 2025
- 2025CoUn: Empowering Machine Unlearning via Contrastive Learning19 Sep 2025
- 2025Unlearning Comparator: A Visual Analytics System for Comparative Evaluation of Machine Unlearning Methods18 Aug 2025
- 2025ZIUM: Zero-Shot Intent-Aware Adversarial Attack on Unlearned Models29 Jul 2025
12 newest of 29 All 29 (JSON)
- 2025Data Unlearning in Diffusion Modelscited by 18
- 2024Model Integrity when Unlearning with T2I Diffusion Modelscited by 7
- 2026SPARE: Self-distillation for PARameter-Efficient Removalcited by 1
- 2026SPARE: Self-distillation for PARameter-Efficient Removal4 Feb 2026
- 2025Data Unlearning in Diffusion Models2 Mar 2025
- 2024Model Integrity when Unlearning with T2I Diffusion Models4 Nov 2024
- 2023GraphGuard: Detecting and Counteracting Training Data Misuse in Graph Neural Networkscited by 8
- 2024A Survey on Recommendation Unlearning: Fundamentals, Taxonomy, Evaluation, and Open Questionscited by 7
- 2023Adaptive Multi-Agent Deep Reinforcement Learning for Timely Healthcare Interventionscited by 3
- 2026A SISA-based Machine Unlearning Framework for Power Transformer Inter-Turn Short-Circuit Fault Localizationcited by 1
- 2026GDGU: A Gradient Difference-based Graph Unlearning Method for Cyberattack Localization in Electric Vehicle Charging Networkscited by 1
- 2024Review of Digital Asset Development with Graph Neural Network Unlearningcited by 0
- 2026Inducing Artificial Uncertainty in Language Modelscited by 0
- 2026AI Security Research Should Better Incentivize Defense Researchcited by 0
- 2026GDGU: A Gradient Difference-based Graph Unlearning Method for Cyberattack Localization in Electric Vehicle Charging Networks17 Jun 2026
- 2026AI Security Research Should Better Incentivize Defense Research22 May 2026
- 2026Inducing Artificial Uncertainty in Language Models13 May 2026
- 2026A SISA-based Machine Unlearning Framework for Power Transformer Inter-Turn Short-Circuit Fault Localization7 Mar 2026
- 2024A Survey on Recommendation Unlearning: Fundamentals, Taxonomy, Evaluation, and Open Questions17 Dec 2024
- 2024Review of Digital Asset Development with Graph Neural Network Unlearning27 Sep 2024
- 2023GraphGuard: Detecting and Counteracting Training Data Misuse in Graph Neural Networks13 Dec 2023
- 2023Adaptive Multi-Agent Deep Reinforcement Learning for Timely Healthcare Interventions20 Sep 2023