Data Augmentation Improves Machine Unlearning
On the map: LLM safety and security → Machine unlearning
Abstract (arXiv)
Machine Unlearning (MU) aims to remove the influence of specific data from a trained model while preserving its performance on the remaining data. Although a few works suggest connections between memorisation and augmentation, the role of systematic augmentation design in MU remains under-investigated. In this work, we investigate the impact of different data augmentation strategies on the performance of unlearning methods, including SalUn, Random Label, and Fine-Tuning. Experiments conducted on CIFAR-10 and CIFAR-100, under varying forget rates, show that proper augmentation design can significantly improve unlearning effectiveness, reducing the performance gap to retrained models. Results showed a reduction of up to 40.12% of the Average Gap unlearning Metric, when using TrivialAug augmentation. Our results suggest that augmentation not only helps reduce memorization but also plays a crucial role in achieving privacy-preserving and efficient unlearning.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 19 of its 26 references that are in the map. First posted on arXiv 25 Aug 2025.
Builds on
19 of 26 references.
Closest ancestors · 7
Same direction, newest first
- 2024A Review on Machine Unlearning18 Nov
- 2024Label Smoothing Improves Machine Unlearning11 Jun
- 2024What makes unlearning hard and what to do about it3 Jun
- 2024Machine Unlearning: Taxonomy, Metrics, Applications, Challenges, and Prospects13 Mar
- 2023SalUn: Empowering Machine Unlearning via Gradient-based Weight Saliency in Both Image Classification and Generation19 Oct
- 2023Model Sparsity Can Simplify Machine Unlearning11 Apr
- 2021Machine Unlearning of Features and Labels26 Aug
Other references · 12
- 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,269
- 2017Random Erasing Data Augmentationcited by 1,239
- 2019Machine Unlearningcited by 1,061
- 2019AugMix: A Simple Data Processing Method to Improve Robustness and Uncertaintycited by 901
- 2018AutoAugment: Learning Augmentation Policies from Datacited by 730
- 2019Eternal Sunshine of the Spotless Net: Selective Forgetting in Deep Networkscited by 618
- 2020Amnesiac Machine Learningcited by 319
- 2021TrivialAugment: Tuning-free Yet State-of-the-Art Data Augmentationcited by 227
- 2016Wider or Deeper: Revisiting the ResNet Model for Visual Recognitioncited by 184
- 2022Talking About Large Language Modelscited by 175
- 2018Data Augmentation using Random Image Cropping and Patching for Deep CNNscited by 88
- 2024A survey of synthetic data augmentation methods in computer visioncited by 34
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025When to Forget? Complexity Trade-offs in Machine Unlearning
- 2024Scalability of memorization-based machine unlearning
- 2023Exploring the Landscape of Machine Unlearning: A Comprehensive Survey and Taxonomy
- 2024Machine unlearning through fine-grained model parameters perturbation
- 2024Machine Unlearning in Forgettability Sequence
- 2024Towards Natural Machine Unlearning
- 2025Are We Truly Forgetting? A Critical Re-examination of Machine Unlearning Evaluation Protocols
- 2026Forgetting Similar Samples: Can Machine Unlearning Do it Better?