Machine Unlearning for Robust DNNs: Attribution-Guided Partitioning and Neuron Pruning in Noisy Environments
On the map: LLM safety and security → Machine unlearning
Abstract (arXiv)
Deep neural networks (DNNs) have achieved remarkable success across diverse domains, but their performance can be severely degraded by noisy or corrupted training data. Conventional noise mitigation methods often rely on explicit assumptions about noise distributions or require extensive retraining, which can be impractical for large-scale models. Inspired by the principles of machine unlearning, we propose a novel framework that integrates attribution-guided data partitioning, discriminative neuron pruning, and targeted fine-tuning to mitigate the impact of noisy samples. Our approach employs gradient-based attribution to probabilistically distinguish high-quality examples from potentially corrupted ones without imposing restrictive assumptions on the noise. It then applies regression-based sensitivity analysis to identify and prune neurons that are most vulnerable to noise. Finally, the resulting network is fine-tuned on the high-quality data subset to efficiently recover and enhance its generalization performance. This integrated unlearning-inspired framework provides several advantages over conventional noise-robust learning approaches. Notably, it combines data-level unlearning with model-level adaptation, thereby avoiding the need for full model retraining or explicit noise modeling. We evaluate our method on representative tasks (e.g., CIFAR-10 image classification and speech recognition) under various noise levels and observe substantial gains in both accuracy and efficiency. For example, our framework achieves approximately a 10% absolute accuracy improvement over standard retraining on CIFAR-10 with injected label noise, while reducing retraining time by up to 47% in some settings. These results demonstrate the effectiveness and scalability of the proposed approach for achieving robust generalization in noisy environments.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 52 of its 74 references that are in the map. First posted on arXiv 13 Jun 2025.
Builds on
52 of 74 references.
Closest ancestors · 2
Same direction, newest first
- 2024Dissecting Language Models: Machine Unlearning via Selective Pruning2 Mar
- 2021On the Necessity of Auditable Algorithmic Definitions for Machine Unlearning22 Oct
Other references · 50
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2017Axiomatic Attribution for Deep Networkscited by 3,384
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
- 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,329
- 2013Visualizing and Understanding Convolutional Networkscited by 2,290
- 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,262
38 more
- 2015Learning both Weights and Connections for Efficient Neural Networkscited by 2,031
- 2016Understanding deep learning requires rethinking generalizationcited by 1,674
- 2016Concrete Problems in AI Safetycited by 1,642
- 2016Understanding intermediate layers using linear classifier probescited by 1,353
- 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,336
- 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,186
- 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,089
- 2019Machine Unlearningcited by 1,061
- 2018Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labelscited by 1,059
- 2018Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labelscited by 997
- 2017A Closer Look at Memorization in Deep Networkscited by 942
- 2018Reconciling modern machine learning practice and the bias-variance trade-offcited by 927
- 2017Evasion Attacks against Machine Learning at Test Timecited by 689
- 2018Learning to Reweight Examples for Robust Deep Learningcited by 675
- 2013Speech Recognition with Deep Recurrent Neural Networkscited by 669
- 2016Making Deep Neural Networks Robust to Label Noise: a Loss Correction Approachcited by 665
- 2017MentorNet: Learning Data-Driven Curriculum for Very Deep Neural Networks on Corrupted Labelscited by 653
- 2019Eternal Sunshine of the Spotless Net: Selective Forgetting in Deep Networkscited by 618
- 2017Learning Sparse Neural Networks through L0 Regularizationcited by 583
- 2019Importance Estimation for Neural Network Pruningcited by 541
- 2019Symmetric Cross Entropy for Robust Learning with Noisy Labelscited by 500
- 2018A Benchmark for Interpretability Methods in Deep Neural Networkscited by 476
- 2017Interpretation of Neural Networks is Fragilecited by 444
- 2020Movement Pruning: Adaptive Sparsity by Fine-Tuningcited by 403
- 2021Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarkscited by 395
- 2014Deep Speech: Scaling up end-to-end speech recognitioncited by 354
- 2017The (Un)reliability of saliency methodscited by 333
- 2020Amnesiac Machine Learningcited by 319
- 2019Are Anchor Points Really Indispensable in Label-Noise Learning?cited by 208
- 2017CleanNet: Transfer Learning for Scalable Image Classifier Training with Label Noisecited by 181
- 2018Dimensionality-Driven Learning with Noisy Labelscited by 173
- 2017Deep Learning is Robust to Massive Label Noisecited by 165
- 2018Learning to Learn from Noisy Labeled Datacited by 160
- 2018On the importance of single directions for generalizationcited by 99
- 2020Estimating Example Difficulty Using Variance of Gradientscited by 97
- 2018Faster gaze prediction with dense networks and Fisher pruningcited by 94
- 2019When Explanations Lie: Why Many Modified BP Attributions Failcited by 92
- 2020TODS: An Automated Time Series Outlier Detection Systemcited by 41
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Forget or Fine-tune? A Comparative Study of Machine Unlearning Strategies for Noisy Label Correction
- 2025Provable Unlearning with Gradient Ascent on Two-Layer ReLU Neural Networks
- 2025LoTUS: Large-Scale Machine Unlearning with a Taste of Uncertainty
- 2025Unleashing Uncertainty: Efficient Machine Unlearning for Generative AI
- 2025How Does Overparameterization Affect Machine Unlearning of Deep Neural Networks?
- 2024nabla τ: Gradient-based and Task-Agnostic machine Unlearning
- 2023Learn to Unlearn for Deep Neural Networks: Minimizing Unlearning Interference with Gradient Projection
- 2021Denoising Noisy Neural Networks: A Bayesian Approach with Compensation