mlsanityData to 14 Oct 2026

Machine Unlearning for Robust DNNs: Attribution-Guided Partitioning and Neuron Pruning in Noisy Environments

arXiv 2506.11615 ↗First posted 13 Jun 2025cs.LGcited by 0

On the map: LLM safety and security → Machine unlearning

Abstract (arXiv)

Deep neural networks (DNNs) have achieved remarkable success across diverse domains, but their performance can be severely degraded by noisy or corrupted training data. Conventional noise mitigation methods often rely on explicit assumptions about noise distributions or require extensive retraining, which can be impractical for large-scale models. Inspired by the principles of machine unlearning, we propose a novel framework that integrates attribution-guided data partitioning, discriminative neuron pruning, and targeted fine-tuning to mitigate the impact of noisy samples. Our approach employs gradient-based attribution to probabilistically distinguish high-quality examples from potentially corrupted ones without imposing restrictive assumptions on the noise. It then applies regression-based sensitivity analysis to identify and prune neurons that are most vulnerable to noise. Finally, the resulting network is fine-tuned on the high-quality data subset to efficiently recover and enhance its generalization performance. This integrated unlearning-inspired framework provides several advantages over conventional noise-robust learning approaches. Notably, it combines data-level unlearning with model-level adaptation, thereby avoiding the need for full model retraining or explicit noise modeling. We evaluate our method on representative tasks (e.g., CIFAR-10 image classification and speech recognition) under various noise levels and observe substantial gains in both accuracy and efficiency. For example, our framework achieves approximately a 10% absolute accuracy improvement over standard retraining on CIFAR-10 with injected label noise, while reducing retraining time by up to 47% in some settings. These results demonstrate the effectiveness and scalability of the proposed approach for achieving robust generalization in noisy environments.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 52 of its 74 references that are in the map. First posted on arXiv 13 Jun 2025.

Builds on

52 of 74 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024Dissecting Language Models: Machine Unlearning via Selective Pruning2 Mar
  2. 2021On the Necessity of Auditable Algorithmic Definitions for Machine Unlearning22 Oct

Other references · 50

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  4. 2020Language Models are Few-Shot Learnerscited by 32,419
  5. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  6. 2017Proximal Policy Optimization Algorithmscited by 15,215
  7. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  8. 2017Axiomatic Attribution for Deep Networkscited by 3,384
  9. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
  10. 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,329
  11. 2013Visualizing and Understanding Convolutional Networkscited by 2,290
  12. 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,262
38 more
  1. 2015Learning both Weights and Connections for Efficient Neural Networkscited by 2,031
  2. 2016Understanding deep learning requires rethinking generalizationcited by 1,674
  3. 2016Concrete Problems in AI Safetycited by 1,642
  4. 2016Understanding intermediate layers using linear classifier probescited by 1,353
  5. 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,336
  6. 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,186
  7. 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,089
  8. 2019Machine Unlearningcited by 1,061
  9. 2018Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labelscited by 1,059
  10. 2018Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labelscited by 997
  11. 2017A Closer Look at Memorization in Deep Networkscited by 942
  12. 2018Reconciling modern machine learning practice and the bias-variance trade-offcited by 927
  13. 2017Evasion Attacks against Machine Learning at Test Timecited by 689
  14. 2018Learning to Reweight Examples for Robust Deep Learningcited by 675
  15. 2013Speech Recognition with Deep Recurrent Neural Networkscited by 669
  16. 2016Making Deep Neural Networks Robust to Label Noise: a Loss Correction Approachcited by 665
  17. 2017MentorNet: Learning Data-Driven Curriculum for Very Deep Neural Networks on Corrupted Labelscited by 653
  18. 2019Eternal Sunshine of the Spotless Net: Selective Forgetting in Deep Networkscited by 618
  19. 2017Learning Sparse Neural Networks through L0 Regularizationcited by 583
  20. 2019Importance Estimation for Neural Network Pruningcited by 541
  21. 2019Symmetric Cross Entropy for Robust Learning with Noisy Labelscited by 500
  22. 2018A Benchmark for Interpretability Methods in Deep Neural Networkscited by 476
  23. 2017Interpretation of Neural Networks is Fragilecited by 444
  24. 2020Movement Pruning: Adaptive Sparsity by Fine-Tuningcited by 403
  25. 2021Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarkscited by 395
  26. 2014Deep Speech: Scaling up end-to-end speech recognitioncited by 354
  27. 2017The (Un)reliability of saliency methodscited by 333
  28. 2020Amnesiac Machine Learningcited by 319
  29. 2019Are Anchor Points Really Indispensable in Label-Noise Learning?cited by 208
  30. 2017CleanNet: Transfer Learning for Scalable Image Classifier Training with Label Noisecited by 181
  31. 2018Dimensionality-Driven Learning with Noisy Labelscited by 173
  32. 2017Deep Learning is Robust to Massive Label Noisecited by 165
  33. 2018Learning to Learn from Noisy Labeled Datacited by 160
  34. 2018On the importance of single directions for generalizationcited by 99
  35. 2020Estimating Example Difficulty Using Variance of Gradientscited by 97
  36. 2018Faster gaze prediction with dense networks and Fisher pruningcited by 94
  37. 2019When Explanations Lie: Why Many Modified BP Attributions Failcited by 92
  38. 2020TODS: An Automated Time Series Outlier Detection Systemcited by 41

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Forget or Fine-tune? A Comparative Study of Machine Unlearning Strategies for Noisy Label Correction
  2. 2025Provable Unlearning with Gradient Ascent on Two-Layer ReLU Neural Networks
  3. 2025LoTUS: Large-Scale Machine Unlearning with a Taste of Uncertainty
  4. 2025Unleashing Uncertainty: Efficient Machine Unlearning for Generative AI
  5. 2025How Does Overparameterization Affect Machine Unlearning of Deep Neural Networks?
  6. 2024nabla τ: Gradient-based and Task-Agnostic machine Unlearning
  7. 2023Learn to Unlearn for Deep Neural Networks: Minimizing Unlearning Interference with Gradient Projection
  8. 2021Denoising Noisy Neural Networks: A Bayesian Approach with Compensation