mlsanityData to 7 Oct 2026

Zero-shot Class Unlearning via Layer-wise Relevance Analysis and Neuronal Path Perturbation

arXiv 2410.23693 ↗First posted 31 Oct 2024cs.LG cs.CRcited by 3

On the map: LLM safety and security → Machine unlearning

Abstract (arXiv)

In the rapid advancement of artificial intelligence, privacy protection has become crucial, giving rise to machine unlearning. Machine unlearning is a technique that removes specific data influences from trained models without the need for extensive retraining. However, it faces several key challenges, including accurately implementing unlearning, ensuring privacy protection during the unlearning process, and achieving effective unlearning without significantly compromising model performance. This paper presents a novel approach to machine unlearning by employing Layer-wise Relevance Analysis and Neuronal Path Perturbation. We address three primary challenges: the lack of detailed unlearning principles, privacy guarantees in zero-shot unlearning scenario, and the balance between unlearning effectiveness and model utility. Our method balances machine unlearning performance and model utility by identifying and perturbing highly relevant neurons, thereby achieving effective unlearning. By using data not present in the original training set during the unlearning process, we satisfy the zero-shot unlearning scenario and ensure robust privacy protection. Experimental results demonstrate that our approach effectively removes targeted data from the target unlearning model while maintaining the model's utility, offering a practical solution for privacy-preserving machine learning.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 28 of its 50 references that are in the map. First posted on arXiv 31 Oct 2024.

Builds on

28 of 50 references.

Closest ancestors · 14

Same direction, newest first

  1. 2024Targeted Unlearning with Single Layer Unlearning Gradient16 Jul
  2. 2024Towards Efficient Target-Level Machine Unlearning Based on Essential Graph16 Jun
  3. 2024Don't Forget Too Much: Towards Machine Unlearning on Feature Level16 Jun
  4. 2024Class Machine Unlearning for Complex Data via Concepts Inference and Data Poisoning24 May
  5. 2023Towards Machine Unlearning Benchmarks: Forgetting the Personal Identities in Facial Recognition Systems3 Nov
  6. 2023Fast Model Debias with Machine Unlearning19 Oct
  7. 2023Fast Machine Unlearning Without Retraining Through Selective Synaptic Dampening15 Aug
  8. 2023Random Relabeling for Efficient Machine Unlearning21 May
  9. 2023Model Sparsity Can Simplify Machine Unlearning11 Apr
  10. 2023Boundary Unlearning21 Mar
  11. 2023Towards Unbounded Machine Unlearning20 Feb
  12. 2022A Survey of Machine Unlearning6 Sep
2 more
  1. 2022Zero-Shot Machine Unlearning14 Jan
  2. 2021Fast Yet Effective Machine Unlearning17 Nov

Other references · 14

  1. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  2. 2014How transferable are features in deep neural networks?cited by 1,216
  3. 2019Machine Unlearningcited by 1,020
  4. 2017Network Dissection: Quantifying Interpretability of Deep Visual Representationscited by 703
  5. 2020Amnesiac Machine Learningcited by 305
  6. 2016Layer-wise Relevance Propagation for Neural Networks with Local Renormalization Layerscited by 197
  7. 2021Graph Unlearningcited by 129
  8. 2017Learning how to explain neural networks: PatternNet and PatternAttributioncited by 84
  9. 2020Learn to Forget: Machine Unlearning via Neuron Maskingcited by 56
  10. 2020The Lottery Ticket Hypothesis for Object Recognitioncited by 34
  11. 2022Improving deep neural network generalization and robustness to background bias via layer-wise relevance propagation optimizationcited by 25
  12. 2024Novel Class Discovery for Ultra-Fine-Grained Visual Categorizationcited by 13
2 more
  1. 2024Pruning By Explaining Revisited: Optimizing Attribution Methods to Prune CNNs and Transformerscited by 11
  2. 2023Generative Adversarial Networks Unlearningcited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.