Zero-shot Class Unlearning via Layer-wise Relevance Analysis and Neuronal Path Perturbation
On the map: LLM safety and security → Machine unlearning
Abstract (arXiv)
In the rapid advancement of artificial intelligence, privacy protection has become crucial, giving rise to machine unlearning. Machine unlearning is a technique that removes specific data influences from trained models without the need for extensive retraining. However, it faces several key challenges, including accurately implementing unlearning, ensuring privacy protection during the unlearning process, and achieving effective unlearning without significantly compromising model performance. This paper presents a novel approach to machine unlearning by employing Layer-wise Relevance Analysis and Neuronal Path Perturbation. We address three primary challenges: the lack of detailed unlearning principles, privacy guarantees in zero-shot unlearning scenario, and the balance between unlearning effectiveness and model utility. Our method balances machine unlearning performance and model utility by identifying and perturbing highly relevant neurons, thereby achieving effective unlearning. By using data not present in the original training set during the unlearning process, we satisfy the zero-shot unlearning scenario and ensure robust privacy protection. Experimental results demonstrate that our approach effectively removes targeted data from the target unlearning model while maintaining the model's utility, offering a practical solution for privacy-preserving machine learning.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 28 of its 50 references that are in the map. First posted on arXiv 31 Oct 2024.
Builds on
28 of 50 references.
Closest ancestors · 14
Same direction, newest first
- 2024Targeted Unlearning with Single Layer Unlearning Gradient16 Jul
- 2024Towards Efficient Target-Level Machine Unlearning Based on Essential Graph16 Jun
- 2024Don't Forget Too Much: Towards Machine Unlearning on Feature Level16 Jun
- 2024Class Machine Unlearning for Complex Data via Concepts Inference and Data Poisoning24 May
- 2023Towards Machine Unlearning Benchmarks: Forgetting the Personal Identities in Facial Recognition Systems3 Nov
- 2023Fast Model Debias with Machine Unlearning19 Oct
- 2023Fast Machine Unlearning Without Retraining Through Selective Synaptic Dampening15 Aug
- 2023Random Relabeling for Efficient Machine Unlearning21 May
- 2023Model Sparsity Can Simplify Machine Unlearning11 Apr
- 2023Boundary Unlearning21 Mar
- 2023Towards Unbounded Machine Unlearning20 Feb
- 2022A Survey of Machine Unlearning6 Sep
2 more
- 2022Zero-Shot Machine Unlearning14 Jan
- 2021Fast Yet Effective Machine Unlearning17 Nov
Other references · 14
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2014How transferable are features in deep neural networks?cited by 1,216
- 2019Machine Unlearningcited by 1,020
- 2017Network Dissection: Quantifying Interpretability of Deep Visual Representationscited by 703
- 2020Amnesiac Machine Learningcited by 305
- 2016Layer-wise Relevance Propagation for Neural Networks with Local Renormalization Layerscited by 197
- 2021Graph Unlearningcited by 129
- 2017Learning how to explain neural networks: PatternNet and PatternAttributioncited by 84
- 2020Learn to Forget: Machine Unlearning via Neuron Maskingcited by 56
- 2020The Lottery Ticket Hypothesis for Object Recognitioncited by 34
- 2022Improving deep neural network generalization and robustness to background bias via layer-wise relevance propagation optimizationcited by 25
- 2024Novel Class Discovery for Ultra-Fine-Grained Visual Categorizationcited by 13
2 more
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.