mlsanityData to 7 Oct 2026

Class Machine Unlearning for Complex Data via Concepts Inference and Data Poisoning

arXiv 2405.15662 ↗First posted 24 May 2024cs.LGcited by 5

On the map: LLM safety and security → Machine unlearning

Abstract (arXiv)

Machine unlearning aims to remove the influence of specified training data or knowledge from a trained model without requiring full retraining. This capability is particularly important for modern image classifiers and large language models (LLMs), where retraining can be computationally expensive. However, machine unlearning on complex data remains difficult because the target information is often distributed across multiple semantic elements. Existing methods mainly remove samples, modify labels, or edit model parameters to reduce the influence of the forgetting target. These approaches usually do not explicitly identify which semantic concepts connect the forgetting target to the model's prediction or generated response. As a result, it is difficult to determine which information to modify. This uncertainty may leave residual target information or unnecessarily affect knowledge that should be retained. To address this gap, we propose a concept-guided poisoning unlearning framework that explicitly identifies the concepts that contribute most strongly to the target class or knowledge and uses them to guide the model update. For image classification, our method first identifies class-relevant concepts with a Post-hoc Concept Bottleneck Model, localizes the image regions that express these concepts, and constructs replacement-based poisoned samples. For LLMs, it elicits the target knowledge through multiple questions, aggregates Integrated Gradients across the resulting responses to identify consistently important content, and masks this content to construct poisoned training targets. Experiments on multiple datasets show that the proposed framework achieves effective unlearning across different tasks while largely preserving retained model utility.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 32 of its 50 references that are in the map. First posted on arXiv 24 May 2024.

Builds on

32 of 50 references.

Closest ancestors · 11

Same direction, newest first

  1. 2024Machine Unlearning via Null Space Calibration21 Apr
  2. 2024Negative Preference Optimization: From Catastrophic Collapse to Effective Unlearning8 Apr
  3. 2024The Frontier of Data Erasure: Machine Unlearning for Large Language Models23 Mar
  4. 2024TOFU: A Task of Fictitious Unlearning for LLMs11 Jan
  5. 2023Reinforcement Unlearning26 Dec
  6. 2023SalUn: Empowering Machine Unlearning via Gradient-based Weight Saliency in Both Image Classification and Generation19 Oct
  7. 2023Large Language Model Unlearning14 Oct
  8. 2023In-Context Unlearning: Language Models as Few Shot Unlearners11 Oct
  9. 2023Who's Harry Potter? Approximate Unlearning in LLMs3 Oct
  10. 2023Boundary Unlearning21 Mar
  11. 2022Knowledge Unlearning for Mitigating Privacy Risks in Language Models4 Oct

Other references · 21

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  4. 2017Axiomatic Attribution for Deep Networkscited by 3,350
  5. 2016Membership Inference Attacks against Machine Learning Modelscited by 2,221
  6. 2023A Survey on Evaluation of Large Language Modelscited by 1,227
  7. 2020Concept Bottleneck Modelscited by 1,022
  8. 2019Machine Unlearningcited by 1,020
  9. 2024The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearningcited by 488
  10. 2017Efficient Processing of Deep Neural Networks: A Tutorial and Surveycited by 427
  11. 2020A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospectscited by 396
  12. 2020Amnesiac Machine Learningcited by 305
9 more
  1. 2022Post-hoc Concept Bottleneck Modelscited by 289
  2. 2021Graph Unlearningcited by 129
  3. 2021Federated Unlearning via Class-Discriminative Pruningcited by 108
  4. 2021Guided Integrated Gradients: An Adaptive Path Method for Removing Noisecited by 102
  5. 2020Machine Unlearning: Linear Filtration for Logit-based Classifierscited by 89
  6. 2022Recommendation Unlearningcited by 71
  7. 2020Learn to Forget: Machine Unlearning via Neuron Maskingcited by 56
  8. 2020Class Clown: Data Redaction in Machine Unlearning at Enterprise Scalecited by 10
  9. 2023Generative Adversarial Networks Unlearningcited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 3; 2026: 1.

5 papers.