mlsanityData to 14 Oct 2026

Pre-Forgettable Models: Prompt Learning as a Native Mechanism for Unlearning

arXiv 2509.15230 ↗First posted 5 Sep 2025cs.LG cs.AIcited by 1

On the map: LLM safety and security → Machine unlearning

Abstract (arXiv)

Foundation models have transformed multimedia analysis by enabling robust and transferable representations across diverse modalities and tasks. However, their static deployment conflicts with growing societal and regulatory demands -- particularly the need to unlearn specific data upon request, as mandated by privacy frameworks such as the GDPR. Traditional unlearning approaches, including retraining, activation editing, or distillation, are often computationally expensive, fragile, and ill-suited for real-time or continuously evolving systems. In this paper, we propose a paradigm shift: rethinking unlearning not as a retroactive intervention but as a built-in capability. We introduce a prompt-based learning framework that unifies knowledge acquisition and removal within a single training phase. Rather than encoding information in model weights, our approach binds class-level semantics to dedicated prompt tokens. This design enables instant unlearning simply by removing the corresponding prompt -- without retraining, model modification, or access to original data. Experiments demonstrate that our framework preserves predictive performance on retained classes while effectively erasing forgotten ones. Beyond utility, our method exhibits strong privacy and security guarantees: it is resistant to membership inference attacks, and prompt removal prevents any residual knowledge extraction, even under adversarial conditions. This ensures compliance with data protection principles and safeguards against unauthorized access to forgotten information, making the framework suitable for deployment in sensitive and regulated environments. Overall, by embedding removability into the architecture itself, this work establishes a new foundation for designing modular, scalable and ethically responsive AI models.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 13 of its 30 references that are in the map. First posted on arXiv 5 Sep 2025.

Builds on

13 of 30 references.

Closest ancestors · 5

Same direction, newest first

  1. 2024LMEraser: Large Model Unlearning through Adaptive Prompt Tuning17 Apr
  2. 2023Fast Machine Unlearning Without Retraining Through Selective Synaptic Dampening15 Aug
  3. 2023Machine Unlearning: A Survey6 Jun
  4. 2022Can Bad Teaching Induce Forgetting? Unlearning in Deep Networks using an Incompetent Teacher17 May
  5. 2022Towards Adversarial Evaluations for Inexact Machine Unlearning17 Jan

Other references · 8

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  3. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  4. 2019Machine Unlearningcited by 1,061
  5. 2021MedMNIST v2 -- A large-scale lightweight benchmark for 2D and 3D biomedical image classificationcited by 690
  6. 2021AST: Audio Spectrogram Transformercited by 643
  7. 2017Skin Lesion Analysis Toward Melanoma Detection: A Challenge at the 2017 International Symposium on Biomedical Imaging (ISBI), Hosted by the International Skin Imaging Collaboration (ISIC)cited by 549
  8. 2020Amnesiac Machine Learningcited by 319

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Representation Unlearning: Forgetting through Information Compression
  2. 2026Models Designed to Forget: Machine Unlearning via Key Deletion
  3. 2025Are We Truly Forgetting? A Critical Re-examination of Machine Unlearning Evaluation Protocols
  4. 2026Reference-Guided Machine Unlearning
  5. 2026Shadow Unlearning: A Neuro-Semantic Approach to Fidelity-Preserving Faceless Forgetting in LLMs
  6. 2024Label-Agnostic Forgetting: A Supervision-Free Unlearning in Deep Models
  7. 2025Rethinking Post-Unlearning Behavior of Large Vision-Language Models
  8. 2026Unlearning the Unpromptable: Prompt-free Instance Unlearning in Diffusion Models