mlsanityData to 14 Oct 2026

Preserving Cross-Modal Stability for Visual Unlearning in Multimodal Scenarios

arXiv 2509.23895 ↗First posted 28 Sep 2025cs.CV cs.AIcited by 0

On the map: LLM safety and security → Machine unlearning

Abstract (arXiv)

Visual modality is the most vulnerable to privacy leakage in real-world multimodal applications like autonomous driving with visual and radar data; Machine unlearning removes specific training data from pre-trained models to address privacy leakage, however, existing methods fail to preserve cross-modal knowledge and maintain intra-class structural stability of retain data, leading to reduced overall and other modalities' performance during visual unlearning; to address these challenges, we propose a Cross-modal Contrastive Unlearning (CCU) framework, which integrates three key components: (a) selective visual unlearning: employing inverse contrastive learning to dissociate visual representations from their original semantics, (b) cross-modal knowledge retention: preserving other modalities' discriminability through semantic consistency, and (c) dual-set contrastive separation: preserving the model performance via isolation of structural perturbations between the unlearn set and retain set; extensive experiments on three datasets demonstrate the superiority of CCU, and our method achieves a 7.12% accuracy improvement with only 7% of the unlearning time compared to the top-accuracy baseline.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 18 of its 30 references that are in the map. First posted on arXiv 28 Sep 2025.

Builds on

18 of 30 references.

Closest ancestors · 8

Same direction, newest first

  1. 2024Contrastive Unlearning: A Contrastive Approach to Machine Unlearning19 Jan
  2. 2023MultiDelete for Multimodal Machine Unlearning18 Nov
  3. 2023Fast Machine Unlearning Without Retraining Through Selective Synaptic Dampening15 Aug
  4. 2023Towards Unbounded Machine Unlearning20 Feb
  5. 2022Can Bad Teaching Induce Forgetting? Unlearning in Deep Networks using an Incompetent Teacher17 May
  6. 2021On the Necessity of Auditable Algorithmic Definitions for Machine Unlearning22 Oct
  7. 2021Unrolling SGD: Understanding Factors Influencing Machine Unlearning27 Sep
  8. 2021Machine Unlearning of Features and Labels26 Aug

Other references · 10

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  3. 2016Membership Inference Attacks against Machine Learning Modelscited by 2,281
  4. 2019Machine Unlearningcited by 1,061
  5. 2019Eternal Sunshine of the Spotless Net: Selective Forgetting in Deep Networkscited by 618
  6. 2018CentralNet: a Multilayer Approach for Multimodal Fusioncited by 86
  7. 2023Boosting Multi-modal Model Performance with Adaptive Gradient Modulationcited by 73
  8. 2022PUMA: Performance Unchanged Model Augmentation for Training Data Removalcited by 58
  9. 2024Classifier-guided Gradient Modulation for Enhanced Multimodal Learningcited by 35
  10. 2019On the Separability of Classes with the Cross-Entropy Loss Functioncited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026One Modality to Forget Them All: Enhancing Cross-Modal Unlearning in Vision-Language Models
  2. 2026Multimodal Unlearning Across Vision, Language, Video, and Audio: Survey of Methods, Datasets, and Benchmarks
  3. 2026Does Forgetting Transfer Across Modalities? A Real-World Benchmark for Cross-Modal Knowledge Unlearning Evaluation
  4. 2026PPU-Bench:Real World Benchmark for Personalized Partial Unlearning in Vision Language Models
  5. 2024CLEAR: Character Unlearning in Textual and Visual Modalities
  6. 2026Do More Modalities Always Help? A Geometric Perspective on Missing-Modality Robustness
  7. 2026Understanding Cross-Modal Contributions in Continual Vision-Language Models: A Theoretical Perspective
  8. 2026On the Robustness of Machine Unlearning for Vision-Language Models