Cross-Modal Unlearning via Influential Neuron Path Editing in Multimodal Large Language Models
On the map: Multimodal LLMs / vision-language models → MLLM jailbreaks and adversarial robustness
also in 1 more
Abstract (arXiv)
Multimodal Large Language Models (MLLMs) extend foundation models to real-world applications by integrating inputs such as text and vision. However, their broad knowledge capacity raises growing concerns about privacy leakage, toxicity mitigation, and intellectual property violations. Machine Unlearning (MU) offers a practical solution by selectively forgetting targeted knowledge while preserving overall model utility. When applied to MLLMs, existing neuron-editing-based MU approaches face two fundamental challenges: (1) forgetting becomes inconsistent across modalities because existing point-wise attribution methods fail to capture the structured, layer-by-layer information flow that connects different modalities; and (2) general knowledge performance declines when sensitive neurons that also support important reasoning paths are pruned, as this disrupts the model's ability to generalize. To alleviate these limitations, we propose a multimodal influential neuron path editor (MIP-Editor) for MU. Our approach introduces modality-specific attribution scores to identify influential neuron paths responsible for encoding forget-set knowledge and applies influential-path-aware neuron-editing via representation misdirection. This strategy also enables effective and coordinated forgetting across modalities while preserving the model's general capabilities. Experimental results demonstrate that MIP-Editor achieves a superior unlearning performance on multimodal tasks, with a maximum forgetting rate of 87.75% and up to 54.26% improvement in general knowledge retention. On textual tasks, MIP-Editor achieves up to 80.65% forgetting and preserves 77.9% of general performance. Codes are available at https://github.com/PreckLi/MIP-Editor.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in MLLM jailbreaks and adversarial robustness, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 26 of its 37 references that are in the map. First posted on arXiv 10 Nov 2025.
Builds on
26 of 37 references.
Closest ancestors · 3
Same direction, newest first
- 2025SafeEraser: Enhancing Safety in Multimodal Large Language Models through Multimodal Machine Unlearning18 Feb
- 2024Protecting Privacy in Multimodal Large Language Models with MLLMU-Bench29 Oct
- 2024MLLM-Protector: Ensuring MLLM's Safety without Hurting Performance5 Jan
Other references · 23
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2024TOFU: A Task of Fictitious Unlearning for LLMscited by 533
- 2024The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearningcited by 509
- 2024Negative Preference Optimization: From Catastrophic Collapse to Effective Unlearningcited by 504
- 2023Editing Large Language Models: Problems, Methods, and Opportunitiescited by 372
- 2021Unrolling SGD: Understanding Factors Influencing Machine Unlearningcited by 279
- 2023Does Localization Inform Editing? Surprising Differences in Causality-Based Localization vs. Knowledge Editing in Language Modelscited by 243
- 2023Model Sparsity Can Simplify Machine Unlearningcited by 214
- 2024Simplicity Prevails: Rethinking Negative Preference Optimization for LLM Unlearningcited by 172
- 2022Continual Learning and Private Unlearningcited by 130
11 more
- 2020Variational Bayesian Unlearningcited by 117
- 2022PUMA: Performance Unchanged Model Augmentation for Training Data Removalcited by 58
- 2023Journey to the Center of the Knowledge Neurons: Discoveries of Language-Independent Knowledge Neurons and Degenerate Knowledge Neuronscited by 56
- 2024CLEAR: Character Unlearning in Textual and Visual Modalitiescited by 39
- 2023Separate the Wheat from the Chaff: Model Deficiency Unlearning via Parameter-Efficient Module Operationcited by 33
- 2023Analyzing And Editing Inner Mechanisms Of Backdoored Language Modelscited by 23
- 2024CLIPErase: Efficient Unlearning of Visual-Textual Associations in CLIPcited by 19
- 2023Retentive or Forgetful? Diving into the Knowledge Memorizing Mechanism of Language Modelscited by 18
- 2020Influence Patterns for Explaining Information Flow in BERTcited by 14
- 2025Discovering Influential Neuron Path in Vision Transformerscited by 7
- 2025Identifying Multi-modal Knowledge Neurons in Pretrained Transformers via Two-stage Filteringcited by 3
Built on by
Citing papers per year: 2025: 1; 2026: 7.
8 papers.
- 2026EASE: Federated Multimodal Unlearning via Entanglement-Aware Anchor Closurecited by 5
- 2026Visual-Guided Key-Token Regularization for Multimodal Large Language Model Unlearningcited by 3
- 2025SGM: Safety Glasses for Multimodal Large Language Models via Neuron-Level Detoxificationcited by 1
- 2026MemLeak: Diagnosing Information Leaks in Multimodal Agent Memorycited by 1
- 2026AIM: Anchor Identity Features, Then Match for Multimodal Large Language Model Unlearningcited by 1
- 2026SPACE: Source-free Proxy Anchor Concept Erasure for MLLMscited by 0
- 2026SIEVE: Selective attention-value Suppression for Vision-Language Models Unlearningcited by 0
- 2026CUSE: Fine-Grained Multimodal Unlearning with Counterfactual Guidance and On-Policy Self-Distillationcited by 0
- 2026CUSE: Fine-Grained Multimodal Unlearning with Counterfactual Guidance and On-Policy Self-Distillation10 Oct 2026
- 2026SIEVE: Selective attention-value Suppression for Vision-Language Models Unlearning1 Oct 2026
- 2026AIM: Anchor Identity Features, Then Match for Multimodal Large Language Model Unlearning28 Aug 2026
- 2026MemLeak: Diagnosing Information Leaks in Multimodal Agent Memory29 Jun 2026
- 2026SPACE: Source-free Proxy Anchor Concept Erasure for MLLMs1 Jun 2026
- 2026EASE: Federated Multimodal Unlearning via Entanglement-Aware Anchor Closure1 May 2026
- 2026Visual-Guided Key-Token Regularization for Multimodal Large Language Model Unlearning29 Jan 2026
- 2025SGM: Safety Glasses for Multimodal Large Language Models via Neuron-Level Detoxification17 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2025Modality-Aware Neuron Pruning for Unlearning in Multimodal Large Language Models
- 2026Correct When Paired, Wrong When Split: Decoupling and Editing Modality-Specific Neurons in MLLMs
- 2025SIMU: Selective Influence Machine Unlearning
- 2026Does Forgetting Transfer Across Modalities? A Real-World Benchmark for Cross-Modal Knowledge Unlearning Evaluation
- 2026Exploring and Bridging Knowledge Holes in Unlearned Multimodal Large Language Models
- 2025Towards Benign Memory Forgetting for Selective Multimodal Large Language Model Unlearning
- 2026Toward Fine-Grained Forgetting:Attribute Unlearning for Multimodal Large Language Models
- 2025Towards Reasoning-Preserving Unlearning in Multimodal Large Language Models