mlsanityData to 14 Oct 2026

Cross-Modal Unlearning via Influential Neuron Path Editing in Multimodal Large Language Models

arXiv 2511.06793 ↗First posted 10 Nov 2025cs.LG cs.AIcited by 8

On the map: Multimodal LLMs / vision-language models → MLLM jailbreaks and adversarial robustness

also in 1 more
Abstract (arXiv)

Multimodal Large Language Models (MLLMs) extend foundation models to real-world applications by integrating inputs such as text and vision. However, their broad knowledge capacity raises growing concerns about privacy leakage, toxicity mitigation, and intellectual property violations. Machine Unlearning (MU) offers a practical solution by selectively forgetting targeted knowledge while preserving overall model utility. When applied to MLLMs, existing neuron-editing-based MU approaches face two fundamental challenges: (1) forgetting becomes inconsistent across modalities because existing point-wise attribution methods fail to capture the structured, layer-by-layer information flow that connects different modalities; and (2) general knowledge performance declines when sensitive neurons that also support important reasoning paths are pruned, as this disrupts the model's ability to generalize. To alleviate these limitations, we propose a multimodal influential neuron path editor (MIP-Editor) for MU. Our approach introduces modality-specific attribution scores to identify influential neuron paths responsible for encoding forget-set knowledge and applies influential-path-aware neuron-editing via representation misdirection. This strategy also enables effective and coordinated forgetting across modalities while preserving the model's general capabilities. Experimental results demonstrate that MIP-Editor achieves a superior unlearning performance on multimodal tasks, with a maximum forgetting rate of 87.75% and up to 54.26% improvement in general knowledge retention. On textual tasks, MIP-Editor achieves up to 80.65% forgetting and preserves 77.9% of general performance. Codes are available at https://github.com/PreckLi/MIP-Editor.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in MLLM jailbreaks and adversarial robustness, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 26 of its 37 references that are in the map. First posted on arXiv 10 Nov 2025.

Builds on

26 of 37 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025SafeEraser: Enhancing Safety in Multimodal Large Language Models through Multimodal Machine Unlearning18 Feb
  2. 2024Protecting Privacy in Multimodal Large Language Models with MLLMU-Bench29 Oct
  3. 2024MLLM-Protector: Ensuring MLLM's Safety without Hurting Performance5 Jan

Other references · 23

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  3. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  4. 2024TOFU: A Task of Fictitious Unlearning for LLMscited by 533
  5. 2024The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearningcited by 509
  6. 2024Negative Preference Optimization: From Catastrophic Collapse to Effective Unlearningcited by 504
  7. 2023Editing Large Language Models: Problems, Methods, and Opportunitiescited by 372
  8. 2021Unrolling SGD: Understanding Factors Influencing Machine Unlearningcited by 279
  9. 2023Does Localization Inform Editing? Surprising Differences in Causality-Based Localization vs. Knowledge Editing in Language Modelscited by 243
  10. 2023Model Sparsity Can Simplify Machine Unlearningcited by 214
  11. 2024Simplicity Prevails: Rethinking Negative Preference Optimization for LLM Unlearningcited by 172
  12. 2022Continual Learning and Private Unlearningcited by 130
11 more
  1. 2020Variational Bayesian Unlearningcited by 117
  2. 2022PUMA: Performance Unchanged Model Augmentation for Training Data Removalcited by 58
  3. 2023Journey to the Center of the Knowledge Neurons: Discoveries of Language-Independent Knowledge Neurons and Degenerate Knowledge Neuronscited by 56
  4. 2024CLEAR: Character Unlearning in Textual and Visual Modalitiescited by 39
  5. 2023Separate the Wheat from the Chaff: Model Deficiency Unlearning via Parameter-Efficient Module Operationcited by 33
  6. 2023Analyzing And Editing Inner Mechanisms Of Backdoored Language Modelscited by 23
  7. 2024CLIPErase: Efficient Unlearning of Visual-Textual Associations in CLIPcited by 19
  8. 2023Retentive or Forgetful? Diving into the Knowledge Memorizing Mechanism of Language Modelscited by 18
  9. 2020Influence Patterns for Explaining Information Flow in BERTcited by 14
  10. 2025Discovering Influential Neuron Path in Vision Transformerscited by 7
  11. 2025Identifying Multi-modal Knowledge Neurons in Pretrained Transformers via Two-stage Filteringcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 7.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Modality-Aware Neuron Pruning for Unlearning in Multimodal Large Language Models
  2. 2026Correct When Paired, Wrong When Split: Decoupling and Editing Modality-Specific Neurons in MLLMs
  3. 2025SIMU: Selective Influence Machine Unlearning
  4. 2026Does Forgetting Transfer Across Modalities? A Real-World Benchmark for Cross-Modal Knowledge Unlearning Evaluation
  5. 2026Exploring and Bridging Knowledge Holes in Unlearned Multimodal Large Language Models
  6. 2025Towards Benign Memory Forgetting for Selective Multimodal Large Language Model Unlearning
  7. 2026Toward Fine-Grained Forgetting:Attribute Unlearning for Multimodal Large Language Models
  8. 2025Towards Reasoning-Preserving Unlearning in Multimodal Large Language Models