mlsanityData to 14 Oct 2026

Correct When Paired, Wrong When Split: Decoupling and Editing Modality-Specific Neurons in MLLMs

arXiv 2606.17057 ↗First posted 20 Apr 2026cs.LG cs.AI cs.CLcited by 1

On the map: Multimodal LLMs / vision-language models → Image editing and quality assessment

Abstract (arXiv)

Although Knowledge Editing provides an efficient mechanism for updating the knowledge of Multimodal Large Language Models (MLLMs), we find that current paradigms still suffer from an important yet remain underexplored issue : editing decoupling failure, where entity-related knowledge can be updated when the model is triggered by multimodal inputs (text--image query pairs), however, it often reverts to outdated pre-edit facts when the paired inputs are split into unimodal ones. Our in-depth empirical analysis reveals that the entity knowledge in MLLMs is not stored as a unified representation, but is instead distributed across disentangled modality-specific pathways. As a result, updates biased toward multimodal queries fail to propagate effectively to unimodal circuits. To bridge this gap, we propose DECODE, which explicitly disentangles and localizes modality-specific neuron groups for targeted knowledge. Extensive experiments demonstrate that DECODE consistently achieves effective knowledge updates under different modality triggers, thereby mitigating editing decoupling failures.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Image editing and quality assessment, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 23 of its 33 references that are in the map. First posted on arXiv 20 Apr 2026.

Builds on

23 of 33 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024Towards Unified Multimodal Editing with Enhanced Knowledge Collaboration30 Sep
  2. 2024Attribution Analysis Meets Model Editing: Advancing Knowledge Correction in Vision Language Models with VisEdit19 Aug

Other references · 21

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
  3. 2022Locating and Editing Factual Associations in GPTcited by 2,691
  4. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
  5. 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,336
  6. 2022Mass-Editing Memory in a Transformercited by 1,001
  7. 2021Editing Factual Knowledge in Language Modelscited by 553
  8. 2021Fast Model Editing at Scalecited by 498
  9. 2022Memory-Based Model Editing at Scalecited by 447
  10. 2023Can We Edit Factual Knowledge by In-Context Learning?cited by 285
  11. 2022Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptorscited by 271
  12. 2024AlphaEdit: Null-Space Constrained Knowledge Editing for Language Modelscited by 236
9 more
  1. 2023PMET: Precise Model Editing in a Transformercited by 173
  2. 2024A Unified Framework for Model Editingcited by 57
  3. 2024Can Knowledge Editing Really Correct Hallucinations?cited by 28
  4. 2025MMKE-Bench: A Multimodal Editing Benchmark for Diverse Visual Knowledgecited by 23
  5. 2025Precise Localization of Memories: A Fine-grained Neuron-level Knowledge Editing Technique for LLMscited by 18
  6. 2025Rethinking Machine Unlearning in Image Generation Modelscited by 9
  7. 2025Drifting Away from Truth: GenAI-Driven News Diversity Challenges LVLM-Based Misinformation Detectioncited by 6
  8. 2025Seeing Through Deception: Uncovering Misleading Creator Intent in Multimodal News with Vision-Language Modelscited by 5
  9. 2024D-Judge: How Far Are We? Assessing the Discrepancies Between AI-synthesized and Natural Images through Multimodal Guidancecited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Cross-Modal Unlearning via Influential Neuron Path Editing in Multimodal Large Language Models
  2. 2026Multimodal Knowledge Edit-Scoped Generalization for Online Recursive MLLM Editing
  3. 2023Finding and Editing Multi-Modal Neurons in Pre-Trained Transformers
  4. 2026Towards Localized and Disentangled Knowledge Editing for Multimodal Large Language Models
  5. 2024MC-MKE: A Fine-Grained Multimodal Knowledge Editing Benchmark Emphasizing Modality Consistency
  6. 2025Identifying Multi-modal Knowledge Neurons in Pretrained Transformers via Two-stage Filtering
  7. 2025MemEIC: A Step Toward Continual and Compositional Knowledge Editing
  8. 2024ComprehendEdit: A Comprehensive Dataset and Evaluation Framework for Multimodal Knowledge Editing