mlsanityData to 14 Oct 2026

Uncovering Entity Identity Confusion in Multimodal Knowledge Editing

arXiv 2605.06096 ↗First posted 7 May 2026cs.CL cs.CVcited by 1

On the map: Multimodal LLMs / vision-language models → Image editing and quality assessment

Abstract (arXiv)

Multimodal knowledge editing (MKE) aims to correct the internal knowledge of large vision-language models after deployment, yet the behavioral patterns of post-edit models remain underexplored. In this paper, we identify a systemic failure mode in edited models, termed Entity Identity Confusion (EIC): edited models exhibit an absurd behavior where text-only queries about the original entity's identity unexpectedly return information about the new entity. To rigorously investigate EIC, we construct EC-Bench, a diagnostic benchmark that directly probes how image-entity bindings shift before and after editing. Our analysis reveals that EIC stems from existing methods failing to distinguish between Image-Entity (I-E) binding and Entity-Entity (E-E) relational knowledge in the model, causing models to overfit E-E associations as a shortcut: the image is still perceived as the original entity, with the new entity's name serving only as a spurious identity label. We further explore potential mitigation strategies, showing that constraining edits to the model's I-E processing stage encourages edits to act more faithfully on I-E binding, thereby substantially reducing EIC. Based on these findings, we discuss principled desiderata for faithful MKE and provide methodological guidance for future research.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Image editing and quality assessment, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 26 of its 29 references that are in the map. First posted on arXiv 7 May 2026.

Builds on

26 of 29 references.

Closest ancestors · 5

Same direction, newest first

  1. 2024Visual-Oriented Fine-Grained Knowledge Editing for MultiModal Large Language Models19 Nov
  2. 2024Towards Unified Multimodal Editing with Enhanced Knowledge Collaboration30 Sep
  3. 2024MC-MKE: A Fine-Grained Multimodal Knowledge Editing Benchmark Emphasizing Modality Consistency19 Jun
  4. 2024VLKEB: A Large Vision-Language Model Knowledge Editing Benchmark12 Mar
  5. 2024MIKE: A New Benchmark for Fine-grained Multimodal Entity Knowledge Editing18 Feb

Other references · 21

  1. 2023Visual Instruction Tuningcited by 7,869
  2. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  3. 2022Locating and Editing Factual Associations in GPTcited by 2,691
  4. 2023A Survey of Large Language Modelscited by 2,576
  5. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
  6. 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,336
  7. 2022Mass-Editing Memory in a Transformercited by 1,001
  8. 2021Editing Factual Knowledge in Language Modelscited by 553
  9. 2023Dissecting Recall of Factual Associations in Auto-Regressive Language Modelscited by 528
  10. 2021Fast Model Editing at Scalecited by 498
  11. 2022Memory-Based Model Editing at Scalecited by 447
  12. 2023Can We Edit Factual Knowledge by In-Context Learning?cited by 285
9 more
  1. 2024A Comprehensive Study of Knowledge Editing for Large Language Modelscited by 163
  2. 2019MMKG: Multi-Modal Knowledge Graphscited by 105
  3. 2023EasyEdit: An Easy-to-use Knowledge Editing Framework for Large Language Modelscited by 98
  4. 2023Can We Edit Multimodal Large Language Models?cited by 44
  5. 2024Knowledge Graph Enhanced Large Language Model Editingcited by 40
  6. 2024Uncovering Overfitting in Large Language Model Editingcited by 39
  7. 2025Too Late to Recall: Explaining the Two-Hop Problem in Multimodal Knowledge Retrievalcited by 7
  8. 2026Spectral Characterization and Mitigation of Sequential Knowledge Editing Collapsecited by 5
  9. 2026Uncovering Context Reliance in Unstructured Knowledge Editingcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024ComprehendEdit: A Comprehensive Dataset and Evaluation Framework for Multimodal Knowledge Editing
  2. 2026Correct When Paired, Wrong When Split: Decoupling and Editing Modality-Specific Neurons in MLLMs
  3. 2026Towards Localized and Disentangled Knowledge Editing for Multimodal Large Language Models
  4. 2026Multimodal Knowledge Edit-Scoped Generalization for Online Recursive MLLM Editing
  5. 2025Towards Meta-Cognitive Knowledge Editing for Multimodal LLMs
  6. 2024Representation Shattering in Transformers: A Synthetic Study with Knowledge Editing
  7. 2026Mind the Gap: Diagnosing Constraint Discovery Failures in Text-in-Image Editing
  8. 2025MMKE-Bench: A Multimodal Editing Benchmark for Diverse Visual Knowledge