Uncovering Entity Identity Confusion in Multimodal Knowledge Editing
On the map: Multimodal LLMs / vision-language models → Image editing and quality assessment
Abstract (arXiv)
Multimodal knowledge editing (MKE) aims to correct the internal knowledge of large vision-language models after deployment, yet the behavioral patterns of post-edit models remain underexplored. In this paper, we identify a systemic failure mode in edited models, termed Entity Identity Confusion (EIC): edited models exhibit an absurd behavior where text-only queries about the original entity's identity unexpectedly return information about the new entity. To rigorously investigate EIC, we construct EC-Bench, a diagnostic benchmark that directly probes how image-entity bindings shift before and after editing. Our analysis reveals that EIC stems from existing methods failing to distinguish between Image-Entity (I-E) binding and Entity-Entity (E-E) relational knowledge in the model, causing models to overfit E-E associations as a shortcut: the image is still perceived as the original entity, with the new entity's name serving only as a spurious identity label. We further explore potential mitigation strategies, showing that constraining edits to the model's I-E processing stage encourages edits to act more faithfully on I-E binding, thereby substantially reducing EIC. Based on these findings, we discuss principled desiderata for faithful MKE and provide methodological guidance for future research.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Image editing and quality assessment, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 26 of its 29 references that are in the map. First posted on arXiv 7 May 2026.
Builds on
26 of 29 references.
Closest ancestors · 5
Same direction, newest first
- 2024Visual-Oriented Fine-Grained Knowledge Editing for MultiModal Large Language Models19 Nov
- 2024Towards Unified Multimodal Editing with Enhanced Knowledge Collaboration30 Sep
- 2024MC-MKE: A Fine-Grained Multimodal Knowledge Editing Benchmark Emphasizing Modality Consistency19 Jun
- 2024VLKEB: A Large Vision-Language Model Knowledge Editing Benchmark12 Mar
- 2024MIKE: A New Benchmark for Fine-grained Multimodal Entity Knowledge Editing18 Feb
Other references · 21
- 2023Visual Instruction Tuningcited by 7,869
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2022Locating and Editing Factual Associations in GPTcited by 2,691
- 2023A Survey of Large Language Modelscited by 2,576
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,336
- 2022Mass-Editing Memory in a Transformercited by 1,001
- 2021Editing Factual Knowledge in Language Modelscited by 553
- 2023Dissecting Recall of Factual Associations in Auto-Regressive Language Modelscited by 528
- 2021Fast Model Editing at Scalecited by 498
- 2022Memory-Based Model Editing at Scalecited by 447
- 2023Can We Edit Factual Knowledge by In-Context Learning?cited by 285
9 more
- 2024A Comprehensive Study of Knowledge Editing for Large Language Modelscited by 163
- 2019MMKG: Multi-Modal Knowledge Graphscited by 105
- 2023EasyEdit: An Easy-to-use Knowledge Editing Framework for Large Language Modelscited by 98
- 2023Can We Edit Multimodal Large Language Models?cited by 44
- 2024Knowledge Graph Enhanced Large Language Model Editingcited by 40
- 2024Uncovering Overfitting in Large Language Model Editingcited by 39
- 2025Too Late to Recall: Explaining the Two-Hop Problem in Multimodal Knowledge Retrievalcited by 7
- 2026Spectral Characterization and Mitigation of Sequential Knowledge Editing Collapsecited by 5
- 2026Uncovering Context Reliance in Unstructured Knowledge Editingcited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024ComprehendEdit: A Comprehensive Dataset and Evaluation Framework for Multimodal Knowledge Editing
- 2026Correct When Paired, Wrong When Split: Decoupling and Editing Modality-Specific Neurons in MLLMs
- 2026Towards Localized and Disentangled Knowledge Editing for Multimodal Large Language Models
- 2026Multimodal Knowledge Edit-Scoped Generalization for Online Recursive MLLM Editing
- 2025Towards Meta-Cognitive Knowledge Editing for Multimodal LLMs
- 2024Representation Shattering in Transformers: A Synthetic Study with Knowledge Editing
- 2026Mind the Gap: Diagnosing Constraint Discovery Failures in Text-in-Image Editing
- 2025MMKE-Bench: A Multimodal Editing Benchmark for Diverse Visual Knowledge