Beyond Binary Edits Robust Multimodal Knowledge Editing with Adversarial Subspace Alignment
On the map: Multimodal LLMs / vision-language models → Image editing and quality assessment
Abstract (arXiv)
Multimodal large language models (MLLMs) need efficient mechanisms to update knowledge without degrading existing capabilities. While intrinsic multimodal knowledge editing achieves strong reliability and locality, it often exhibits limited generality, failing to propagate edits across semantically equivalent visual and linguistic variations. This issue arises from the lack of explicit semantic supervision, rigid editing scopes, and biased anchoring to individual samples in high-dimensional multimodal spaces. We address robust intrinsic multimodal knowledge editing by explicitly targeting generalization. We formalize robustness through knowledge units that group semantically equivalent multimodal inputs and define generality as consistent predictions within each unit. To expose fragile semantic regions, we introduce Latent Adversarial Robustification (LAR), which generates adversarial yet semantically coherent variants in the joint latent space. We further propose Rank-Constrained Subspace Learning (RCSL), enforcing low-rank alignment of adversarial representations at the edit layer via a singular value-based objective. Extensive analysis demonstrates the effectiveness of ASAM empirically.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Image editing and quality assessment, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 41 of its 47 references that are in the map. First posted on arXiv 22 May 2026.
Builds on
41 of 47 references.
Closest ancestors · 6
Same direction, newest first
- 2025BalancEdit: Dynamically Balancing the Generality-Locality Trade-off in Multi-modal Model Editing2 May
- 2024Visual-Oriented Fine-Grained Knowledge Editing for MultiModal Large Language Models19 Nov
- 2024Towards Unified Multimodal Editing with Enhanced Knowledge Collaboration30 Sep
- 2024MC-MKE: A Fine-Grained Multimodal Knowledge Editing Benchmark Emphasizing Modality Consistency19 Jun
- 2024VLKEB: A Large Vision-Language Model Knowledge Editing Benchmark12 Mar
- 2024MIKE: A New Benchmark for Fine-grained Multimodal Entity Knowledge Editing18 Feb
Other references · 35
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
- 2022Locating and Editing Factual Associations in GPTcited by 2,609
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
- 2022Mass-Editing Memory in a Transformercited by 976
- 2021Editing Factual Knowledge in Language Modelscited by 548
- 2021Fast Model Editing at Scalecited by 491
- 2022Memory-Based Model Editing at Scalecited by 443
- 2024MoE-LLaVA: Mixture of Experts for Large Vision-Language Modelscited by 298
- 2023Can We Edit Factual Knowledge by In-Context Learning?cited by 284
23 more
- 2022Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptorscited by 267
- 2023Evaluating the Ripple Effects of Knowledge Editing in Language Modelscited by 238
- 2024AlphaEdit: Null-Space Constrained Knowledge Editing for Language Modelscited by 224
- 2023Transformer-Patcher: One Mistake worth One Neuroncited by 196
- 2023Knowledge Editing for Large Language Models: A Surveycited by 189
- 2023PMET: Precise Model Editing in a Transformercited by 170
- 2024A Comprehensive Study of Knowledge Editing for Large Language Modelscited by 157
- 2022Calibrating Factual Knowledge in Pretrained Language Modelscited by 92
- 2024WISE: Rethinking the Knowledge Memory for Lifelong Model Editing of Large Language Modelscited by 90
- 2023MELO: Enhancing Model Editing with Neuron-Indexed Dynamic LoRAcited by 80
- 2025AnyEdit: Edit Any Knowledge Encoded in Language Modelscited by 74
- 2023Massive Editing for Large Language Models via Meta Learningcited by 62
- 2023Can We Edit Multimodal Large Language Models?cited by 44
- 2024Knowledge Graph Enhanced Large Language Model Editingcited by 38
- 2024Decoding by Contrasting Knowledge: Enhancing LLMs' Confidence on Edited Factscited by 36
- 2023Evaluating the Reversal Curse in Model Editingcited by 34
- 2025MMKE-Bench: A Multimodal Editing Benchmark for Diverse Visual Knowledgecited by 22
- 2024Everything is Editable: Extend Knowledge Editing to Unstructured Data in Large Language Modelscited by 18
- 2024InstructEdit: Instruction-based Knowledge Editing for Large Language Modelscited by 17
- 2025Precise Localization of Memories: A Fine-grained Neuron-level Knowledge Editing Technique for LLMscited by 16
- 2025Mass-Editing Memory with Attention in Transformers: A cross-lingual exploration of knowledgecited by 10
- 2025Same Question, Different Words: A Latent Adversarial Framework for Prompt Robustnesscited by 5
- 2025Calibrated Multimodal Representation Learning with Missing Modalitiescited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Multimodal Knowledge Edit-Scoped Generalization for Online Recursive MLLM Editing
- 2026Generalizable Multimodal Large Language Model Editing via Invariant Trajectory Learning
- 2026Towards Localized and Disentangled Knowledge Editing for Multimodal Large Language Models
- 2024Enhance Modality Robustness in Text-Centric Multimodal Alignment with Adversarial Prompting
- 2024ComprehendEdit: A Comprehensive Dataset and Evaluation Framework for Multimodal Knowledge Editing
- 2026Investigating Adversarial Robustness of Multi-modal Large Language Models
- 2026Same Semantics, Different Outcome: On the Modality Robustness of Multimodal LLMs under Knowledge Conflict
- 2026Beyond the Covariance Trap: Unlocking Generalization in Same-Subject Knowledge Editing for Large Language Models