mlsanityData to 7 Oct 2026

Beyond Binary Edits Robust Multimodal Knowledge Editing with Adversarial Subspace Alignment

arXiv 2605.23780 ↗First posted 22 May 2026cs.AIcited by 0

On the map: Multimodal LLMs / vision-language models → Image editing and quality assessment

Abstract (arXiv)

Multimodal large language models (MLLMs) need efficient mechanisms to update knowledge without degrading existing capabilities. While intrinsic multimodal knowledge editing achieves strong reliability and locality, it often exhibits limited generality, failing to propagate edits across semantically equivalent visual and linguistic variations. This issue arises from the lack of explicit semantic supervision, rigid editing scopes, and biased anchoring to individual samples in high-dimensional multimodal spaces. We address robust intrinsic multimodal knowledge editing by explicitly targeting generalization. We formalize robustness through knowledge units that group semantically equivalent multimodal inputs and define generality as consistent predictions within each unit. To expose fragile semantic regions, we introduce Latent Adversarial Robustification (LAR), which generates adversarial yet semantically coherent variants in the joint latent space. We further propose Rank-Constrained Subspace Learning (RCSL), enforcing low-rank alignment of adversarial representations at the edit layer via a singular value-based objective. Extensive analysis demonstrates the effectiveness of ASAM empirically.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Image editing and quality assessment, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 41 of its 47 references that are in the map. First posted on arXiv 22 May 2026.

Builds on

41 of 47 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025BalancEdit: Dynamically Balancing the Generality-Locality Trade-off in Multi-modal Model Editing2 May
  2. 2024Visual-Oriented Fine-Grained Knowledge Editing for MultiModal Large Language Models19 Nov
  3. 2024Towards Unified Multimodal Editing with Enhanced Knowledge Collaboration30 Sep
  4. 2024MC-MKE: A Fine-Grained Multimodal Knowledge Editing Benchmark Emphasizing Modality Consistency19 Jun
  5. 2024VLKEB: A Large Vision-Language Model Knowledge Editing Benchmark12 Mar
  6. 2024MIKE: A New Benchmark for Fine-grained Multimodal Entity Knowledge Editing18 Feb

Other references · 35

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  3. 2025Qwen2.5-VL Technical Reportcited by 5,418
  4. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
  5. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  6. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
  7. 2022Mass-Editing Memory in a Transformercited by 976
  8. 2021Editing Factual Knowledge in Language Modelscited by 548
  9. 2021Fast Model Editing at Scalecited by 491
  10. 2022Memory-Based Model Editing at Scalecited by 443
  11. 2024MoE-LLaVA: Mixture of Experts for Large Vision-Language Modelscited by 298
  12. 2023Can We Edit Factual Knowledge by In-Context Learning?cited by 284
23 more
  1. 2022Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptorscited by 267
  2. 2023Evaluating the Ripple Effects of Knowledge Editing in Language Modelscited by 238
  3. 2024AlphaEdit: Null-Space Constrained Knowledge Editing for Language Modelscited by 224
  4. 2023Transformer-Patcher: One Mistake worth One Neuroncited by 196
  5. 2023Knowledge Editing for Large Language Models: A Surveycited by 189
  6. 2023PMET: Precise Model Editing in a Transformercited by 170
  7. 2024A Comprehensive Study of Knowledge Editing for Large Language Modelscited by 157
  8. 2022Calibrating Factual Knowledge in Pretrained Language Modelscited by 92
  9. 2024WISE: Rethinking the Knowledge Memory for Lifelong Model Editing of Large Language Modelscited by 90
  10. 2023MELO: Enhancing Model Editing with Neuron-Indexed Dynamic LoRAcited by 80
  11. 2025AnyEdit: Edit Any Knowledge Encoded in Language Modelscited by 74
  12. 2023Massive Editing for Large Language Models via Meta Learningcited by 62
  13. 2023Can We Edit Multimodal Large Language Models?cited by 44
  14. 2024Knowledge Graph Enhanced Large Language Model Editingcited by 38
  15. 2024Decoding by Contrasting Knowledge: Enhancing LLMs' Confidence on Edited Factscited by 36
  16. 2023Evaluating the Reversal Curse in Model Editingcited by 34
  17. 2025MMKE-Bench: A Multimodal Editing Benchmark for Diverse Visual Knowledgecited by 22
  18. 2024Everything is Editable: Extend Knowledge Editing to Unstructured Data in Large Language Modelscited by 18
  19. 2024InstructEdit: Instruction-based Knowledge Editing for Large Language Modelscited by 17
  20. 2025Precise Localization of Memories: A Fine-grained Neuron-level Knowledge Editing Technique for LLMscited by 16
  21. 2025Mass-Editing Memory with Attention in Transformers: A cross-lingual exploration of knowledgecited by 10
  22. 2025Same Question, Different Words: A Latent Adversarial Framework for Prompt Robustnesscited by 5
  23. 2025Calibrated Multimodal Representation Learning with Missing Modalitiescited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Multimodal Knowledge Edit-Scoped Generalization for Online Recursive MLLM Editing
  2. 2026Generalizable Multimodal Large Language Model Editing via Invariant Trajectory Learning
  3. 2026Towards Localized and Disentangled Knowledge Editing for Multimodal Large Language Models
  4. 2024Enhance Modality Robustness in Text-Centric Multimodal Alignment with Adversarial Prompting
  5. 2024ComprehendEdit: A Comprehensive Dataset and Evaluation Framework for Multimodal Knowledge Editing
  6. 2026Investigating Adversarial Robustness of Multi-modal Large Language Models
  7. 2026Same Semantics, Different Outcome: On the Modality Robustness of Multimodal LLMs under Knowledge Conflict
  8. 2026Beyond the Covariance Trap: Unlocking Generalization in Same-Subject Knowledge Editing for Large Language Models