mlsanityData to 14 Oct 2026

Multimodal Knowledge Edit-Scoped Generalization for Online Recursive MLLM Editing

arXiv 2607.01978 ↗First posted 2 Jul 2026cs.AI cs.CL cs.CVcited by 0

On the map: Multimodal LLMs / vision-language models → Image editing and quality assessment

Abstract (arXiv)

Online multimodal knowledge editing requires injecting a continual stream of visual-textual corrections into multimodal large language models (MLLMs) with bounded overhead and minimal disruption to unrelated behaviors. Existing editors mainly emphasize edit reliability and long-horizon stability, but rarely control the semantic boundary of each edit. Our pilot analyses of post-edit behaviors and internal neuronal activities reveal a scope gap behind reliable edits: instance-level success neither guarantees transfer to valid cross-modal variants nor prevents leakage to unrelated inputs, while edit-related cross-modal responses concentrate in deeper semantic layers. Therefore, we formulate Edit-Scoped Generalization, reframing online MLLM editing from merely correcting an instance to controlling the propagation boundary of each edit. To this end, we propose ScopeEdit, a scope-aware online editor that decomposes each update into a modality-local absorption branch and an evidence-gated shared generalization branch. The local branch supports stable edit absorption, whereas the shared branch enables cross-modal propagation only when visual and textual evidence are sufficiently aligned. Both branches perform scope-separated write geometries in orthogonal low-rank spaces and maintain branch-wise preconditioners via Sherman--Morrison recursions, yielding constant per-edit overhead. Extensive experiments across diverse benchmarks, long-horizon edit streams, MLLM backbones, real-world VLKEB scenarios, and complex vision-language architectures show that ScopeEdit consistently improves the trade-off between in-scope cross-modal transfer and out-of-scope locality, while preserving edit reliability, stability and online efficiency. Our code is available at https://github.com/lab-klc/ScopeEdit.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Image editing and quality assessment, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 55 of its 62 references that are in the map. First posted on arXiv 2 Jul 2026.

Builds on

55 of 62 references.

Closest ancestors · 9

Same direction, newest first

  1. 2026Modality-Decoupled Online Recursive Editing19 May
  2. 2025MemEIC: A Step Toward Continual and Compositional Knowledge Editing29 Oct
  3. 2025DualEdit: Dual Editing for Knowledge Updating in Vision-Language Models16 Jun
  4. 2025BalancEdit: Dynamically Balancing the Generality-Locality Trade-off in Multi-modal Model Editing2 May
  5. 2024Lifelong Knowledge Editing for Vision Language Models with Low-Rank Mixture-of-Experts23 Nov
  6. 2024Visual-Oriented Fine-Grained Knowledge Editing for MultiModal Large Language Models19 Nov
  7. 2024Attribution Analysis Meets Model Editing: Advancing Knowledge Correction in Vision Language Models with VisEdit19 Aug
  8. 2024MC-MKE: A Fine-Grained Multimodal Knowledge Editing Benchmark Emphasizing Modality Consistency19 Jun
  9. 2024VLKEB: A Large Vision-Language Model Knowledge Editing Benchmark12 Mar

Other references · 46

  1. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  2. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  3. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  4. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  5. 2025Qwen3-VL Technical Reportcited by 2,793
  6. 2022Locating and Editing Factual Associations in GPTcited by 2,691
  7. 2023A Survey of Large Language Modelscited by 2,576
  8. 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,402
  9. 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,336
  10. 2022Mass-Editing Memory in a Transformercited by 1,001
  11. 2021Knowledge Neurons in Pretrained Transformerscited by 601
  12. 2021Editing Factual Knowledge in Language Modelscited by 553
34 more
  1. 2021Fast Model Editing at Scalecited by 498
  2. 2022Memory-Based Model Editing at Scalecited by 447
  3. 2024MoE-LLaVA: Mixture of Experts for Large Vision-Language Modelscited by 300
  4. 2023Can We Edit Factual Knowledge by In-Context Learning?cited by 285
  5. 2022Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptorscited by 271
  6. 2024AlphaEdit: Null-Space Constrained Knowledge Editing for Language Modelscited by 236
  7. 2023Transformer-Patcher: One Mistake worth One Neuroncited by 197
  8. 2024A Comprehensive Study of Knowledge Editing for Large Language Modelscited by 163
  9. 2020Editable Neural Networkscited by 155
  10. 2024MEMORYLLM: Towards Self-Updatable Large Language Modelscited by 93
  11. 2024WISE: Rethinking the Knowledge Memory for Lifelong Model Editing of Large Language Modelscited by 92
  12. 2023MELO: Enhancing Model Editing with Neuron-Indexed Dynamic LoRAcited by 80
  13. 2023Can We Edit Multimodal Large Language Models?cited by 44
  14. 2024Lifelong Knowledge Editing for LLMs with Retrieval-Augmented Continuous Prompt Learningcited by 40
  15. 2024Uncovering Overfitting in Large Language Model Editingcited by 39
  16. 2024Insight Over Sight: Exploring the Vision-Knowledge Conflicts in Multimodal LLMscited by 38
  17. 2024LLMs Meet Multimodal Generation and Editing: A Surveycited by 35
  18. 2024VLBiasBench: A Comprehensive Benchmark for Evaluating Bias in Large Vision-Language Modelcited by 26
  19. 2024Knowledge Editing through Chain-of-Thoughtcited by 26
  20. 2025WikiBigEdit: Understanding the Limits of Lifelong Knowledge Editing in LLMscited by 26
  21. 2025MMKE-Bench: A Multimodal Editing Benchmark for Diverse Visual Knowledgecited by 23
  22. 2024Neuron-Level Sequential Editing for Large Language Modelscited by 20
  23. 2025Unlocking Efficient, Scalable, and Continual Knowledge Editing with Basis-Level Representation Fine-Tuningcited by 19
  24. 2025Principled Multimodal Representation Learningcited by 19
  25. 2024Should We Really Edit Language Models? On the Evaluation of Edited Language Modelscited by 18
  26. 2025SAKE: Steering Activations for Knowledge Editingcited by 13
  27. 2024Neighboring Perturbations of Knowledge Editing on Large Language Modelscited by 10
  28. 2025CaKE: Circuit-aware Editing Enables Generalizable Knowledge Learnerscited by 9
  29. 2025Revealing and Mitigating Over-Attention in Knowledge Editingcited by 8
  30. 2025Exploring and Evaluating Multimodal Knowledge Reasoning Consistency of Multimodal Large Language Modelscited by 8
  31. 2025V-SEAM: Visual Semantic Editing and Attention Modulating for Causal Interpretability of Vision-Language Modelscited by 8
  32. 2025When Large Multimodal Models Confront Evolving Knowledge: Challenges and Explorationscited by 7
  33. 2024Is Cognition Consistent with Perception? Assessing and Mitigating Multimodal Knowledge Conflicts in Document Understandingcited by 4
  34. 2026DSCA: Dynamic Subspace Concept Alignment for Lifelong VLM Editingcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Generalizable Multimodal Large Language Model Editing via Invariant Trajectory Learning
  2. 2024ComprehendEdit: A Comprehensive Dataset and Evaluation Framework for Multimodal Knowledge Editing
  3. 2024Towards Unified Multimodal Editing with Enhanced Knowledge Collaboration
  4. 2026Beyond Binary Edits Robust Multimodal Knowledge Editing with Adversarial Subspace Alignment
  5. 2026Correct When Paired, Wrong When Split: Decoupling and Editing Modality-Specific Neurons in MLLMs
  6. 2026Beyond the Covariance Trap: Unlocking Generalization in Same-Subject Knowledge Editing for Large Language Models
  7. 2026Towards Localized and Disentangled Knowledge Editing for Multimodal Large Language Models
  8. 2025MIND-Edit: MLLM Insight-Driven Editing via Language-Vision Projection