Multimodal Knowledge Edit-Scoped Generalization for Online Recursive MLLM Editing
On the map: Multimodal LLMs / vision-language models → Image editing and quality assessment
Abstract (arXiv)
Online multimodal knowledge editing requires injecting a continual stream of visual-textual corrections into multimodal large language models (MLLMs) with bounded overhead and minimal disruption to unrelated behaviors. Existing editors mainly emphasize edit reliability and long-horizon stability, but rarely control the semantic boundary of each edit. Our pilot analyses of post-edit behaviors and internal neuronal activities reveal a scope gap behind reliable edits: instance-level success neither guarantees transfer to valid cross-modal variants nor prevents leakage to unrelated inputs, while edit-related cross-modal responses concentrate in deeper semantic layers. Therefore, we formulate Edit-Scoped Generalization, reframing online MLLM editing from merely correcting an instance to controlling the propagation boundary of each edit. To this end, we propose ScopeEdit, a scope-aware online editor that decomposes each update into a modality-local absorption branch and an evidence-gated shared generalization branch. The local branch supports stable edit absorption, whereas the shared branch enables cross-modal propagation only when visual and textual evidence are sufficiently aligned. Both branches perform scope-separated write geometries in orthogonal low-rank spaces and maintain branch-wise preconditioners via Sherman--Morrison recursions, yielding constant per-edit overhead. Extensive experiments across diverse benchmarks, long-horizon edit streams, MLLM backbones, real-world VLKEB scenarios, and complex vision-language architectures show that ScopeEdit consistently improves the trade-off between in-scope cross-modal transfer and out-of-scope locality, while preserving edit reliability, stability and online efficiency. Our code is available at https://github.com/lab-klc/ScopeEdit.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Image editing and quality assessment, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 55 of its 62 references that are in the map. First posted on arXiv 2 Jul 2026.
Builds on
55 of 62 references.
Closest ancestors · 9
Same direction, newest first
- 2026Modality-Decoupled Online Recursive Editing19 May
- 2025MemEIC: A Step Toward Continual and Compositional Knowledge Editing29 Oct
- 2025DualEdit: Dual Editing for Knowledge Updating in Vision-Language Models16 Jun
- 2025BalancEdit: Dynamically Balancing the Generality-Locality Trade-off in Multi-modal Model Editing2 May
- 2024Lifelong Knowledge Editing for Vision Language Models with Low-Rank Mixture-of-Experts23 Nov
- 2024Visual-Oriented Fine-Grained Knowledge Editing for MultiModal Large Language Models19 Nov
- 2024Attribution Analysis Meets Model Editing: Advancing Knowledge Correction in Vision Language Models with VisEdit19 Aug
- 2024MC-MKE: A Fine-Grained Multimodal Knowledge Editing Benchmark Emphasizing Modality Consistency19 Jun
- 2024VLKEB: A Large Vision-Language Model Knowledge Editing Benchmark12 Mar
Other references · 46
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2022Locating and Editing Factual Associations in GPTcited by 2,691
- 2023A Survey of Large Language Modelscited by 2,576
- 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,402
- 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,336
- 2022Mass-Editing Memory in a Transformercited by 1,001
- 2021Knowledge Neurons in Pretrained Transformerscited by 601
- 2021Editing Factual Knowledge in Language Modelscited by 553
34 more
- 2021Fast Model Editing at Scalecited by 498
- 2022Memory-Based Model Editing at Scalecited by 447
- 2024MoE-LLaVA: Mixture of Experts for Large Vision-Language Modelscited by 300
- 2023Can We Edit Factual Knowledge by In-Context Learning?cited by 285
- 2022Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptorscited by 271
- 2024AlphaEdit: Null-Space Constrained Knowledge Editing for Language Modelscited by 236
- 2023Transformer-Patcher: One Mistake worth One Neuroncited by 197
- 2024A Comprehensive Study of Knowledge Editing for Large Language Modelscited by 163
- 2020Editable Neural Networkscited by 155
- 2024MEMORYLLM: Towards Self-Updatable Large Language Modelscited by 93
- 2024WISE: Rethinking the Knowledge Memory for Lifelong Model Editing of Large Language Modelscited by 92
- 2023MELO: Enhancing Model Editing with Neuron-Indexed Dynamic LoRAcited by 80
- 2023Can We Edit Multimodal Large Language Models?cited by 44
- 2024Lifelong Knowledge Editing for LLMs with Retrieval-Augmented Continuous Prompt Learningcited by 40
- 2024Uncovering Overfitting in Large Language Model Editingcited by 39
- 2024Insight Over Sight: Exploring the Vision-Knowledge Conflicts in Multimodal LLMscited by 38
- 2024LLMs Meet Multimodal Generation and Editing: A Surveycited by 35
- 2024VLBiasBench: A Comprehensive Benchmark for Evaluating Bias in Large Vision-Language Modelcited by 26
- 2024Knowledge Editing through Chain-of-Thoughtcited by 26
- 2025WikiBigEdit: Understanding the Limits of Lifelong Knowledge Editing in LLMscited by 26
- 2025MMKE-Bench: A Multimodal Editing Benchmark for Diverse Visual Knowledgecited by 23
- 2024Neuron-Level Sequential Editing for Large Language Modelscited by 20
- 2025Unlocking Efficient, Scalable, and Continual Knowledge Editing with Basis-Level Representation Fine-Tuningcited by 19
- 2025Principled Multimodal Representation Learningcited by 19
- 2024Should We Really Edit Language Models? On the Evaluation of Edited Language Modelscited by 18
- 2025SAKE: Steering Activations for Knowledge Editingcited by 13
- 2024Neighboring Perturbations of Knowledge Editing on Large Language Modelscited by 10
- 2025CaKE: Circuit-aware Editing Enables Generalizable Knowledge Learnerscited by 9
- 2025Revealing and Mitigating Over-Attention in Knowledge Editingcited by 8
- 2025Exploring and Evaluating Multimodal Knowledge Reasoning Consistency of Multimodal Large Language Modelscited by 8
- 2025V-SEAM: Visual Semantic Editing and Attention Modulating for Causal Interpretability of Vision-Language Modelscited by 8
- 2025When Large Multimodal Models Confront Evolving Knowledge: Challenges and Explorationscited by 7
- 2024Is Cognition Consistent with Perception? Assessing and Mitigating Multimodal Knowledge Conflicts in Document Understandingcited by 4
- 2026DSCA: Dynamic Subspace Concept Alignment for Lifelong VLM Editingcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Generalizable Multimodal Large Language Model Editing via Invariant Trajectory Learning
- 2024ComprehendEdit: A Comprehensive Dataset and Evaluation Framework for Multimodal Knowledge Editing
- 2024Towards Unified Multimodal Editing with Enhanced Knowledge Collaboration
- 2026Beyond Binary Edits Robust Multimodal Knowledge Editing with Adversarial Subspace Alignment
- 2026Correct When Paired, Wrong When Split: Decoupling and Editing Modality-Specific Neurons in MLLMs
- 2026Beyond the Covariance Trap: Unlocking Generalization in Same-Subject Knowledge Editing for Large Language Models
- 2026Towards Localized and Disentangled Knowledge Editing for Multimodal Large Language Models
- 2025MIND-Edit: MLLM Insight-Driven Editing via Language-Vision Projection