mlsanityData to 7 Oct 2026

VLKEB: A Large Vision-Language Model Knowledge Editing Benchmark

arXiv 2403.07350 ↗First posted 12 Mar 2024cs.CL cs.AI cs.CVcited by 30

On the map: Multimodal LLMs / vision-language models → Image editing and quality assessment

Abstract (arXiv)

Recently, knowledge editing on large language models (LLMs) has received considerable attention. Compared to this, editing Large Vision-Language Models (LVLMs) faces extra challenges from diverse data modalities and complicated model components, and data for LVLMs editing are limited. The existing LVLM editing benchmark, which comprises three metrics (Reliability, Locality, and Generality), falls short in the quality of synthesized evaluation images and cannot assess whether models apply edited knowledge in relevant content. Therefore, we employ more reliable data collection methods to construct a new Large Vision-Language Model Knowledge Editing Benchmark, VLKEB, and extend the Portability metric for more comprehensive evaluation. Leveraging a multi-modal knowledge graph, our image data are bound with knowledge entities. This can be further used to extract entity-related knowledge, which constitutes the base of editing data. We conduct experiments of different editing methods on five LVLMs, and thoroughly analyze how do they impact the models. The results reveal strengths and deficiencies of these methods and hopefully provide insights for future research. The codes and dataset are available at: https://github.com/VLKEB/VLKEB.

Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). Placed in Image editing and quality assessment, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 28 of its 37 references that are in the map. First posted on arXiv 12 Mar 2024.

Builds on

28 of 37 references.

References · 28

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  5. 2023Visual Instruction Tuningcited by 7,792
  6. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  7. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  8. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
  9. 2021Knowledge Neurons in Pretrained Transformerscited by 590
  10. 2021Editing Factual Knowledge in Language Modelscited by 548
  11. 2023mPLUG-Owl2: Revolutionizing Multi-modal Large Language Model with Modality Collaborationcited by 545
  12. 2021Fast Model Editing at Scalecited by 491
16 more
  1. 2022Memory-Based Model Editing at Scalecited by 443
  2. 2017Zero-Shot Relation Extraction via Reading Comprehensioncited by 425
  3. 2023Editing Large Language Models: Problems, Methods, and Opportunitiescited by 367
  4. 2023MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questionscited by 292
  5. 2023Can We Edit Factual Knowledge by In-Context Learning?cited by 284
  6. 2022Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptorscited by 267
  7. 2023Evaluating the Ripple Effects of Knowledge Editing in Language Modelscited by 238
  8. 2023Transformer-Patcher: One Mistake worth One Neuroncited by 196
  9. 2023Knowledge Editing for Large Language Models: A Surveycited by 189
  10. 2024A Comprehensive Study of Knowledge Editing for Large Language Modelscited by 157
  11. 2019MMKG: Multi-Modal Knowledge Graphscited by 104
  12. 2023EasyEdit: An Easy-to-use Knowledge Editing Framework for Large Language Modelscited by 97
  13. 2022Calibrating Factual Knowledge in Pretrained Language Modelscited by 92
  14. 2023Massive Editing for Large Language Models via Meta Learningcited by 62
  15. 2023Can We Edit Multimodal Large Language Models?cited by 44
  16. 2016WikiReading: A Novel Large-scale Language Understanding Task over Wikipediacited by 26

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 7; 2025: 14; 2026: 9.

30 papers.

Sort:

By area:

  1. 2024MME-Survey: A Comprehensive Survey on Evaluation of Multimodal LLMscited by 72
  2. 2024Knowledge Mechanisms in Large Language Models: A Survey and Perspectivecited by 50
  3. 2025Pixels Versus Priors: Controlling Knowledge Priors in Vision-Language Models through Visual Counterfactscited by 30
  4. 2024Can Knowledge Editing Really Correct Hallucinations?cited by 28
  5. 2024A Survey on Multimodal Benchmarks: In the Era of Large AI Modelscited by 27
  6. 2024Can Editing LLMs Inject Harm?cited by 22
  7. 2025MMKE-Bench: A Multimodal Editing Benchmark for Diverse Visual Knowledgecited by 22
  8. 2024Lifelong Knowledge Editing for Vision Language Models with Low-Rank Mixture-of-Expertscited by 14
  9. 2025MINED: Probing and Updating with Multimodal Time-Sensitive Knowledge for Large Multimodal Modelscited by 7
  10. 2025CLIP-UP: CLIP-Based Unanswerable Problem Detection for Visual Question Answeringcited by 6
  11. 2025When Large Multimodal Models Confront Evolving Knowledge: Challenges and Explorationscited by 6
  12. 2025SAKE: Towards Editing Auditory Attribute Knowledge of Large Audio-Language Modelscited by 5
18 more
  1. 2026MMKU-Bench: A Multimodal Update Benchmark for Diverse Visual Knowledgecited by 5
  2. 2024ComprehendEdit: A Comprehensive Dataset and Evaluation Framework for Multimodal Knowledge Editingcited by 4
  3. 2025MolEdit: Knowledge Editing for Multimodal Molecule Language Modelscited by 3
  4. 2026Before Forgetting, Learn to Remember: Revisiting Foundational Learning Failures in LVLM Unlearning Benchmarkscited by 3
  5. 2025SNS-Bench-VL: Benchmarking Multimodal Large Language Models in Social Networking Servicescited by 2
  6. 2025MedMKEB: A Comprehensive Knowledge Editing Benchmark for Medical Multimodal Large Language Modelscited by 2
  7. 2025MemEIC: A Step Toward Continual and Compositional Knowledge Editingcited by 2
  8. 2025Towards Meta-Cognitive Knowledge Editing for Multimodal LLMscited by 1
  9. 2026Generalizable Multimodal Large Language Model Editing via Invariant Trajectory Learningcited by 1
  10. 2026DSCA: Dynamic Subspace Concept Alignment for Lifelong VLM Editingcited by 1
  11. 2025ADS-Edit: A Multimodal Knowledge Editing Dataset for Autonomous Driving Systemscited by 0
  12. 2025Lifting Data-Tracing Machine Unlearning to Knowledge-Tracing for Foundation Modelscited by 0
  13. 2025Uncovering and Mitigating Transient Blindness in Multimodal Model Editingcited by 0
  14. 2026ReasonEdit: Editing Vision-Language Models using Human Reasoningcited by 0
  15. 2026Uncovering Entity Identity Confusion in Multimodal Knowledge Editingcited by 0
  16. 2026CrossCult-KIBench: A Benchmark for Cross-Cultural Knowledge Insertion in MLLMscited by 0
  17. 2026Beyond Binary Edits Robust Multimodal Knowledge Editing with Adversarial Subspace Alignmentcited by 0
  18. 2026Multimodal Knowledge Edit-Scoped Generalization for Online Recursive MLLM Editingcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Attribution Analysis Meets Model Editing: Advancing Knowledge Correction in Vision Language Models with VisEdit
  2. 202620/20 Vision Language Models: A Prescription for Better VLMs through Data Curation Alone
  3. 2024Visual-Oriented Fine-Grained Knowledge Editing for MultiModal Large Language Models
  4. 2026Evaluating and Understanding Model Editing for Medical Vision Language Models
  5. 2025DualEdit: Dual Editing for Knowledge Updating in Vision-Language Models
  6. 2023ReForm-Eval: Evaluating Large Vision Language Models via Unified Re-Formulation of Task-Oriented Benchmarks
  7. 2026V-DyKnow: A Dynamic Benchmark for Time-Sensitive Knowledge in Vision Language Models
  8. 2026DataComp-VLM: Improved Open Datasets for Vision-Language Models