mlsanityData to 14 Oct 2026

Towards Self-Explainable Document Visual Question Answering with Chain-of-Explanation Predictions

arXiv 2605.06058 ↗First posted 7 May 2026cs.LG cs.CVcited by 1

On the map: Multimodal LLMs / vision-language models → VLM benchmarks and visual reasoning

Abstract (arXiv)

Document Visual Question Answering (DocVQA) requires vision-language models to reason not only about what information in a document is relevant to a question, but also where the answer is grounded on the page. Existing DocVQA models entangle question-relevant evidence and answer localization and operate largely as black boxes, offering limited means to verify how predictions depend on visual evidence. We propose CoExVQA, a self-explainable DocVQA framework with a grounded reasoning process through a chain-of-explanation design. CoExVQA first identifies question-relevant evidence, then explicitly localizes the answer region, and finally decodes the answer exclusively from the grounded region. Prediction via CoExVQA's chain-of-explanation enables direct inspection and verification of the reasoning process across modalities. Empirical results show that restricting decoding to grounded evidence achieves SotA explainable DocVQA performance on PFL-DocVQA, improving ANLS by 12% over the current explainable baselines while providing transparent and verifiable predictions.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in VLM benchmarks and visual reasoning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 37 of its 50 references that are in the map. First posted on arXiv 7 May 2026.

Builds on

37 of 50 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models13 Jun
  2. 2024Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoning25 Mar

Other references · 35

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  3. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  4. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
  5. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
  6. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  7. 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,368
  8. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
  9. 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,178
  10. 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,122
  11. 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 485
  12. 2021OCR-free Document Understanding Transformercited by 407
23 more
  1. 2022Pix2Struct: Screenshot Parsing as Pretraining for Visual Language Understandingcited by 366
  2. 2022Language in a Bottle: Language Model Guided Concept Bottlenecks for Interpretable Image Classificationcited by 312
  3. 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learningcited by 278
  4. 2018Multimodal Explanations: Justifying Decisions and Pointing to the Evidencecited by 179
  5. 2019Self-Driving Cars: A Surveycited by 148
  6. 2021Explainable AI (XAI): A Systematic Meta-Survey of Current Challenges and Future Opportunitiescited by 125
  7. 2023Explainable Artificial Intelligence (XAI) 2.0: A Manifesto of Open Challenges and Interdisciplinary Research Directionscited by 125
  8. 2019Iterative Answer Prediction with Pointer-Augmented Multimodal Transformers for TextVQAcited by 107
  9. 2021LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understandingcited by 103
  10. 2020TAP: Text-Aware Pre-training for Text-VQA and Text-Captioncited by 95
  11. 2021AI in Finance: Challenges, Techniques and Opportunitiescited by 81
  12. 2024Multi-Object Hallucination in Vision-Language Modelscited by 60
  13. 2025YOLOv13: Real-Time Object Detection with Hypergraph-Enhanced Adaptive Visual Perceptioncited by 58
  14. 2018Learning Visual Question Answering by Bootstrapping Hard Attentioncited by 24
  15. 2021Automated Generation of Accurate & Fluent Medical X-ray Reportscited by 24
  16. 2024On the Faithfulness of Vision Transformer Explanationscited by 19
  17. 2023Privacy-Aware Document Visual Question Answeringcited by 17
  18. 2024A Survey of Explainable Artificial Intelligence (XAI) in Financial Time Series Forecastingcited by 14
  19. 2025CoE: Chain-of-Explanation via Automatic Visual Concept Circuit Description and Polysemanticity Quantificationcited by 9
  20. 2025DocVXQA: Context-Aware Visual Explanations for Document Question Answeringcited by 5
  21. 2025Visual Alignment of Medical Vision-Language Models for Grounded Radiology Report Generationcited by 5
  22. 2023Locate Then Generate: Bridging Vision and Language with Bounding Box for Scene-Text VQAcited by 4
  23. 2025ColMate: Contrastive Late Interaction and Masked Text for Multimodal Document Retrievalcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025ProtoVQA: An Adaptable Prototypical Framework for Explainable Fine-Grained Visual Question Answering
  2. 2026DocTrace: Towards Traceable Long Document VQA via Hierarchical Evidence Graph Reasoning
  3. 2026Comparative Study of Domain-adapted VLMs for General Document Visual Question Answering
  4. 2025SciEGQA: A Dataset for Scientific Evidence-Grounded Question Answering and Reasoning
  5. 2026Doc-V*:Coarse-to-Fine Interactive Visual Reasoning for Multi-Page Document VQA
  6. 2025Spatially Grounded Explanations in Vision Language Models for Document Visual Question Answering
  7. 2026TestHallVQA: Exploring LVLMs' Document-Level Reasoning under Redundant Contexts from Scientific Exams
  8. 2025DocVAL: Validated Chain-of-Thought Distillation for Grounded Document VQA