Towards Self-Explainable Document Visual Question Answering with Chain-of-Explanation Predictions
On the map: Multimodal LLMs / vision-language models → VLM benchmarks and visual reasoning
Abstract (arXiv)
Document Visual Question Answering (DocVQA) requires vision-language models to reason not only about what information in a document is relevant to a question, but also where the answer is grounded on the page. Existing DocVQA models entangle question-relevant evidence and answer localization and operate largely as black boxes, offering limited means to verify how predictions depend on visual evidence. We propose CoExVQA, a self-explainable DocVQA framework with a grounded reasoning process through a chain-of-explanation design. CoExVQA first identifies question-relevant evidence, then explicitly localizes the answer region, and finally decodes the answer exclusively from the grounded region. Prediction via CoExVQA's chain-of-explanation enables direct inspection and verification of the reasoning process across modalities. Empirical results show that restricting decoding to grounded evidence achieves SotA explainable DocVQA performance on PFL-DocVQA, improving ANLS by 12% over the current explainable baselines while providing transparent and verifiable predictions.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in VLM benchmarks and visual reasoning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 37 of its 50 references that are in the map. First posted on arXiv 7 May 2026.
Builds on
37 of 50 references.
Closest ancestors · 2
Same direction, newest first
- 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models13 Jun
- 2024Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoning25 Mar
Other references · 35
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,368
- 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
- 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,178
- 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,122
- 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 485
- 2021OCR-free Document Understanding Transformercited by 407
23 more
- 2022Pix2Struct: Screenshot Parsing as Pretraining for Visual Language Understandingcited by 366
- 2022Language in a Bottle: Language Model Guided Concept Bottlenecks for Interpretable Image Classificationcited by 312
- 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learningcited by 278
- 2018Multimodal Explanations: Justifying Decisions and Pointing to the Evidencecited by 179
- 2019Self-Driving Cars: A Surveycited by 148
- 2021Explainable AI (XAI): A Systematic Meta-Survey of Current Challenges and Future Opportunitiescited by 125
- 2023Explainable Artificial Intelligence (XAI) 2.0: A Manifesto of Open Challenges and Interdisciplinary Research Directionscited by 125
- 2019Iterative Answer Prediction with Pointer-Augmented Multimodal Transformers for TextVQAcited by 107
- 2021LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understandingcited by 103
- 2020TAP: Text-Aware Pre-training for Text-VQA and Text-Captioncited by 95
- 2021AI in Finance: Challenges, Techniques and Opportunitiescited by 81
- 2024Multi-Object Hallucination in Vision-Language Modelscited by 60
- 2025YOLOv13: Real-Time Object Detection with Hypergraph-Enhanced Adaptive Visual Perceptioncited by 58
- 2018Learning Visual Question Answering by Bootstrapping Hard Attentioncited by 24
- 2021Automated Generation of Accurate & Fluent Medical X-ray Reportscited by 24
- 2024On the Faithfulness of Vision Transformer Explanationscited by 19
- 2023Privacy-Aware Document Visual Question Answeringcited by 17
- 2024A Survey of Explainable Artificial Intelligence (XAI) in Financial Time Series Forecastingcited by 14
- 2025CoE: Chain-of-Explanation via Automatic Visual Concept Circuit Description and Polysemanticity Quantificationcited by 9
- 2025DocVXQA: Context-Aware Visual Explanations for Document Question Answeringcited by 5
- 2025Visual Alignment of Medical Vision-Language Models for Grounded Radiology Report Generationcited by 5
- 2023Locate Then Generate: Bridging Vision and Language with Bounding Box for Scene-Text VQAcited by 4
- 2025ColMate: Contrastive Late Interaction and Masked Text for Multimodal Document Retrievalcited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025ProtoVQA: An Adaptable Prototypical Framework for Explainable Fine-Grained Visual Question Answering
- 2026DocTrace: Towards Traceable Long Document VQA via Hierarchical Evidence Graph Reasoning
- 2026Comparative Study of Domain-adapted VLMs for General Document Visual Question Answering
- 2025SciEGQA: A Dataset for Scientific Evidence-Grounded Question Answering and Reasoning
- 2026Doc-V*:Coarse-to-Fine Interactive Visual Reasoning for Multi-Page Document VQA
- 2025Spatially Grounded Explanations in Vision Language Models for Document Visual Question Answering
- 2026TestHallVQA: Exploring LVLMs' Document-Level Reasoning under Redundant Contexts from Scientific Exams
- 2025DocVAL: Validated Chain-of-Thought Distillation for Grounded Document VQA