MedXplain-VQA: Multi-Component Explainable Medical Visual Question Answering
Not on the map. Why?
Abstract (arXiv)
Explainability is critical for the clinical adoption of medical visual question answering (VQA) systems, as physicians require transparent reasoning to trust AI-generated diagnoses. We present MedXplain-VQA, a comprehensive framework integrating five explainable AI components to deliver interpretable medical image analysis. The framework leverages a fine-tuned BLIP-2 backbone, medical query reformulation, enhanced Grad-CAM attention, precise region extraction, and structured chain-of-thought reasoning via multi-modal language models. To evaluate the system, we introduce a medical-domain-specific framework replacing traditional NLP metrics with clinically relevant assessments, including terminology coverage, clinical structure quality, and attention region relevance. Experiments on 500 PathVQA histopathology samples demonstrate substantial improvements, with the enhanced system achieving a composite score of 0.683 compared to 0.378 for baseline methods, while maintaining high reasoning confidence (0.890). Our system identifies 3-5 diagnostically relevant regions per sample and generates structured explanations averaging 57 words with appropriate clinical terminology. Ablation studies reveal that query reformulation provides the most significant initial improvement, while chain-of-thought reasoning enables systematic diagnostic processes. These findings underscore the potential of MedXplain-VQA as a robust, explainable medical VQA system. Future work will focus on validation with medical experts and large-scale clinical datasets to ensure clinical readiness.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 23 of its 38 references that are in the map. First posted on arXiv 26 Oct 2025.
Builds on
23 of 38 references.
References · 23
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2015VQA: Visual Question Answeringcited by 2,506
- 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
11 more
- 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,423
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
- 2018Sanity Checks for Saliency Mapscited by 1,156
- 2023Multimodal Chain-of-Thought Reasoning in Language Modelscited by 752
- 2020PathVQA: 30000+ Questions for Medical Visual Question Answeringcited by 475
- 2019A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAIcited by 404
- 2023ChatDoctor: A Medical Chat Model Fine-Tuned on a Large Language Model Meta-AI (LLaMA) Using Medical Domain Knowledgecited by 325
- 2021Medical Visual Question Answering: A Surveycited by 93
- 2019Overcoming Data Limitation in Medical Visual Question Answeringcited by 71
- 2021MMBERT: Multimodal BERT Pretraining for Improved Medical VQAcited by 68
- 2023Measuring Faithful and Plausible Visual Grounding in VQAcited by 8
Built on by
Citing papers per year: 2025: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2023Interpretable Medical Image Visual Question Answering via Multi-Modal Relationship Graph Learning
- 2024GEMeX: A Large-Scale, Groundable, and Explainable Medical VQA Benchmark for Chest X-ray Diagnosis
- 2024MedThink: Explaining Medical Visual Question Answering via Multimodal Decision-Making Rationale
- 2025AMANDA: Agentic Medical Knowledge Augmentation for Data-Efficient Medical Visual Question Answering
- 2025Multimodal Retrieval-Augmented Generation with Large Language Models for Medical VQA
- 2026LiteMedCoT-VL: Parameter-Efficient Adaptation for Medical Visual Question Answering
- 2025ClinKD: Cross-Modal Clinical Knowledge Distiller For Multi-Task Medical Images
- 2023Visual Question Answering in the Medical Domain