Barriers in Integrating Medical Visual Question Answering into Radiology Workflows: A Scoping Review and Clinicians' Insights
Not on the map. Why?
Abstract (arXiv)
Medical Visual Question Answering (MedVQA) is a promising tool to assist radiologists by automating medical image interpretation through question answering. Despite advances in models and datasets, MedVQA's integration into clinical workflows remains limited. This study systematically reviews 68 publications (2018-2024) and surveys 50 clinicians from India and Thailand to examine MedVQA's practical utility, challenges, and gaps. Following the Arksey and O'Malley scoping review framework, we used a two-pronged approach: (1) reviewing studies to identify key concepts, advancements, and research gaps in radiology workflows, and (2) surveying clinicians to capture their perspectives on MedVQA's clinical relevance. Our review reveals that nearly 60% of QA pairs are non-diagnostic and lack clinical relevance. Most datasets and models do not support multi-view, multi-resolution imaging, EHR integration, or domain knowledge, features essential for clinical diagnosis. Furthermore, there is a clear mismatch between current evaluation metrics and clinical needs. The clinician survey confirms this disconnect: only 29.8% consider MedVQA systems highly useful. Key concerns include the absence of patient history or domain knowledge (87.2%), preference for manually curated datasets (51.1%), and the need for multi-view image support (78.7%). Additionally, 66% favor models focused on specific anatomical regions, and 89.4% prefer dialogue-based interactive systems. While MedVQA shows strong potential, challenges such as limited multimodal analysis, lack of patient context, and misaligned evaluation approaches must be addressed for effective clinical integration.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 23 of its 73 references that are in the map. First posted on arXiv 9 Jul 2025.
Builds on
23 of 73 references.
References · 23
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
- 2022MedCLIP: Contrastive Learning from Unpaired Medical Images and Textcited by 564
- 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 506
- 2021SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answeringcited by 444
- 2023Med-Flamingo: a Multimodal Medical Few-shot Learnercited by 387
- 2020CheXbert: Combining Automatic Labelers and Expert Annotations for Accurate Radiology Report Labeling Using BERTcited by 329
- 2023PMC-CLIP: Contrastive Language-Image Pre-training using Biomedical Documentscited by 212
- 2023BiomedGPT: A Generalist Vision-Language Foundation Model for Diverse Biomedical Taskscited by 201
- 2022Multi-Modal Masked Autoencoders for Medical Vision-and-Language Pre-Trainingcited by 104
- 2021Medical Visual Question Answering: A Surveycited by 93
- 2019Overcoming Data Limitation in Medical Visual Question Answeringcited by 71
- 2021MMBERT: Multimodal BERT Pretraining for Improved Medical VQAcited by 68
11 more
- 2021Multiple Meta-model Quantifying for Medical Visual Question Answeringcited by 54
- 2023EHRXQA: A Multi-Modal Question Answering Dataset for Electronic Health Records with Chest X-ray Imagescited by 53
- 2023Expert Knowledge-Aware Image Difference Graph Representation Learning for Difference-Aware Medical Visual Question Answeringcited by 41
- 2023Q2ATransformer: Improving Medical VQA via an Answer Querying Decodercited by 31
- 2021Cross-Modal Self-Attention with Multi-Task Pre-Training for Medical Visual Question Answeringcited by 26
- 2020A Question-Centric Model for Visual Question Answering in Medical Imagingcited by 23
- 2024MISS: A Generative Pretraining and Finetuning Approach for Med-VQAcited by 14
- 2020Hierarchical Deep Multi-modal Network for Medical Visual Question Answeringcited by 11
- 2023Radiology-Aware Model-Based Evaluation Metric for Report Generationcited by 7
- 2022A Dual-Attention Learning Network with Word and Sentence Embedding for Medical Visual Question Answeringcited by 5
- 2024M2I2: Learning Efficient Multi-Agent Communication via Masked State Modeling and Intention Inferencecited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.