Overcoming Data Limitation in Medical Visual Question Answering
Not on the map. Why?
Abstract (arXiv)
Traditional approaches for Visual Question Answering (VQA) require large amount of labeled data for training. Unfortunately, such large scale data is usually not available for medical domain. In this paper, we propose a novel medical VQA framework that overcomes the labeled data limitation. The proposed framework explores the use of the unsupervised Denoising Auto-Encoder (DAE) and the supervised Meta-Learning. The advantage of DAE is to leverage the large amount of unlabeled images while the advantage of Meta-Learning is to learn meta-weights that quickly adapt to VQA problem with limited labeled data. By leveraging the advantages of these techniques, it allows the proposed framework to be efficiently trained using a small labeled training set. The experimental results show that our proposed method significantly outperforms the state-of-the-art medical VQA.
Key facts. Cited by 71 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 8; 2023: 20; 2024: 16; 2025: 14; 2026: 4.
71 papers.
Sort:
By area:
- 2021SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answeringcited by 444
- 2023PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answeringcited by 333
- 2023PMC-CLIP: Contrastive Language-Image Pre-training using Biomedical Documentscited by 212
- 2022Multi-Modal Masked Autoencoders for Medical Vision-and-Language Pre-Trainingcited by 104
- 2021Multi-modal Understanding and Generation for Medical Images and Text via Vision-Language Pre-Trainingcited by 96
- 2021Medical Visual Question Answering: A Surveycited by 93
- 2021Does CLIP Benefit Visual Question Answering in the Medical Domain as Much as it Does in the General Domain?cited by 85
- 2021MMBERT: Multimodal BERT Pretraining for Improved Medical VQAcited by 68
- 2023Open-Ended Medical Visual Question Answering Through Prefix Tuning of Language Modelscited by 58
- 2021Multiple Meta-model Quantifying for Medical Visual Question Answeringcited by 54
- 2022Align, Reason and Learn: Enhancing Medical Vision-and-Language Pre-training with Knowledgecited by 51
- 2021Biomedical Question Answering: A Survey of Approaches and Challengescited by 46
38 more
- 2024MedCoT: Medical Chain of Thought via Hierarchical Expertcited by 46
- 2025Med3DVLM: An Efficient Vision-Language Model for 3D Medical Image Analysiscited by 44
- 2025Improving Medical Large Vision-Language Models with Abnormal-Aware Feedbackcited by 42
- 2023Towards Unifying Medical Vision-and-Language Pre-training via Soft Promptscited by 35
- 2023RAMM: Retrieval-augmented Biomedical Visual Question Answering with Multi-modal Pre-trainingcited by 31
- 2023Q2ATransformer: Improving Medical VQA via an Answer Querying Decodercited by 31
- 2022Self-supervised vision-language pretraining for Medical visual question answeringcited by 30
- 2023Masked Vision and Language Pre-training with Unimodal and Multimodal Contrastive Losses for Medical Visual Question Answeringcited by 29
- 2024MultiMedEval: A Benchmark and a Toolkit for Evaluating Medical Vision-Language Modelscited by 28
- 20253D-RAD: A Comprehensive 3D Radiology Med-VQA Dataset with Multi-Temporal Analysis and Diverse Diagnostic Taskscited by 24
- 2023Multi-task Paired Masking with Alignment Modeling for Medical Vision-Language Pre-trainingcited by 22
- 2024R-LLaVA: Improving Med-VQA Understanding through Visual Region of Interestcited by 21
- 2024Has Multimodal Learning Delivered Universal Intelligence in Healthcare? A Comprehensive Surveycited by 20
- 2023Rad-ReStruct: A Novel VQA Benchmark and Method for Structured Radiology Reportingcited by 17
- 2022RepsNet: Combining Vision with Language for Automated Medical Reportscited by 14
- 2024MISS: A Generative Pretraining and Finetuning Approach for Med-VQAcited by 14
- 2024MedThink: Explaining Medical Visual Question Answering via Multimodal Decision-Making Rationalecited by 14
- 2025MM-Skin: Enhancing Dermatology Vision-Language Model with an Image-Text Dataset Derived from Textbookscited by 14
- 2023A scoping review on multimodal deep learning in biomedical images and textscited by 13
- 2024LaPA: Latent Prompt Assist Model For Medical Visual Question Answeringcited by 12
- 2021Visual Question Answering: which investigated applications?cited by 11
- 2023Towards Medical Artificial General Intelligence via Knowledge-Enhanced Multimodal Pretrainingcited by 11
- 2024Efficiency in Focus: LayerNorm as a Catalyst for Fine-tuning Medical Visual Language Pre-trained Modelscited by 11
- 2022Consistency-preserving Visual Question Answering in Medical Imagingcited by 10
- 2022UnICLAM:Contrastive Representation Learning with Adversarial Masking for Unified and Interpretable Medical Vision Question Answeringcited by 6
- 2023Logical Implications for Visual Question Answering Consistencycited by 6
- 2024Memory-Augmented Multimodal LLMs for Surgical VQA via Self-Contained Inquirycited by 6
- 2025Structure Causal Models and LLMs Integration in Medical Visual Question Answeringcited by 6
- 2022A Dual-Attention Learning Network with Word and Sentence Embedding for Medical Visual Question Answeringcited by 5
- 2023Multi-modal Pre-training for Medical Vision-language Understanding and Generation: An Empirical Study with A New Benchmarkcited by 5
- 2023Localized Questions in Medical Visual Question Answeringcited by 5
- 2025SilVar-Med: A Speech-Driven Visual Language Model for Explainable Abnormality Detection in Medical Imagingcited by 5
- 2021MuVAM: A Multi-View Attention-based Model for Medical Visual Question Answeringcited by 4
- 2024Prompt-based Personalized Federated Learning for Medical Visual Question Answeringcited by 4
- 2023MetaLDC: Meta Learning of Low-Dimensional Computing Classifiers for Fast On-Device Adaptioncited by 3
- 2023BESTMVQA: A Benchmark Evaluation System for Medical Visual Question Answeringcited by 3
- 2023UniDCP: Unifying Multiple Medical Vision-language Tasks via Dynamic Cross-modal Learnable Promptscited by 3
- 2024Unified Multi-modal Diagnostic Framework with Reconstruction Pre-training and Heterogeneity-combat Tuningcited by 3
50 most cited of 71 All 71 (JSON)
- 2026Dual Causal Inference: Integrating Backdoor Adjustment and Instrumental Variable Learning for Medical VQA22 Apr 2026
- 2026KG-CMI: Knowledge graph enhanced cross-Mamba interaction for medical visual question answering1 Apr 2026
- 2026Learning to Trim: End-to-End Causal Graph Pruning with Dynamic Anatomical Feature Banks for Medical VQA27 Mar 2026
- 2026ViX-Ray: A Vietnamese Chest X-Ray Dataset for Vision-Language Models16 Mar 2026
- 2025CMI-MTL: Cross-Mamba interaction based multi-task learning for medical visual question answering3 Nov 2025
- 2025MedXplain-VQA: Multi-Component Explainable Medical Visual Question Answering26 Oct 2025
- 2025Alignment, Mining and Fusion: Representation Alignment with Hard Negative Mining and Selective Knowledge Fusion for Medical Visual Question Answering9 Oct 2025
- 2025Med-GRIM: Enhanced Zero-Shot Medical VQA using prompt-embedded Multimodal Graph RAG20 Jul 2025
- 2025Barriers in Integrating Medical Visual Question Answering into Radiology Workflows: A Scoping Review and Clinicians' Insights9 Jul 2025
- 2025Cause-Effect Driven Optimization for Robust Medical Visual Question Answering with Language Biases22 Jun 2025
- 20253D-RAD: A Comprehensive 3D Radiology Med-VQA Dataset with Multi-Temporal Analysis and Diverse Diagnostic Tasks11 Jun 2025
- 2025MM-Skin: Enhancing Dermatology Vision-Language Model with an Image-Text Dataset Derived from Textbooks9 May 2025
38 more
- 2025Structure Causal Models and LLMs Integration in Medical Visual Question Answering5 May 2025
- 2025AdCare-VLM: Towards a Unified and Pre-aligned Latent Representation for Healthcare Video Understanding1 May 2025
- 2025SilVar-Med: A Speech-Driven Visual Language Model for Explainable Abnormality Detection in Medical Imaging14 Apr 2025
- 2025Med3DVLM: An Efficient Vision-Language Model for 3D Medical Image Analysis25 Mar 2025
- 2025DiN: Diffusion Model for Robust Medical VQA with Semantic Noisy Labels24 Mar 2025
- 2025Improving Medical Large Vision-Language Models with Abnormal-Aware Feedback2 Jan 2025
- 2024MedCoT: Medical Chain of Thought via Hierarchical Expert18 Dec 2024
- 2024Memory-Augmented Multimodal LLMs for Surgical VQA via Self-Contained Inquiry17 Nov 2024
- 2024Efficient Bilinear Attention-based Fusion for Medical Visual Question Answering28 Oct 2024
- 2024R-LLaVA: Improving Med-VQA Understanding through Visual Region of Interest27 Oct 2024
- 2024Which Client is Reliable?: A Reliable and Personalized Prompt-based Federated Learning for Medical Image Question Answering23 Oct 2024
- 2024Has Multimodal Learning Delivered Universal Intelligence in Healthcare? A Comprehensive Survey23 Aug 2024
- 2024Tri-VQA: Triangular Reasoning Medical Visual Question Answering for Multi-Attribute Analysis21 Jun 2024
- 2024Efficiency in Focus: LayerNorm as a Catalyst for Fine-tuning Medical Visual Language Pre-trained Models25 Apr 2024
- 2024Grounded Knowledge-Enhanced Medical Vision-Language Pre-training for Chest X-Ray23 Apr 2024
- 2024LaPA: Latent Prompt Assist Model For Medical Visual Question Answering19 Apr 2024
- 2024MedThink: Explaining Medical Visual Question Answering via Multimodal Decision-Making Rationale18 Apr 2024
- 2024Unified Multi-modal Diagnostic Framework with Reconstruction Pre-training and Heterogeneity-combat Tuning9 Apr 2024
- 2024Enhancing Generalization in Medical Visual Question Answering Tasks via Gradient-Guided Model Perturbation5 Mar 2024
- 2024Prompt-based Personalized Federated Learning for Medical Visual Question Answering15 Feb 2024
- 2024MultiMedEval: A Benchmark and a Toolkit for Evaluating Medical Vision-Language Models14 Feb 2024
- 2024MISS: A Generative Pretraining and Finetuning Approach for Med-VQA10 Jan 2024
- 2023UniDCP: Unifying Multiple Medical Vision-language Tasks via Dynamic Cross-modal Learnable Prompts18 Dec 2023
- 2023BESTMVQA: A Benchmark Evaluation System for Medical Visual Question Answering13 Dec 2023
- 2023Causal Reasoning through Two Layers of Cognition for Improving Generalization in Visual Question Answering9 Oct 2023
- 2023A scoping review on multimodal deep learning in biomedical images and texts14 Jul 2023
- 2023Rad-ReStruct: A Novel VQA Benchmark and Method for Structured Radiology Reporting11 Jul 2023
- 2023Masked Vision and Language Pre-training with Unimodal and Multimodal Contrastive Losses for Medical Visual Question Answering11 Jul 2023
- 2023Localized Questions in Medical Visual Question Answering3 Jul 2023
- 2023Multimodal Prompt Retrieval for Generative Visual Question Answering30 Jun 2023
- 2023Multi-modal Pre-training for Medical Vision-language Understanding and Generation: An Empirical Study with A New Benchmark10 Jun 2023
- 2023PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answering17 May 2023
- 2023Multi-task Paired Masking with Alignment Modeling for Medical Vision-Language Pre-training13 May 2023
- 2023Towards Medical Artificial General Intelligence via Knowledge-Enhanced Multimodal Pretraining26 Apr 2023
- 2023Q2ATransformer: Improving Medical VQA via an Answer Querying Decoder4 Apr 2023
- 2023Logical Implications for Visual Question Answering Consistency16 Mar 2023
- 2023PMC-CLIP: Contrastive Language-Image Pre-training using Biomedical Documents13 Mar 2023
- 2023Open-Ended Medical Visual Question Answering Through Prefix Tuning of Language Models10 Mar 2023
50 newest of 71 All 71 (JSON)
- 2021Multi-modal Understanding and Generation for Medical Images and Text via Vision-Language Pre-Trainingcited by 96
- 2025Med3DVLM: An Efficient Vision-Language Model for 3D Medical Image Analysiscited by 44
- 2025Improving Medical Large Vision-Language Models with Abnormal-Aware Feedbackcited by 42
- 2022Self-supervised vision-language pretraining for Medical visual question answeringcited by 30
- 2024MultiMedEval: A Benchmark and a Toolkit for Evaluating Medical Vision-Language Modelscited by 28
- 2023Multi-task Paired Masking with Alignment Modeling for Medical Vision-Language Pre-trainingcited by 22
- 2024MISS: A Generative Pretraining and Finetuning Approach for Med-VQAcited by 14
- 2025MM-Skin: Enhancing Dermatology Vision-Language Model with an Image-Text Dataset Derived from Textbookscited by 14
- 2024Efficiency in Focus: LayerNorm as a Catalyst for Fine-tuning Medical Visual Language Pre-trained Modelscited by 11
- 2024Memory-Augmented Multimodal LLMs for Surgical VQA via Self-Contained Inquirycited by 6
- 2023Multi-modal Pre-training for Medical Vision-language Understanding and Generation: An Empirical Study with A New Benchmarkcited by 5
- 2025SilVar-Med: A Speech-Driven Visual Language Model for Explainable Abnormality Detection in Medical Imagingcited by 5
12 most cited of 18 All 18 (JSON)
- 2026ViX-Ray: A Vietnamese Chest X-Ray Dataset for Vision-Language Models16 Mar 2026
- 2025Med-GRIM: Enhanced Zero-Shot Medical VQA using prompt-embedded Multimodal Graph RAG20 Jul 2025
- 2025MM-Skin: Enhancing Dermatology Vision-Language Model with an Image-Text Dataset Derived from Textbooks9 May 2025
- 2025SilVar-Med: A Speech-Driven Visual Language Model for Explainable Abnormality Detection in Medical Imaging14 Apr 2025
- 2025Med3DVLM: An Efficient Vision-Language Model for 3D Medical Image Analysis25 Mar 2025
- 2025Improving Medical Large Vision-Language Models with Abnormal-Aware Feedback2 Jan 2025
- 2024Memory-Augmented Multimodal LLMs for Surgical VQA via Self-Contained Inquiry17 Nov 2024
- 2024Efficiency in Focus: LayerNorm as a Catalyst for Fine-tuning Medical Visual Language Pre-trained Models25 Apr 2024
- 2024Grounded Knowledge-Enhanced Medical Vision-Language Pre-training for Chest X-Ray23 Apr 2024
- 2024Enhancing Generalization in Medical Visual Question Answering Tasks via Gradient-Guided Model Perturbation5 Mar 2024
- 2024MultiMedEval: A Benchmark and a Toolkit for Evaluating Medical Vision-Language Models14 Feb 2024
- 2024MISS: A Generative Pretraining and Finetuning Approach for Med-VQA10 Jan 2024
12 newest of 18 All 18 (JSON)
- 2024MedCoT: Medical Chain of Thought via Hierarchical Expertcited by 46
- 2024MedThink: Explaining Medical Visual Question Answering via Multimodal Decision-Making Rationalecited by 14
- 2023Logical Implications for Visual Question Answering Consistencycited by 6
- 2023Causal Reasoning through Two Layers of Cognition for Improving Generalization in Visual Question Answeringcited by 0
- 2024MedCoT: Medical Chain of Thought via Hierarchical Expert18 Dec 2024
- 2024MedThink: Explaining Medical Visual Question Answering via Multimodal Decision-Making Rationale18 Apr 2024
- 2023Causal Reasoning through Two Layers of Cognition for Improving Generalization in Visual Question Answering9 Oct 2023
- 2023Logical Implications for Visual Question Answering Consistency16 Mar 2023
- 2021SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answeringcited by 444
- 2023PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answeringcited by 333
- 2023PMC-CLIP: Contrastive Language-Image Pre-training using Biomedical Documentscited by 212
- 2022Multi-Modal Masked Autoencoders for Medical Vision-and-Language Pre-Trainingcited by 104
- 2021Medical Visual Question Answering: A Surveycited by 93
- 2021Does CLIP Benefit Visual Question Answering in the Medical Domain as Much as it Does in the General Domain?cited by 85
- 2021MMBERT: Multimodal BERT Pretraining for Improved Medical VQAcited by 68
- 2023Open-Ended Medical Visual Question Answering Through Prefix Tuning of Language Modelscited by 58
- 2021Multiple Meta-model Quantifying for Medical Visual Question Answeringcited by 54
- 2022Align, Reason and Learn: Enhancing Medical Vision-and-Language Pre-training with Knowledgecited by 51
- 2021Biomedical Question Answering: A Survey of Approaches and Challengescited by 46
- 2023Towards Unifying Medical Vision-and-Language Pre-training via Soft Promptscited by 35
12 most cited of 45 All 45 (JSON)
- 2026Dual Causal Inference: Integrating Backdoor Adjustment and Instrumental Variable Learning for Medical VQA22 Apr 2026
- 2026Learning to Trim: End-to-End Causal Graph Pruning with Dynamic Anatomical Feature Banks for Medical VQA27 Mar 2026
- 2025MedXplain-VQA: Multi-Component Explainable Medical Visual Question Answering26 Oct 2025
- 2025Alignment, Mining and Fusion: Representation Alignment with Hard Negative Mining and Selective Knowledge Fusion for Medical Visual Question Answering9 Oct 2025
- 2025Barriers in Integrating Medical Visual Question Answering into Radiology Workflows: A Scoping Review and Clinicians' Insights9 Jul 2025
- 2025Cause-Effect Driven Optimization for Robust Medical Visual Question Answering with Language Biases22 Jun 2025
- 20253D-RAD: A Comprehensive 3D Radiology Med-VQA Dataset with Multi-Temporal Analysis and Diverse Diagnostic Tasks11 Jun 2025
- 2025Structure Causal Models and LLMs Integration in Medical Visual Question Answering5 May 2025
- 2025AdCare-VLM: Towards a Unified and Pre-aligned Latent Representation for Healthcare Video Understanding1 May 2025
- 2024Efficient Bilinear Attention-based Fusion for Medical Visual Question Answering28 Oct 2024
- 2024R-LLaVA: Improving Med-VQA Understanding through Visual Region of Interest27 Oct 2024
- 2024Which Client is Reliable?: A Reliable and Personalized Prompt-based Federated Learning for Medical Image Question Answering23 Oct 2024
12 newest of 45 All 45 (JSON)