mlsanityData to 14 Oct 2026

Multimodal AI for Gastrointestinal Diagnostics: Tackling VQA in MEDVQA-GI 2025

arXiv 2507.14544 ↗First posted 19 Jul 2025cs.CV cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

This paper describes our approach to Subtask 1 of the ImageCLEFmed MEDVQA 2025 Challenge, which targets visual question answering (VQA) for gastrointestinal endoscopy. We adopt the Florence model-a large-scale multimodal foundation model-as the backbone of our VQA pipeline, pairing a powerful vision encoder with a text encoder to interpret endoscopic images and produce clinically relevant answers. To improve generalization, we apply domain-specific augmentations that preserve medical features while increasing training diversity. Experiments on the KASVIR dataset show that fine-tuning Florence yields accurate responses on the official challenge metrics. Our results highlight the potential of large multimodal models in medical VQA and provide a strong baseline for future work on explainability, robustness, and clinical integration. The code is publicly available at: https://github.com/TiwariLaxuu/VQA-Florence.git

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 13 of its 24 references that are in the map. First posted on arXiv 19 Jul 2025.

Builds on

13 of 24 references.

References · 13

  1. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  2. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  3. 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,516
  4. 2015VQA: Visual Question Answeringcited by 2,506
  5. 2021SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answeringcited by 449
  6. 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 410
  7. 2021Vision-Language Transformer and Query Generation for Referring Segmentationcited by 240
  8. 2021A Good Prompt Is Worth Millions of Parameters: Low-resource Prompt-based Learning for Vision-Language Modelscited by 101
  9. 2023UNK-VQA: A Dataset and a Probe into the Abstention Ability of Multi-modal Large Modelscited by 25
  10. 2024Kvasir-VQA: A Text-Image Pair GI Tract Datasetcited by 23
  11. 2022VQA and Visual Reasoning: An Overview of Recent Datasets, Methods and Challengescited by 14
  12. 2025Kvasir-VQA-x1: A Multimodal Dataset for Medical Reasoning and Robust MedVQA in Gastrointestinal Endoscopycited by 11
1 more
  1. 2025Prompt to Polyp: Medical Text-Conditioned Image Synthesis with Diffusion Modelscited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Querying GI Endoscopy Images: A VQA Approach
  2. 2026Parameter-Efficient VLMs for Gastrointestinal Endoscopy: Medical Image Generation and Clinical Visual Question Answering
  3. 2026Towards Grounded GI Endoscopy VQA via Multi-Task Learning on Small VLMs
  4. 2025A Lightweight Large Vision-language Model for Multimodal Medical Images
  5. 2025Are Vision Language Models Ready for Clinical Diagnosis? A 3D Medical Benchmark for Tumor-centric Visual Question Answering
  6. 2024MISS: A Generative Pretraining and Finetuning Approach for Med-VQA
  7. 2024OmniMedVQA: A New Large-Scale Comprehensive Evaluation Benchmark for Medical LVLM
  8. 2026Gastric-X: A Multimodal Multi-Phase Benchmark Dataset for Advancing Vision-Language Models in Gastric Cancer Analysis