mlsanityData to 7 Oct 2026

Kvasir-VQA: A Text-Image Pair GI Tract Dataset

arXiv 2409.01437 ↗First posted 2 Sep 2024cs.CV cs.AIcited by 23

Not on the map. Why?

Abstract (arXiv)

We introduce Kvasir-VQA, an extended dataset derived from the HyperKvasir and Kvasir-Instrument datasets, augmented with question-and-answer annotations to facilitate advanced machine learning tasks in Gastrointestinal (GI) diagnostics. This dataset comprises 6,500 annotated images spanning various GI tract conditions and surgical instruments, and it supports multiple question types including yes/no, choice, location, and numerical count. The dataset is intended for applications such as image captioning, Visual Question Answering (VQA), text-based generation of synthetic medical images, object detection, and classification. Our experiments demonstrate the dataset's effectiveness in training models for three selected tasks, showcasing significant applications in medical image analysis and diagnostics. We also present evaluation metrics for each task, highlighting the usability and versatility of our dataset. The dataset and supporting artifacts are available at https://datasets.simula.no/kvasir-vqa.

Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). Builds on 15 of its 57 references that are in the map. First posted on arXiv 2 Sep 2024.

Builds on

15 of 57 references.

References · 15

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  3. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  4. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,027
  5. 2022Diffusion Models for Medical Image Analysis: A Comprehensive Surveycited by 269
  6. 20192017 Robotic Instrument Segmentation Challengecited by 166
  7. 2023Prodigy: An Expeditiously Adaptive Parameter-Free Learnercited by 129
  8. 2021Medical Visual Question Answering: A Surveycited by 93
  9. 2021MMBERT: Multimodal BERT Pretraining for Improved Medical VQAcited by 68
  10. 2022Surgical-VQA: Visual Question Answering in Surgical Scenes using Transformercited by 58
  11. 2020Kvasir-Instrument: Diagnostic and therapeutic tool segmentation dataset in gastrointestinal endoscopycited by 54
  12. 2018Comparative evaluation of instrument segmentation and tracking methods in minimally invasive surgerycited by 36
3 more
  1. 2019Going Deep in Medical Image Analysis: Concepts, Methods, Challenges and Future Directionscited by 24
  2. 2022Medical Image Captioning via Generative Pretrained Transformerscited by 20
  3. 2022PolypConnect: Image inpainting for generating realistic gastrointestinal tract images with polypscited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 16; 2026: 5.

23 papers.

Sort:

By area:

  1. 2025Baichuan-Omni-1.5 Technical Reportcited by 107
  2. 2024Large Language Model Benchmarks in Medical Taskscited by 16
  3. 2024Frontiers in Intelligent Colonoscopycited by 13
  4. 2025EndoBench: A Comprehensive Evaluation of Multi-Modal Large Language Models for Endoscopy Analysiscited by 13
  5. 2025Hallucination-Aware Multimodal Benchmark for Gastrointestinal Image Analysis with Large Vision-Language Modelscited by 9
  6. 2025SurgViVQA: Temporally-Grounded Video Question Answering for Surgical Scene Understandingcited by 7
  7. 2025Prompt to Polyp: Medical Text-Conditioned Image Synthesis with Diffusion Modelscited by 5
  8. 2025HEDGE: Hallucination Estimation via Dense Geometric Entropy for VQA with Vision-Language Modelscited by 5
  9. 2025EndoCogniAgent: Closed-Loop Agentic Reasoning with Self-Consistency Validation for Endoscopic Diagnosiscited by 3
  10. 2025Medico 2025: Visual Question Answering for Gastrointestinal Imagingcited by 3
  11. 2025Med-RewardBench: Benchmarking Reward Models and Judges for Medical Multimodal Large Language Modelscited by 2
  12. 2025Multimodal LLM With Hierarchical Mixture-of-Experts for VQA on 3D Brain MRIcited by 2
11 more
  1. 2025Multi-Task Learning for Visually Grounded Reasoning in Gastrointestinal VQAcited by 2
  2. 2025Challenging Vision-Language Models with Surgical Data: A New Dataset and Broad Benchmarking Studycited by 1
  3. 2025Multimodal AI for Gastrointestinal Diagnostics: Tackling VQA in MEDVQA-GI 2025cited by 1
  4. 2026SAGE: An Expert-Annotated South Asian GI Endoscopy Dataset for Multimodal Learning and Hallucination Analysiscited by 1
  5. 2025Querying GI Endoscopy Images: A VQA Approachcited by 0
  6. 2025LEAML: Label-Efficient Adaptation to Out-of-Distribution Visual Tasks for Multimodal Large Language Modelscited by 0
  7. 2025Colon-X: Advancing Intelligent Colonoscopy toward Clinical Reasoningcited by 0
  8. 2026SurgLQA: Scalable Long-Horizon Surgical Video Question Answeringcited by 0
  9. 2026Parameter-Efficient VLMs for Gastrointestinal Endoscopy: Medical Image Generation and Clinical Visual Question Answeringcited by 0
  10. 2026Beyond the Leaderboard: Design Lessons for Trustworthy Multimodal VQAcited by 0
  11. 2026Measuring and Improving Complex-Atomic Answer Consistency in Endoscopic VQAcited by 0