Measuring and Improving Complex-Atomic Answer Consistency in Endoscopic VQA
Not on the map. Why?
Abstract (arXiv)
Endoscopic visual question answering (VQA) increasingly asks complex questions that combine several endoscopic answer components rather than isolated factual queries. Such complex answers may be scored as correct even when the same model fails on associated atomic questions. We introduce EndoCA, a paired complex-atomic answer consistency benchmark for evaluating whether complex answers remain consistent with same-image atomic answers. EndoCA contains two suites: EndoCA-Core evaluates compact question-complexity patterns commonly seen in practical endoscopic VQA, and EndoCA-Diagnostic supports controlled analysis across increasing question complexity. We evaluate 11 VLMs spanning open, medical, endoscopy-adapted, and closed-source models on EndoCA. Some VLMs achieve high complex-answer accuracy, yet their atomic-answer accuracy and complex-atomic answer consistency remain substantially lower. To reduce this complex-atomic inconsistency, we introduce Atomic-Support Reconciliation (ASR), a training-free mechanism that uses model-generated atomic answers as contextual premises for answer revision and consistency-guided selective answering. On four selected publicly available models, ASR-Revise improves paired complex-atomic correctness with modest changes in complex-answer accuracy, while ASR-Selective improves accuracy on answered cases by allowing the model to abstain from less reliable cases. Together, EndoCA and ASR provide a consistency-aware benchmark and a training-free mechanism for answer reconciliation and selective answering in endoscopic VQA.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 27 references that are in the map. First posted on arXiv 20 Jul 2026.
Builds on
23 of 27 references.
References · 23
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2015VQA: Visual Question Answeringcited by 2,506
- 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,729
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
- 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 810
- 2020PathVQA: 30000+ Questions for Medical Visual Question Answeringcited by 475
- 2021SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answeringcited by 449
- 2025MedGemma Technical Reportcited by 436
11 more
- 2025Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoningcited by 230
- 2021Medical Visual Question Answering: A Surveycited by 93
- 2023FaithScore: Fine-grained Evaluations of Hallucinations in Large Vision-Language Modelscited by 46
- 2024Kvasir-VQA: A Text-Image Pair GI Tract Datasetcited by 23
- 2025EndoBench: A Comprehensive Evaluation of Multi-Modal Large Language Models for Endoscopy Analysiscited by 14
- 2025Kvasir-VQA-x1: A Multimodal Dataset for Medical Reasoning and Robust MedVQA in Gastrointestinal Endoscopycited by 11
- 2025SurgViVQA: Temporally-Grounded Video Question Answering for Surgical Scene Understandingcited by 7
- 2025EndoCogniAgent: Closed-Loop Agentic Reasoning with Self-Consistency Validation for Endoscopic Diagnosiscited by 3
- 2020SOrT-ing VQA Models : Contrastive Gradient Learning for Improved Consistencycited by 2
- 2026Gastric-X: A Multimodal Multi-Phase Benchmark Dataset for Advancing Vision-Language Models in Gastric Cancer Analysiscited by 2
- 2025Multimodal AI for Gastrointestinal Diagnostics: Tackling VQA in MEDVQA-GI 2025cited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Tri-VQA: Triangular Reasoning Medical Visual Question Answering for Multi-Attribute Analysis
- 2026SurgCheck: Do Vision-Language Models Really Look at Images in Surgical VQA?
- 2026Towards Grounded GI Endoscopy VQA via Multi-Task Learning on Small VLMs
- 2025Querying GI Endoscopy Images: A VQA Approach
- 2025ReXVQA: A Large-scale Visual Question Answering Benchmark for Generalist Chest X-ray Understanding
- 2025Evaluating Reasoning Faithfulness in Medical Vision-Language Models using Multimodal Perturbations
- 2026Parameter-Efficient VLMs for Gastrointestinal Endoscopy: Medical Image Generation and Clinical Visual Question Answering
- 2023Logical Implications for Visual Question Answering Consistency