mlsanityData to 14 Oct 2026

ReasonVQA: A Multi-hop Reasoning Benchmark with Structural Knowledge for Visual Question Answering

arXiv 2507.16403 ↗First posted 22 Jul 2025cs.CVcited by 8

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

In this paper, we propose a new dataset, ReasonVQA, for the Visual Question Answering (VQA) task. Our dataset is automatically integrated with structured encyclopedic knowledge and constructed using a low-cost framework, which is capable of generating complex, multi-hop questions. We evaluated state-of-the-art VQA models on ReasonVQA, and the empirical results demonstrate that ReasonVQA poses significant challenges to these models, highlighting its potential for benchmarking and advancing the field of VQA. Additionally, our dataset can be easily scaled with respect to input images; the current version surpasses the largest existing datasets requiring external knowledge by more than an order of magnitude.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 30 of its 43 references that are in the map. First posted on arXiv 22 Jul 2025.

Builds on

30 of 43 references.

References · 30

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  3. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  4. 2025Qwen2.5-VL Technical Reportcited by 5,587
  5. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  6. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
  7. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  8. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,656
  9. 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,516
  10. 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,457
  11. 2017Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answeringcited by 1,312
  12. 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,121
18 more
  1. 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,067
  2. 2023mPLUG-Owl2: Revolutionizing Multi-modal Large Language Model with Modality Collaborationcited by 547
  3. 2024What matters when building vision-language models?cited by 326
  4. 2020Google Landmarks Dataset v2 -- A Large-Scale Benchmark for Instance-Level Recognition and Retrievalcited by 309
  5. 2024mPLUG-Owl3: Towards Long Image-Sequence Understanding in Multi-Modal Large Language Modelscited by 291
  6. 2025SmolVLM: Redefining small and efficient multimodal modelscited by 237
  7. 2024MANTIS: Interleaved Multi-Image Instruction Tuningcited by 216
  8. 2023Can Pre-trained Vision and Language Models Answer Visual Information-Seeking Questions?cited by 207
  9. 2024PaliGemma 2: A Family of Versatile VLMs for Transfercited by 207
  10. 2016FVQA: Fact-based Visual Question Answeringcited by 181
  11. 2015Exploring Models and Data for Image Question Answeringcited by 139
  12. 2014A Multi-World Approach to Question Answering about Real-World Scenes based on Uncertain Inputcited by 112
  13. 2019Iterative Answer Prediction with Pointer-Augmented Multimodal Transformers for TextVQAcited by 107
  14. 2023Encyclopedic VQA: Visual questions about detailed properties of fine-grained categoriescited by 107
  15. 2021Zero-shot Visual Question Answering using Knowledge Graphcited by 37
  16. 2020Cross-modal Knowledge Reasoning for Knowledge-based Visual Question Answeringcited by 32
  17. 2019CRIC: A VQA Dataset for Compositional Reasoning on Vision and Commonsensecited by 27
  18. 2021PQA: Perceptual Question Answeringcited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 5.

8 papers.

  1. 2025PPTArena: A Benchmark for PowerPoint Editingcited by 11
  2. 2026Pix2Fact: When Vision Is Not Enough -- Benchmarking Fine-Grained VQA with Web Verification on High-Resolution Real-World Scenescited by 3
  3. 2025Breaking the Visual Shortcuts in Multimodal Knowledge-Based Visual Question Answeringcited by 2
  4. 2026Benchmarking PhD-Level Coding in 3D Geometric Computer Visioncited by 2
  5. 2025CoSPlan: Corrective Sequential Planning via Scene Graph Incremental Updatescited by 1
  6. 2026CRAG-MM-Diagnostics: Enabling Stage-Wise Analysis of Knowledge-Intensive VQAcited by 0
  7. 2026VISPATH: Visual-Intent-Guided Path Reasoning for Multimodal Knowledge Graph Question Answeringcited by 0
  8. 2026ActICL: Post-Training for Agentic Multimodal In-Context Learningcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2022A-OKVQA: A Benchmark for Visual Question Answering using World Knowledge
  2. 2024A Comprehensive Survey on Visual Question Answering Datasets and Algorithms
  3. 2024Disentangling Knowledge-based and Visual Reasoning by Question Decomposition in KB-VQA
  4. 2025Exploring Advanced Techniques for Visual Question Answering: A Comprehensive Comparison
  5. 2024II-MMR: Identifying and Improving Multi-modal Multi-hop Reasoning in Visual Question Answering
  6. 2024Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Survey
  7. 2023VTQA: Visual Text Question Answering via Entity Alignment and Cross-Media Reasoning
  8. 2026Identifying and Resolving Pitfalls of Knowledge-Based VQA Benchmarks: Auditing, Repairing, and Augmenting