Where To Look: Focus Regions for Visual Question Answering
Not on the map. Why?
Abstract (arXiv)
We present a method that learns to answer visual questions by selecting image regions relevant to the text-based query. Our method exhibits significant improvements in answering questions such as "what color," where it is necessary to evaluate a specific location, and "what room," where it selectively identifies informative image regions. Our model is tested on the VQA dataset which is the largest human-annotated visual question answering dataset to our knowledge.
Key facts. Cited by 64 papers in the map (data through 14 Oct 2026). First posted on arXiv 23 Nov 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 16; 2022: 16; 2023: 19; 2024: 8; 2025: 3; 2026: 2.
64 papers.
Sort:
By area:
- 2023To See is to Believe: Prompting GPT-4V for Better Visual Instruction Tuningcited by 144
- 2022CLEVR-Math: A Dataset for Compositional Language, Visual and Mathematical Reasoningcited by 120
- 2022Vision-Language Pre-training: Basics, Recent Advances, and Future Trendscited by 117
- 2024Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Surveycited by 76
- 2023A Comprehensive Survey on Applications of Transformers for Deep Learning Taskscited by 71
- 2021Attention, please! A survey of Neural Attention Models in Deep Learningcited by 51
- 2022GAMMA Challenge:Glaucoma grAding from Multi-Modality imAgescited by 46
- 2021N24News: A New Dataset for Multimodal News Classificationcited by 40
- 2022From Easy to Hard: Learning Language-guided Curriculum for Visual Question Answering on Remote Sensing Datacited by 39
- 2022Vision-Language Intelligence: Tasks, Representation Learning, and Large Modelscited by 28
- 2022Interpretable by Design: Learning Predictors by Composing Interpretable Queriescited by 28
- 2023Multi-modal Machine Learning in Engineering Design: A Review and Future Directionscited by 27
38 more
- 2022Towards Explainable 3D Grounded Visual Question Answering: A New Benchmark and Strong Baselinecited by 25
- 2023From Image to Language: A Critical Analysis of Visual Question Answering (VQA) Approaches, Challenges, and Opportunitiescited by 25
- 2022Vision+X: A Survey on Multimodal Learning in the Light of Datacited by 22
- 2021ProTo: Program-Guided Transformer for Program-Guided Taskscited by 21
- 2022LVP-M3: Language-aware Visual Prompt for Multilingual Multimodal Machine Translationcited by 21
- 2023HRVQA: A Visual Question Answering Benchmark for High-Resolution Aerial Imagescited by 21
- 2024LOVA3: Learning to Visual Question Answering, Asking and Assessmentcited by 21
- 2021Multimodal Integration of Human-Like Attention in Visual Question Answeringcited by 20
- 2023Interpretable Medical Image Visual Question Answering via Multi-Modal Relationship Graph Learningcited by 17
- 2022CLEVR-X: A Visual Reasoning Dataset for Natural Language Explanationscited by 16
- 2023Generate then Select: Open-ended Visual Question Answering Guided by World Knowledgecited by 16
- 2021VQA-Aid: Visual Question Answering for Post-Disaster Damage Assessment and Analysiscited by 15
- 2021Asking questions on handwritten document collectionscited by 14
- 2024Exploring Phrase-Level Grounding with Text-to-Image Diffusion Modelcited by 13
- 2023Diagnosing Human-object Interaction Detectorscited by 11
- 2021X-GGM: Graph Generative Modeling for Out-of-Distribution Generalization in Visual Question Answeringcited by 10
- 2023Answer Mining from a Pool of Images: Towards Retrieval-Based Visual Question Answeringcited by 10
- 2021Answer Questions with Right Image Regions: A Visual Attention Regularization Approachcited by 9
- 2024ViOCRVQA: Novel Benchmark Dataset and Vision Reader for Visual Question Answering by Understanding Vietnamese Text in Imagescited by 8
- 2024A Comprehensive Survey on Visual Question Answering Datasets and Algorithmscited by 8
- 2022From Pixels to Objects: Cubic Visual Attention for Visual Question Answeringcited by 7
- 2023Dual-Gated Fusion with Prefix-Tuning for Multi-Modal Relation Extractioncited by 7
- 2023Multi-Modal Knowledge Graph Transformer Framework for Multi-Modal Entity Alignmentcited by 7
- 2022Is GPT-3 all you need for Visual Question Answering in Cultural Heritage?cited by 6
- 2021Saying the Unseen: Video Descriptions via Dialog Agentscited by 5
- 2022Recent, rapid advancement in visual question answering architecture: a reviewcited by 5
- 2022DoRO: Disambiguation of referred object for embodied agentscited by 5
- 2022AlignVE: Visual Entailment Recognition Based on Alignment Relationscited by 5
- 2024Text-Guided Coarse-to-Fine Fusion Network for Robust Remote Sensing Visual Question Answeringcited by 5
- 2022Understanding Attention for Vision-and-Language Taskscited by 4
- 2023Semi-Supervised Panoptic Narrative Groundingcited by 4
- 2021Relation-aware Hierarchical Attention Framework for Video Question Answeringcited by 3
- 2025DepthFocus: Controllable Depth Estimation for See-Through Scenescited by 3
- 2021Latent Variable Models for Visual Question Answeringcited by 2
- 2021Visual Question Answering based on Local-Scene-Aware Referring Expression Generationcited by 2
- 2023Learning to Agree on Vision Attention for Visual Commonsense Reasoningcited by 2
- 2023Dynamic Clue Bottlenecks: Towards Interpretable-by-Design Visual Question Answeringcited by 2
- 2023Attention-Based Methods For Audio Question Answeringcited by 2
50 most cited of 64 All 64 (JSON)
- 2026Disentanglement-Based Equivariant Learning for Compositional VQA1 Jun 2026
- 2026How Good LLMs Are at Answering Bangla Medical Visual Questions? Dataset and Benchmarking18 May 2026
- 2025DepthFocus: Controllable Depth Estimation for See-Through Scenes21 Nov 2025
- 2025Vision Generalist Model: A Survey11 Jun 2025
- 2025Light as Deception: GPT-driven Natural Relighting Against Vision-Language Pre-training Models30 May 2025
- 2024Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Survey26 Nov 2024
- 2024Text-Guided Coarse-to-Fine Fusion Network for Robust Remote Sensing Visual Question Answering24 Nov 2024
- 2024A Comprehensive Survey on Visual Question Answering Datasets and Algorithms17 Nov 2024
- 2024Exploring Phrase-Level Grounding with Text-to-Image Diffusion Model7 Jul 2024
- 2024LOVA3: Learning to Visual Question Answering, Asking and Assessment23 May 2024
- 2024ViOCRVQA: Novel Benchmark Dataset and Vision Reader for Visual Question Answering by Understanding Vietnamese Text in Images29 Apr 2024
- 2024Variational Multi-Modal Hypergraph Attention Network for Multi-Modal Relation Extraction18 Apr 2024
38 more
- 2024Intrinsic Subgraph Generation for Interpretable Graph based Visual Question Answering26 Mar 2024
- 2023To See is to Believe: Prompting GPT-4V for Better Visual Instruction Tuning13 Nov 2023
- 2023From Image to Language: A Critical Analysis of Visual Question Answering (VQA) Approaches, Challenges, and Opportunities1 Nov 2023
- 2023Semi-Supervised Panoptic Narrative Grounding27 Oct 2023
- 2023Superpixel Semantics Representation and Pre-training for Vision-Language Task20 Oct 2023
- 2023Multi-Modal Knowledge Graph Transformer Framework for Multi-Modal Entity Alignment10 Oct 2023
- 2023Artificial-Spiking Hierarchical Networks for Vision-Language Representation Learning18 Aug 2023
- 2023Diagnosing Human-object Interaction Detectors16 Aug 2023
- 2023Answer Mining from a Pool of Images: Towards Retrieval-Based Visual Question Answering29 Jun 2023
- 2023Dual-Gated Fusion with Prefix-Tuning for Multi-Modal Relation Extraction19 Jun 2023
- 2023A Comprehensive Survey on Applications of Transformers for Deep Learning Tasks11 Jun 2023
- 2023Attention-Based Methods For Audio Question Answering31 May 2023
- 2023Generate then Select: Open-ended Visual Question Answering Guided by World Knowledge30 May 2023
- 2023Dynamic Clue Bottlenecks: Towards Interpretable-by-Design Visual Question Answering24 May 2023
- 2023VQA with Cascade of Self- and Co-Attention Blocks28 Feb 2023
- 2023Interpretable Medical Image Visual Question Answering via Multi-Modal Relationship Graph Learning19 Feb 2023
- 2023Bridge Damage Cause Estimation Using Multiple Images Based on Visual Question Answering18 Feb 2023
- 2023Multi-modal Machine Learning in Engineering Design: A Review and Future Directions14 Feb 2023
- 2023Learning to Agree on Vision Attention for Visual Commonsense Reasoning4 Feb 2023
- 2023HRVQA: A Visual Question Answering Benchmark for High-Resolution Aerial Images23 Jan 2023
- 2022AlignVE: Visual Entailment Recognition Based on Alignment Relations16 Nov 2022
- 2022LVP-M3: Language-aware Visual Prompt for Multilingual Multimodal Machine Translation19 Oct 2022
- 2022Vision-Language Pre-training: Basics, Recent Advances, and Future Trends17 Oct 2022
- 2022Vision+X: A Survey on Multimodal Learning in the Light of Data5 Oct 2022
- 2022Towards Explainable 3D Grounded Visual Question Answering: A New Benchmark and Strong Baseline24 Sep 2022
- 2022Understanding Attention for Vision-and-Language Tasks17 Aug 2022
- 2022CLEVR-Math: A Dataset for Compositional Language, Visual and Mathematical Reasoning10 Aug 2022
- 2022DoRO: Disambiguation of referred object for embodied agents28 Jul 2022
- 2022Is GPT-3 all you need for Visual Question Answering in Cultural Heritage?25 Jul 2022
- 2022Interpretable by Design: Learning Predictors by Composing Interpretable Queries3 Jul 2022
- 2022From Pixels to Objects: Cubic Visual Attention for Visual Question Answering4 Jun 2022
- 2022From Easy to Hard: Learning Language-guided Curriculum for Visual Question Answering on Remote Sensing Data6 May 2022
- 2022CLEVR-X: A Visual Reasoning Dataset for Natural Language Explanations5 Apr 2022
- 2022Vision-Language Intelligence: Tasks, Representation Learning, and Large Models3 Mar 2022
- 2022Recent, rapid advancement in visual question answering architecture: a review2 Mar 2022
- 2022GAMMA Challenge:Glaucoma grAding from Multi-Modality imAges14 Feb 2022
- 2021ProTo: Program-Guided Transformer for Program-Guided Tasks2 Oct 2021
- 2021Asking questions on handwritten document collections2 Oct 2021
50 newest of 64 All 64 (JSON)
- 2022Vision-Language Pre-training: Basics, Recent Advances, and Future Trendscited by 117
- 2024Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Surveycited by 76
- 2023Dynamic Clue Bottlenecks: Towards Interpretable-by-Design Visual Question Answeringcited by 2
- 2025Light as Deception: GPT-driven Natural Relighting Against Vision-Language Pre-training Modelscited by 1
- 2026How Good LLMs Are at Answering Bangla Medical Visual Questions? Dataset and Benchmarkingcited by 0
- 2026How Good LLMs Are at Answering Bangla Medical Visual Questions? Dataset and Benchmarking18 May 2026
- 2025Light as Deception: GPT-driven Natural Relighting Against Vision-Language Pre-training Models30 May 2025
- 2024Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Survey26 Nov 2024
- 2023Dynamic Clue Bottlenecks: Towards Interpretable-by-Design Visual Question Answering24 May 2023
- 2022Vision-Language Pre-training: Basics, Recent Advances, and Future Trends17 Oct 2022
- 2023To See is to Believe: Prompting GPT-4V for Better Visual Instruction Tuningcited by 144
- 2023A Comprehensive Survey on Applications of Transformers for Deep Learning Taskscited by 71
- 2021Attention, please! A survey of Neural Attention Models in Deep Learningcited by 51
- 2022GAMMA Challenge:Glaucoma grAding from Multi-Modality imAgescited by 46
- 2021N24News: A New Dataset for Multimodal News Classificationcited by 40
- 2022From Easy to Hard: Learning Language-guided Curriculum for Visual Question Answering on Remote Sensing Datacited by 39
- 2022Vision-Language Intelligence: Tasks, Representation Learning, and Large Modelscited by 28
- 2022Interpretable by Design: Learning Predictors by Composing Interpretable Queriescited by 28
- 2023Multi-modal Machine Learning in Engineering Design: A Review and Future Directionscited by 27
- 2022Towards Explainable 3D Grounded Visual Question Answering: A New Benchmark and Strong Baselinecited by 25
- 2023From Image to Language: A Critical Analysis of Visual Question Answering (VQA) Approaches, Challenges, and Opportunitiescited by 25
- 2022Vision+X: A Survey on Multimodal Learning in the Light of Datacited by 22
12 most cited of 55 All 55 (JSON)
- 2026Disentanglement-Based Equivariant Learning for Compositional VQA1 Jun 2026
- 2025DepthFocus: Controllable Depth Estimation for See-Through Scenes21 Nov 2025
- 2025Vision Generalist Model: A Survey11 Jun 2025
- 2024Text-Guided Coarse-to-Fine Fusion Network for Robust Remote Sensing Visual Question Answering24 Nov 2024
- 2024A Comprehensive Survey on Visual Question Answering Datasets and Algorithms17 Nov 2024
- 2024LOVA3: Learning to Visual Question Answering, Asking and Assessment23 May 2024
- 2024ViOCRVQA: Novel Benchmark Dataset and Vision Reader for Visual Question Answering by Understanding Vietnamese Text in Images29 Apr 2024
- 2024Variational Multi-Modal Hypergraph Attention Network for Multi-Modal Relation Extraction18 Apr 2024
- 2024Intrinsic Subgraph Generation for Interpretable Graph based Visual Question Answering26 Mar 2024
- 2023To See is to Believe: Prompting GPT-4V for Better Visual Instruction Tuning13 Nov 2023
- 2023From Image to Language: A Critical Analysis of Visual Question Answering (VQA) Approaches, Challenges, and Opportunities1 Nov 2023
- 2023Semi-Supervised Panoptic Narrative Grounding27 Oct 2023
12 newest of 55 All 55 (JSON)