Show, Ask, Attend, and Answer: A Strong Baseline For Visual Question Answering
Not on the map. Why?
Abstract (arXiv)
This paper presents a new baseline for visual question answering task. Given an image and a question in natural language, our model produces accurate answers according to the content of the image. Our model, while being architecturally simple and relatively small in terms of trainable parameters, sets a new state of the art on both unbalanced and balanced VQA benchmark. On VQA 1.0 open ended challenge, our model achieves 64.6% accuracy on the test-standard set without using additional data, an improvement of 0.4% over state of the art, and on newly released VQA 2.0, our model scores 59.7% on validation set outperforming best previously reported results by 0.5%. The results presented in this paper are especially interesting because very similar models have been tried before but significantly lower performance were reported. In light of the new results we hope to see more meaningful research on visual question answering in the future.
Key facts. Cited by 31 papers in the map (data through 14 Oct 2026). First posted on arXiv 11 Apr 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 6; 2023: 9; 2024: 7.
31 papers.
Sort:
By area:
- 2021InfographicVQAcited by 437
- 2022Revisiting Weakly Supervised Pre-Training of Visual Perception Modelscited by 116
- 2022MapQA: A Dataset for Question Answering on Choropleth Mapscited by 85
- 2024Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Surveycited by 76
- 2021Beyond Question-Based Biases: Assessing Multimodal Shortcut Learning in Visual Question Answeringcited by 71
- 2023Learnable Cross-modal Knowledge Distillation for Multi-modal Learning with Missing Modalitycited by 45
- 2024EDT: Improving Large Language Models' Generation by Entropy-based Dynamic Temperature Samplingcited by 45
- 2022Rethinking Attention-Model Explainability through Faithfulness Violation Testcited by 43
- 2023Multimodal Explainable Artificial Intelligence: A Comprehensive Review of Methodological Advances and Future Research Directionscited by 25
- 2023From Image to Language: A Critical Analysis of Visual Question Answering (VQA) Approaches, Challenges, and Opportunitiescited by 25
- 2023OpenViVQA: Task, Dataset, and Multimodal Fusion Models for Visual Question Answering in Vietnamesecited by 20
- 2021MuMuQA: Multimedia Multi-Hop News Question Answering via Cross-Media Knowledge Extraction and Groundingcited by 19
19 more
- 2021AdaVQA: Overcoming Language Priors with Adapted Margin Cosine Losscited by 18
- 2021Robustness through Data Augmentation Loss Consistencycited by 8
- 2024ViOCRVQA: Novel Benchmark Dataset and Vision Reader for Visual Question Answering by Understanding Vietnamese Text in Imagescited by 8
- 2022Correlation Information Bottleneck: Towards Adapting Pretrained Multimodal Models for Robust Visual Question Answeringcited by 7
- 2024AdaCM2: On Understanding Extremely Long-Term Video with Adaptive Cross-Modality Memory Reductioncited by 7
- 2022Towards Answering Open-ended Ethical Quandary Questionscited by 3
- 2023PAT: Parallel Attention Transformer for Visual Question Answering in Vietnamesecited by 3
- 2024Story Generation from Visual Inputs: Techniques, Related Tasks, and Challengescited by 3
- 2021Latent Variable Models for Visual Question Answeringcited by 2
- 2021Generating and Evaluating Explanations of Attended and Error-Inducing Input Regions for VQA Modelscited by 2
- 2021Show Why the Answer is Correct! Towards Explainable AI using Compositional Temporal Attentioncited by 2
- 2021Multi-Image Visual Question Answeringcited by 2
- 2023Medical visual question answering using joint self-supervised learningcited by 2
- 2024@Bench: Benchmarking Vision-Language Models for Human-centered Assistive Technologycited by 2
- 2022Can you even tell left from right? Presenting a new challenge for VQAcited by 0
- 2023VQA with Cascade of Self- and Co-Attention Blockscited by 0
- 2023Knowledge-Based Counterfactual Queries for Visual Question Answeringcited by 0
- 2023On the Cognition of Visual Question Answering Models and Human Intelligence: A Comparative Studycited by 0
- 2024Enhanced Textual Feature Extraction for Visual Question Answering: A Simple Convolutional Approachcited by 0
- 2024Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Survey26 Nov 2024
- 2024AdaCM2: On Understanding Extremely Long-Term Video with Adaptive Cross-Modality Memory Reduction19 Nov 2024
- 2024@Bench: Benchmarking Vision-Language Models for Human-centered Assistive Technology21 Sep 2024
- 2024Story Generation from Visual Inputs: Techniques, Related Tasks, and Challenges4 Jun 2024
- 2024Enhanced Textual Feature Extraction for Visual Question Answering: A Simple Convolutional Approach1 May 2024
- 2024ViOCRVQA: Novel Benchmark Dataset and Vision Reader for Visual Question Answering by Understanding Vietnamese Text in Images29 Apr 2024
- 2024EDT: Improving Large Language Models' Generation by Entropy-based Dynamic Temperature Sampling21 Mar 2024
- 2023From Image to Language: A Critical Analysis of Visual Question Answering (VQA) Approaches, Challenges, and Opportunities1 Nov 2023
- 2023On the Cognition of Visual Question Answering Models and Human Intelligence: A Comparative Study4 Oct 2023
- 2023Learnable Cross-modal Knowledge Distillation for Multi-modal Learning with Missing Modality2 Oct 2023
- 2023PAT: Parallel Attention Transformer for Visual Question Answering in Vietnamese17 Jul 2023
- 2023Multimodal Explainable Artificial Intelligence: A Comprehensive Review of Methodological Advances and Future Research Directions9 Jun 2023
19 more
- 2023OpenViVQA: Task, Dataset, and Multimodal Fusion Models for Visual Question Answering in Vietnamese7 May 2023
- 2023Knowledge-Based Counterfactual Queries for Visual Question Answering5 Mar 2023
- 2023VQA with Cascade of Self- and Co-Attention Blocks28 Feb 2023
- 2023Medical visual question answering using joint self-supervised learning25 Feb 2023
- 2022MapQA: A Dataset for Question Answering on Choropleth Maps15 Nov 2022
- 2022Correlation Information Bottleneck: Towards Adapting Pretrained Multimodal Models for Robust Visual Question Answering14 Sep 2022
- 2022Towards Answering Open-ended Ethical Quandary Questions12 May 2022
- 2022Can you even tell left from right? Presenting a new challenge for VQA15 Mar 2022
- 2022Rethinking Attention-Model Explainability through Faithfulness Violation Test28 Jan 2022
- 2022Revisiting Weakly Supervised Pre-Training of Visual Perception Models20 Jan 2022
- 2021Multi-Image Visual Question Answering27 Dec 2021
- 2021MuMuQA: Multimedia Multi-Hop News Question Answering via Cross-Media Knowledge Extraction and Grounding20 Dec 2021
- 2021Robustness through Data Augmentation Loss Consistency21 Oct 2021
- 2021Show Why the Answer is Correct! Towards Explainable AI using Compositional Temporal Attention15 May 2021
- 2021AdaVQA: Overcoming Language Priors with Adapted Margin Cosine Loss5 May 2021
- 2021InfographicVQA26 Apr 2021
- 2021Beyond Question-Based Biases: Assessing Multimodal Shortcut Learning in Visual Question Answering7 Apr 2021
- 2021Generating and Evaluating Explanations of Attended and Error-Inducing Input Regions for VQA Models26 Mar 2021
- 2021Latent Variable Models for Visual Question Answering16 Jan 2021
- 2024Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Surveycited by 76
- 2022Correlation Information Bottleneck: Towards Adapting Pretrained Multimodal Models for Robust Visual Question Answeringcited by 7
- 2024@Bench: Benchmarking Vision-Language Models for Human-centered Assistive Technologycited by 2
- 2024Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Survey26 Nov 2024
- 2024@Bench: Benchmarking Vision-Language Models for Human-centered Assistive Technology21 Sep 2024
- 2022Correlation Information Bottleneck: Towards Adapting Pretrained Multimodal Models for Robust Visual Question Answering14 Sep 2022
- 2021InfographicVQAcited by 437
- 2022Revisiting Weakly Supervised Pre-Training of Visual Perception Modelscited by 116
- 2022MapQA: A Dataset for Question Answering on Choropleth Mapscited by 85
- 2021Beyond Question-Based Biases: Assessing Multimodal Shortcut Learning in Visual Question Answeringcited by 71
- 2024EDT: Improving Large Language Models' Generation by Entropy-based Dynamic Temperature Samplingcited by 45
- 2022Rethinking Attention-Model Explainability through Faithfulness Violation Testcited by 43
- 2023Multimodal Explainable Artificial Intelligence: A Comprehensive Review of Methodological Advances and Future Research Directionscited by 25
- 2023From Image to Language: A Critical Analysis of Visual Question Answering (VQA) Approaches, Challenges, and Opportunitiescited by 25
- 2023OpenViVQA: Task, Dataset, and Multimodal Fusion Models for Visual Question Answering in Vietnamesecited by 20
- 2021MuMuQA: Multimedia Multi-Hop News Question Answering via Cross-Media Knowledge Extraction and Groundingcited by 19
- 2021AdaVQA: Overcoming Language Priors with Adapted Margin Cosine Losscited by 18
- 2021Robustness through Data Augmentation Loss Consistencycited by 8
12 most cited of 27 All 27 (JSON)
- 2024AdaCM2: On Understanding Extremely Long-Term Video with Adaptive Cross-Modality Memory Reduction19 Nov 2024
- 2024Story Generation from Visual Inputs: Techniques, Related Tasks, and Challenges4 Jun 2024
- 2024Enhanced Textual Feature Extraction for Visual Question Answering: A Simple Convolutional Approach1 May 2024
- 2024ViOCRVQA: Novel Benchmark Dataset and Vision Reader for Visual Question Answering by Understanding Vietnamese Text in Images29 Apr 2024
- 2024EDT: Improving Large Language Models' Generation by Entropy-based Dynamic Temperature Sampling21 Mar 2024
- 2023From Image to Language: A Critical Analysis of Visual Question Answering (VQA) Approaches, Challenges, and Opportunities1 Nov 2023
- 2023On the Cognition of Visual Question Answering Models and Human Intelligence: A Comparative Study4 Oct 2023
- 2023PAT: Parallel Attention Transformer for Visual Question Answering in Vietnamese17 Jul 2023
- 2023Multimodal Explainable Artificial Intelligence: A Comprehensive Review of Methodological Advances and Future Research Directions9 Jun 2023
- 2023OpenViVQA: Task, Dataset, and Multimodal Fusion Models for Visual Question Answering in Vietnamese7 May 2023
- 2023Knowledge-Based Counterfactual Queries for Visual Question Answering5 Mar 2023
- 2023VQA with Cascade of Self- and Co-Attention Blocks28 Feb 2023
12 newest of 27 All 27 (JSON)