Simple Baseline for Visual Question Answering
Not on the map. Why?
Abstract (arXiv)
We describe a very simple bag-of-words baseline for visual question answering. This baseline concatenates the word features from the question and CNN features from the image to predict the answer. When evaluated on the challenging VQA dataset [2], it shows comparable performance to many recent approaches using recurrent neural networks. To explore the strength and weakness of the trained model, we also provide an interactive web demo and open-source code. .
Key facts. Cited by 24 papers in the map (data through 14 Oct 2026). First posted on arXiv 7 Dec 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 8; 2023: 6; 2024: 3.
24 papers.
Sort:
By area:
- 2022Clotho-AQA: A Crowdsourced Dataset for Audio Question Answeringcited by 85
- 2024Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Surveycited by 76
- 2021Mind Your Outliers! Investigating the Negative Impact of Outliers on Active Learning for Visual Question Answeringcited by 62
- 2022SwapMix: Diagnosing and Regularizing the Over-Reliance on Visual Context in Visual Question Answeringcited by 38
- 2022Towards Explainable 3D Grounded Visual Question Answering: A New Benchmark and Strong Baselinecited by 25
- 2023From Image to Language: A Critical Analysis of Visual Question Answering (VQA) Approaches, Challenges, and Opportunitiescited by 25
- 2021ProTo: Program-Guided Transformer for Program-Guided Taskscited by 21
- 2024LOVA3: Learning to Visual Question Answering, Asking and Assessmentcited by 21
- 2021VQA-Aid: Visual Question Answering for Post-Disaster Damage Assessment and Analysiscited by 15
- 2022VQA and Visual Reasoning: An Overview of Recent Datasets, Methods and Challengescited by 14
- 2024Exploring Phrase-Level Grounding with Text-to-Image Diffusion Modelcited by 13
- 2022Experimental Standards for Deep Learning in Natural Language Processing Researchcited by 10
12 more
- 2021MuVAM: A Multi-View Attention-based Model for Medical Visual Question Answeringcited by 4
- 2023EAML: Ensemble Self-Attention-based Mutual Learning Network for Document Image Classificationcited by 4
- 2023Semi-Supervised Panoptic Narrative Groundingcited by 4
- 2021Show Why the Answer is Correct! Towards Explainable AI using Compositional Temporal Attentioncited by 2
- 2022MGA-VQA: Multi-Granularity Alignment for Visual Question Answeringcited by 2
- 2021A Better Loss for Visual-Textual Groundingcited by 1
- 2022Bilaterally Slimmable Transformer for Elastic and Efficient Visual Question Answeringcited by 1
- 2023BinaryVQA: A Versatile Test Set to Evaluate the Out-of-Distribution Generalization of VQA Modelscited by 1
- 2023Dynamic Task and Weight Prioritization Curriculum Learning for Multimodal Imagerycited by 1
- 2021Will Multi-modal Data Improves Few-shot Learning?cited by 0
- 2022Deep Neural Networks for Visual Reasoningcited by 0
- 2023Bridge Damage Cause Estimation Using Multiple Images Based on Visual Question Answeringcited by 0
- 2024Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Survey26 Nov 2024
- 2024Exploring Phrase-Level Grounding with Text-to-Image Diffusion Model7 Jul 2024
- 2024LOVA3: Learning to Visual Question Answering, Asking and Assessment23 May 2024
- 2023From Image to Language: A Critical Analysis of Visual Question Answering (VQA) Approaches, Challenges, and Opportunities1 Nov 2023
- 2023Dynamic Task and Weight Prioritization Curriculum Learning for Multimodal Imagery29 Oct 2023
- 2023Semi-Supervised Panoptic Narrative Grounding27 Oct 2023
- 2023EAML: Ensemble Self-Attention-based Mutual Learning Network for Document Image Classification11 May 2023
- 2023Bridge Damage Cause Estimation Using Multiple Images Based on Visual Question Answering18 Feb 2023
- 2023BinaryVQA: A Versatile Test Set to Evaluate the Out-of-Distribution Generalization of VQA Models28 Jan 2023
- 2022VQA and Visual Reasoning: An Overview of Recent Datasets, Methods and Challenges26 Dec 2022
- 2022Towards Explainable 3D Grounded Visual Question Answering: A New Benchmark and Strong Baseline24 Sep 2022
- 2022Deep Neural Networks for Visual Reasoning24 Sep 2022
12 more
- 2022Clotho-AQA: A Crowdsourced Dataset for Audio Question Answering20 Apr 2022
- 2022Experimental Standards for Deep Learning in Natural Language Processing Research13 Apr 2022
- 2022SwapMix: Diagnosing and Regularizing the Over-Reliance on Visual Context in Visual Question Answering5 Apr 2022
- 2022Bilaterally Slimmable Transformer for Elastic and Efficient Visual Question Answering24 Mar 2022
- 2022MGA-VQA: Multi-Granularity Alignment for Visual Question Answering25 Jan 2022
- 2021ProTo: Program-Guided Transformer for Program-Guided Tasks2 Oct 2021
- 2021A Better Loss for Visual-Textual Grounding11 Aug 2021
- 2021Will Multi-modal Data Improves Few-shot Learning?25 Jul 2021
- 2021MuVAM: A Multi-View Attention-based Model for Medical Visual Question Answering7 Jul 2021
- 2021Mind Your Outliers! Investigating the Negative Impact of Outliers on Active Learning for Visual Question Answering6 Jul 2021
- 2021VQA-Aid: Visual Question Answering for Post-Disaster Damage Assessment and Analysis19 Jun 2021
- 2021Show Why the Answer is Correct! Towards Explainable AI using Compositional Temporal Attention15 May 2021
- 2022Clotho-AQA: A Crowdsourced Dataset for Audio Question Answeringcited by 85
- 2021Mind Your Outliers! Investigating the Negative Impact of Outliers on Active Learning for Visual Question Answeringcited by 62
- 2022SwapMix: Diagnosing and Regularizing the Over-Reliance on Visual Context in Visual Question Answeringcited by 38
- 2022Towards Explainable 3D Grounded Visual Question Answering: A New Benchmark and Strong Baselinecited by 25
- 2023From Image to Language: A Critical Analysis of Visual Question Answering (VQA) Approaches, Challenges, and Opportunitiescited by 25
- 2021ProTo: Program-Guided Transformer for Program-Guided Taskscited by 21
- 2024LOVA3: Learning to Visual Question Answering, Asking and Assessmentcited by 21
- 2021VQA-Aid: Visual Question Answering for Post-Disaster Damage Assessment and Analysiscited by 15
- 2022Experimental Standards for Deep Learning in Natural Language Processing Researchcited by 10
- 2021MuVAM: A Multi-View Attention-based Model for Medical Visual Question Answeringcited by 4
- 2023EAML: Ensemble Self-Attention-based Mutual Learning Network for Document Image Classificationcited by 4
- 2023Semi-Supervised Panoptic Narrative Groundingcited by 4
12 most cited of 20 All 20 (JSON)
- 2024LOVA3: Learning to Visual Question Answering, Asking and Assessment23 May 2024
- 2023From Image to Language: A Critical Analysis of Visual Question Answering (VQA) Approaches, Challenges, and Opportunities1 Nov 2023
- 2023Dynamic Task and Weight Prioritization Curriculum Learning for Multimodal Imagery29 Oct 2023
- 2023Semi-Supervised Panoptic Narrative Grounding27 Oct 2023
- 2023EAML: Ensemble Self-Attention-based Mutual Learning Network for Document Image Classification11 May 2023
- 2023Bridge Damage Cause Estimation Using Multiple Images Based on Visual Question Answering18 Feb 2023
- 2023BinaryVQA: A Versatile Test Set to Evaluate the Out-of-Distribution Generalization of VQA Models28 Jan 2023
- 2022Towards Explainable 3D Grounded Visual Question Answering: A New Benchmark and Strong Baseline24 Sep 2022
- 2022Clotho-AQA: A Crowdsourced Dataset for Audio Question Answering20 Apr 2022
- 2022Experimental Standards for Deep Learning in Natural Language Processing Research13 Apr 2022
- 2022SwapMix: Diagnosing and Regularizing the Over-Reliance on Visual Context in Visual Question Answering5 Apr 2022
- 2022Bilaterally Slimmable Transformer for Elastic and Efficient Visual Question Answering24 Mar 2022
12 newest of 20 All 20 (JSON)