Visual Question Answering: A Survey on Techniques and Common Trends in Recent Literature
Not on the map. Why?
Abstract (arXiv)
Visual Question Answering (VQA) is an emerging area of interest for researches, being a recent problem in natural language processing and image prediction. In this area, an algorithm needs to answer questions about certain images. As of the writing of this survey, 25 recent studies were analyzed. Besides, 6 datasets were analyzed and provided their link to download. In this work, several recent pieces of research in this area were investigated and a deeper analysis and comparison among them were provided, including results, the state-of-the-art, common errors, and possible points of improvement for future researchers.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 74 of its 107 references that are in the map. First posted on arXiv 18 May 2023.
Builds on
74 of 107 references.
References · 74
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
38 more
- 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
- 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,498
- 2015VQA: Visual Question Answeringcited by 2,489
- 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,027
- 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
- 2019Towards VQA Models That Can Readcited by 1,696
- 2016Enriching Word Vectors with Subword Informationcited by 1,578
- 2019LXMERT: Learning Cross-Modality Encoder Representations from Transformerscited by 1,548
- 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,445
- 2017Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answeringcited by 1,310
- 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,114
- 2021MDETR -- Modulated Detection for End-to-End Multi-Modal Understandingcited by 811
- 2022PaLI: A Jointly-Scaled Multilingual Language-Image Modelcited by 762
- 2017Dynamic Routing Between Capsulescited by 689
- 2020Hopfield Networks is All You Needcited by 461
- 2021VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Expertscited by 424
- 2018DVQA: Understanding Data Visualizations via Question Answeringcited by 338
- 2019Deep Modular Co-Attention Networks for Visual Question Answeringcited by 338
- 2017Don't Just Assume; Look and Answer: Overcoming Priors for Visual Question Answeringcited by 337
- 2019Scene Text Visual Question Answeringcited by 327
- 2015Visual7W: Grounded Question Answering in Imagescited by 315
- 2017FigureQA: An Annotated Figure Dataset for Visual Reasoningcited by 314
- 2019Don't Take the Easy Way Out: Ensemble Based Methods for Avoiding Known Dataset Biasescited by 279
- 2018Bilinear Attention Networkscited by 277
- 2020Counterfactual VQA: A Cause-Effect Look at Language Biascited by 266
- 2016FVQA: Fact-based Visual Question Answeringcited by 181
- 2019Learning by Abstraction: The Neural State Machinecited by 113
- 2016Human Attention in Visual Question Answering: Do Humans and Deep Networks Look at the Same Regions?cited by 111
- 2019Iterative Answer Prediction with Pointer-Augmented Multimodal Transformers for TextVQAcited by 107
- 2020TAP: Text-Aware Pre-training for Text-VQA and Text-Captioncited by 95
- 2017Tips and Tricks for Visual Question Answering: Learnings from the 2017 Challengecited by 76
- 2021LaTr: Layout-Aware Transformer for Scene-Text VQAcited by 72
- 2020Bringing Light Into the Dark: A Large-scale Evaluation of Knowledge Graph Embedding Models Under a Unified Frameworkcited by 70
- 2019Rosetta: Large scale system for text detection and recognition in imagescited by 69
- 2020Roses Are Red, Violets Are Blue... but Should Vqa Expect Them To?cited by 69
- 2020MUTANT: A Training Paradigm for Out-of-Distribution Generalization in Visual Question Answeringcited by 63
- 2017BPEmb: Tokenization-free Pre-trained Subword Embeddings in 275 Languagescited by 52
- 2020Overcoming Language Priors with Self-supervised Learning for Visual Question Answeringcited by 43
50 most cited of 74 All 74 (JSON)
Built on by
Citing papers per year: 2023: 3; 2024: 11; 2025: 5; 2026: 1.
20 papers.
Sort:
By area:
- 2024Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Surveycited by 74
- 2024Med-MoE: Mixture of Domain-Specific Experts for Lightweight Medical Vision-Language Modelscited by 43
- 2024A Survey on Generative AI and LLM for Video Generation, Understanding, and Streamingcited by 37
- 2024Unveiling Visual Perception in Language Models: An Attention Head Analysis Approachcited by 34
- 2025CAFe: Unifying Representation and Generation with Contrastive-Autoregressive Finetuningcited by 31
- 2023Robust Visual Question Answering: Datasets, Methods, and Future Challengescited by 23
- 2023Multimodality of AI for Education: Towards Artificial General Intelligencecited by 21
- 2024Joint Visual and Text Prompting for Improved Object-Centric Perception with Multimodal Large Language Modelscited by 16
- 2024Knowledge-Aware Reasoning over Multimodal Semi-structured Tablescited by 9
- 2024Navigating the Landscape of Hint Generation Research: From the Past to the Futurecited by 6
- 2024ECOR: Explainable CLIP for Object Recognitioncited by 4
- 2024Can Visual Language Models Replace OCR-Based Visual Question Answering Pipelines in Production? A Case Study in Retailcited by 4
8 more
- 2024VolDoGer: LLM-assisted Datasets for Domain Generalization in Vision-Language Taskscited by 3
- 2025Watch Out Your Album! On the Inadvertent Privacy Memorization in Multi-Modal Large Language Modelscited by 3
- 2025CrafText Benchmark: Advancing Instruction Following in Complex Multimodal Open-Ended Worldcited by 2
- 2026TechING: Towards Real World Technical Image Understanding via VLMscited by 2
- 2024SparrowVQE: Visual Question Explanation for Course Content Understandingcited by 1
- 2023Superpixel Semantics Representation and Pre-training for Vision-Language Taskcited by 0
- 2025Robusto-1 Dataset: Comparing Humans and VLMs on real out-of-distribution Autonomous Driving VQA from Perucited by 0
- 2025GC-KBVQA: A New Four-Stage Framework for Enhancing Knowledge Based Visual Question Answering Performancecited by 0
- 2026TechING: Towards Real World Technical Image Understanding via VLMs26 Jan 2026
- 2025GC-KBVQA: A New Four-Stage Framework for Enhancing Knowledge Based Visual Question Answering Performance25 May 2025
- 2025CrafText Benchmark: Advancing Instruction Following in Complex Multimodal Open-Ended World17 May 2025
- 2025CAFe: Unifying Representation and Generation with Contrastive-Autoregressive Finetuning25 Mar 2025
- 2025Robusto-1 Dataset: Comparing Humans and VLMs on real out-of-distribution Autonomous Driving VQA from Peru10 Mar 2025
- 2025Watch Out Your Album! On the Inadvertent Privacy Memorization in Multi-Modal Large Language Models3 Mar 2025
- 2024Unveiling Visual Perception in Language Models: An Attention Head Analysis Approach24 Dec 2024
- 2024Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Survey26 Nov 2024
- 2024SparrowVQE: Visual Question Explanation for Course Content Understanding12 Nov 2024
- 2024Can Visual Language Models Replace OCR-Based Visual Question Answering Pipelines in Production? A Case Study in Retail28 Aug 2024
- 2024Knowledge-Aware Reasoning over Multimodal Semi-structured Tables25 Aug 2024
- 2024VolDoGer: LLM-assisted Datasets for Domain Generalization in Vision-Language Tasks29 Jul 2024
8 more
- 2024ECOR: Explainable CLIP for Object Recognition19 Apr 2024
- 2024Med-MoE: Mixture of Domain-Specific Experts for Lightweight Medical Vision-Language Models16 Apr 2024
- 2024Navigating the Landscape of Hint Generation Research: From the Past to the Future6 Apr 2024
- 2024Joint Visual and Text Prompting for Improved Object-Centric Perception with Multimodal Large Language Models6 Apr 2024
- 2024A Survey on Generative AI and LLM for Video Generation, Understanding, and Streaming30 Jan 2024
- 2023Multimodality of AI for Education: Towards Artificial General Intelligence10 Dec 2023
- 2023Superpixel Semantics Representation and Pre-training for Vision-Language Task20 Oct 2023
- 2023Robust Visual Question Answering: Datasets, Methods, and Future Challenges21 Jul 2023
- 2024Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Surveycited by 74
- 2024Med-MoE: Mixture of Domain-Specific Experts for Lightweight Medical Vision-Language Modelscited by 43
- 2024Unveiling Visual Perception in Language Models: An Attention Head Analysis Approachcited by 34
- 2025CAFe: Unifying Representation and Generation with Contrastive-Autoregressive Finetuningcited by 31
- 2024Joint Visual and Text Prompting for Improved Object-Centric Perception with Multimodal Large Language Modelscited by 16
- 2024ECOR: Explainable CLIP for Object Recognitioncited by 4
- 2024Can Visual Language Models Replace OCR-Based Visual Question Answering Pipelines in Production? A Case Study in Retailcited by 4
- 2025Watch Out Your Album! On the Inadvertent Privacy Memorization in Multi-Modal Large Language Modelscited by 3
- 2025CAFe: Unifying Representation and Generation with Contrastive-Autoregressive Finetuning25 Mar 2025
- 2025Watch Out Your Album! On the Inadvertent Privacy Memorization in Multi-Modal Large Language Models3 Mar 2025
- 2024Unveiling Visual Perception in Language Models: An Attention Head Analysis Approach24 Dec 2024
- 2024Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Survey26 Nov 2024
- 2024Can Visual Language Models Replace OCR-Based Visual Question Answering Pipelines in Production? A Case Study in Retail28 Aug 2024
- 2024ECOR: Explainable CLIP for Object Recognition19 Apr 2024
- 2024Med-MoE: Mixture of Domain-Specific Experts for Lightweight Medical Vision-Language Models16 Apr 2024
- 2024Joint Visual and Text Prompting for Improved Object-Centric Perception with Multimodal Large Language Models6 Apr 2024
- 2024A Survey on Generative AI and LLM for Video Generation, Understanding, and Streamingcited by 37
- 2023Robust Visual Question Answering: Datasets, Methods, and Future Challengescited by 23
- 2023Multimodality of AI for Education: Towards Artificial General Intelligencecited by 21
- 2024Knowledge-Aware Reasoning over Multimodal Semi-structured Tablescited by 9
- 2024Navigating the Landscape of Hint Generation Research: From the Past to the Futurecited by 6
- 2024VolDoGer: LLM-assisted Datasets for Domain Generalization in Vision-Language Taskscited by 3
- 2025CrafText Benchmark: Advancing Instruction Following in Complex Multimodal Open-Ended Worldcited by 2
- 2026TechING: Towards Real World Technical Image Understanding via VLMscited by 2
- 2024SparrowVQE: Visual Question Explanation for Course Content Understandingcited by 1
- 2023Superpixel Semantics Representation and Pre-training for Vision-Language Taskcited by 0
- 2025GC-KBVQA: A New Four-Stage Framework for Enhancing Knowledge Based Visual Question Answering Performancecited by 0
- 2026TechING: Towards Real World Technical Image Understanding via VLMs26 Jan 2026
- 2025GC-KBVQA: A New Four-Stage Framework for Enhancing Knowledge Based Visual Question Answering Performance25 May 2025
- 2025CrafText Benchmark: Advancing Instruction Following in Complex Multimodal Open-Ended World17 May 2025
- 2024SparrowVQE: Visual Question Explanation for Course Content Understanding12 Nov 2024
- 2024Knowledge-Aware Reasoning over Multimodal Semi-structured Tables25 Aug 2024
- 2024VolDoGer: LLM-assisted Datasets for Domain Generalization in Vision-Language Tasks29 Jul 2024
- 2024Navigating the Landscape of Hint Generation Research: From the Past to the Future6 Apr 2024
- 2024A Survey on Generative AI and LLM for Video Generation, Understanding, and Streaming30 Jan 2024
- 2023Multimodality of AI for Education: Towards Artificial General Intelligence10 Dec 2023
- 2023Superpixel Semantics Representation and Pre-training for Vision-Language Task20 Oct 2023
- 2023Robust Visual Question Answering: Datasets, Methods, and Future Challenges21 Jul 2023