mlsanityData to 14 Oct 2026

Recent Advances in Video Question Answering: A Review of Datasets and Methods

arXiv 2101.05954 ↗First posted 15 Jan 2021cs.CVcited by 12

Not on the map. Why?

Abstract (arXiv)

Video Question Answering (VQA) is a recent emerging challenging task in the field of Computer Vision. Several visual information retrieval techniques like Video Captioning/Description and Video-guided Machine Translation have preceded the task of VQA. VQA helps to retrieve temporal and spatial information from the video scenes and interpret it. In this survey, we review a number of methods and datasets for the task of VQA. To the best of our knowledge, no previous survey has been conducted for the VQA task.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 24 of its 52 references that are in the map. First posted on arXiv 15 Jan 2021.

Builds on

24 of 52 references.

References · 24

  1. 2019ActivityNet-QA: A Dataset for Understanding Complex Web Videos via Question Answeringcited by 561
  2. 2018TVQA: Localized, Compositional Video Question Answeringcited by 467
  3. 2017TGIF-QA: Toward Spatio-Temporal Reasoning in Visual Question Answeringcited by 378
  4. 2015MovieQA: Understanding Stories in Movies through Question-Answeringcited by 304
  5. 2015A Dataset for Movie Descriptioncited by 195
  6. 2020Hierarchical Conditional Relation Networks for Video Question Answeringcited by 163
  7. 2019TVQA+: Spatio-Temporal Grounding for Video Question Answeringcited by 154
  8. 2019Heterogeneous Memory Enhanced Multimodal Attention Model for Video Question Answeringcited by 146
  9. 2016TGIF: A New Dataset and Benchmark on Animated GIF Descriptioncited by 124
  10. 2018Motion-Appearance Co-Memory Networks for Video Question Answeringcited by 95
  11. 2020Location-aware Graph Convolutional Networks for Video Question Answeringcited by 80
  12. 2017DeepStory: Video Story QA by Deep Embedded Memory Networkscited by 68
12 more
  1. 2016End-to-end Concept Word Detection for Video Captioning, Retrieval, and Question Answeringcited by 60
  2. 2016Leveraging Video Descriptions to Learn Video Question Answeringcited by 55
  3. 2019KnowIT VQA: Answering Knowledge-Based Questions about Videoscited by 53
  4. 2020DramaQA: Character-Centered Video Story Understanding with Hierarchical QAcited by 45
  5. 2016MarioQA: Answering Questions by Watching Gameplay Videoscited by 42
  6. 2016A dataset and exploration of models for understanding video data through fill-in-the-blank question-answeringcited by 41
  7. 2017Video Question Answering via Attribute-Augmented Attention Network Learningcited by 39
  8. 2019Progressive Attention Memory Network for Movie Story Question Answeringcited by 21
  9. 2018Multimodal Dual Attention Memory for Video Story Question Answeringcited by 20
  10. 2018Audio Visual Scene-Aware Dialog (AVSD) Challenge at DSTC7cited by 9
  11. 2013Joint Video and Text Parsing for Understanding Events and Answering Queriescited by 8
  12. 2019Learning Question-Guided Video Representation for Multi-Turn Video Question Answeringcited by 3

Built on by

Cited by year

Citing papers per year: 2021: 1; 2022: 4; 2023: 1; 2024: 5; 2025: 1.

12 papers.

  1. 2022Socratic Models: Composing Zero-Shot Multimodal Reasoning with Languagecited by 513
  2. 2022Clotho-AQA: A Crowdsourced Dataset for Audio Question Answeringcited by 85
  3. 2022Video Question Answering: Datasets, Algorithms and Challengescited by 84
  4. 2024Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Surveycited by 76
  5. 2022Locate before Answering: Answer Guided Question Localization for Video Question Answeringcited by 19
  6. 2024End-to-End Video Question Answering with Frame Scoring Mechanisms and Adaptive Samplingcited by 19
  7. 2023Learning Situation Hyper-Graphs for Video Question Answeringcited by 16
  8. 2024M2-RAAP: A Multi-Modal Recipe for Advancing Adaptation-based Pre-training towards Effective and Efficient Zero-shot Video-text Retrievalcited by 5
  9. 2021CogME: A Cognition-Inspired Multi-Dimensional Evaluation Metric for Story Understandingcited by 1
  10. 2024Ranking Distillation for Open-Ended Video Question Answering with Insufficient Labelscited by 1
  11. 2024Audiopedia: Audio QA with Knowledgecited by 1
  12. 2025Beyond Isolated Facts: Synthesizing Narrative and Grounded Supervision for VideoQAcited by 1