mlsanityData to 14 Oct 2026

Sports-QA: A Large-Scale Video Question Answering Benchmark for Complex and Professional Sports

arXiv 2401.01505 ↗First posted 3 Jan 2024cs.CVcited by 41

Not on the map. Why?

Abstract (arXiv)

Reasoning over sports videos for question answering is an important task with numerous applications, such as player training and information retrieval. However, this task has not been explored due to the lack of relevant datasets and the challenging nature it presents. Most datasets for video question answering (VideoQA) focus mainly on general and coarse-grained understanding of daily-life videos, which is not applicable to sports scenarios requiring professional action understanding and fine-grained motion analysis. In this paper, we introduce the first dataset, named Sports-QA, specifically designed for the sports VideoQA task. The Sports-QA dataset includes various types of questions, such as descriptions, chronologies, causalities, and counterfactual conditions, covering multiple sports. Furthermore, to address the characteristics of the sports VideoQA task, we propose a new Auto-Focus Transformer (AFT) capable of automatically focusing on particular scales of temporal information for question answering. We conduct extensive experiments on Sports-QA, including baseline studies and the evaluation of different methods. The results demonstrate that our AFT achieves state-of-the-art performance.

Key facts. Cited by 41 papers in the map (data through 14 Oct 2026). Builds on 47 of its 65 references that are in the map. First posted on arXiv 3 Jan 2024.

Builds on

47 of 65 references.

References · 47

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  4. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  5. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  6. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  7. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
  8. 2017Mask R-CNNcited by 7,277
  9. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
  10. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
  11. 2015VQA: Visual Question Answeringcited by 2,506
  12. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,181
35 more
  1. 2021NExT-QA:Next Phase of Question-Answering to Explaining Temporal Actionscited by 744
  2. 2019ActivityNet-QA: A Dataset for Understanding Complex Web Videos via Question Answeringcited by 561
  3. 2017TGIF-QA: Toward Spatio-Temporal Reasoning in Visual Question Answeringcited by 378
  4. 2023Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understandingcited by 371
  5. 2023LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignmentcited by 370
  6. 2021MERLOT: Multimodal Neural Script Knowledge Modelscited by 311
  7. 2015MovieQA: Understanding Stories in Movies through Question-Answeringcited by 304
  8. 2020Just Ask: Learning to Answer Questions from Millions of Narrated Videoscited by 248
  9. 2020FineGym: A Hierarchical Video Dataset for Fine-grained Action Understandingcited by 234
  10. 2017Challenges in Data-to-Document Generationcited by 226
  11. 2021VIOLET : End-to-End Video-Language Transformers with Masked Visual-token Modelingcited by 188
  12. 2022All in One: Exploring Unified Video-Language Pre-trainingcited by 171
  13. 2018SoccerNet: A Scalable Dataset for Action Spotting in Soccer Videoscited by 150
  14. 2019Heterogeneous Memory Enhanced Multimodal Attention Model for Video Question Answeringcited by 146
  15. 2020SoccerNet-v2: A Dataset and Benchmarks for Holistic Understanding of Broadcast Soccer Videoscited by 131
  16. 2018Motion-Appearance Co-Memory Networks for Video Question Answeringcited by 95
  17. 2021MultiSports: A Multi-Person Video Dataset of Spatio-Temporally Localized Sports Actionscited by 84
  18. 2020Uncertainty-aware Score Distribution Learning for Action Quality Assessmentcited by 80
  19. 2018Action Quality Assessment Across Multiple Actionscited by 79
  20. 2021Video as Conditional Graph Hierarchy for Multi-Granular Question Answeringcited by 68
  21. 2022Invariant Grounding for Video Question Answeringcited by 68
  22. 2019BLOCK: Bilinear Superdiagonal Fusion for Visual Question Answering and Visual Relationship Detectioncited by 62
  23. 2021FineAction: A Fine-Grained Video Dataset for Temporal Action Localizationcited by 61
  24. 2022Cross-Modal Causal Relational Reasoning for Event-Level Visual Question Answeringcited by 57
  25. 2021GroupFormer: Group Activity Recognition with Clustered Spatial-Temporal Transformercited by 54
  26. 2019KnowIT VQA: Answering Knowledge-Based Questions about Videoscited by 53
  27. 2020DramaQA: Character-Centered Video Story Understanding with Hierarchical QAcited by 45
  28. 2021Spatio-Temporal Dynamic Inference Network for Group Activity Recognitioncited by 42
  29. 2023Contrastive Video Question Answering via Video Graph Transformercited by 32
  30. 2022Learning to Answer Visual Questions from Web Videoscited by 30
  31. 2021Attend What You Need: Motion-Appearance Synergistic Networks for Video Question Answeringcited by 26
  32. 2021ShuttleNet: Position-aware Fusion of Rally Progress and Player Styles for Stroke Forecasting in Badmintoncited by 21
  33. 2021Contrastive Learning for Sports Video: Unsupervised Player Classificationcited by 17
  34. 2022FenceNet: Fine-grained Footwork Recognition in Fencingcited by 12
  35. 2022Compressing CNN Kernels for Videos Using Tucker Decompositions: Towards Lightweight CNN Applicationscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 10; 2025: 20; 2026: 11.

41 papers.

Sort:

By area:

  1. 2025Eagle 2.5: Boosting Long-Context Post-Training for Frontier Vision-Language Modelscited by 64
  2. 2024MMWorld: Towards Multi-discipline Multi-faceted World Model Evaluation in Videoscited by 43
  3. 2024SPORTU: A Comprehensive Sports Understanding Benchmark for Multimodal Large Language Modelscited by 24
  4. 2024X-VARS: Introducing Explainability in Football Refereeing with Multi-Modal Large Language Modelcited by 22
  5. 2024Towards Universal Soccer Video Understandingcited by 21
  6. 2025Multi-Agent System for Comprehensive Soccer Understandingcited by 18
  7. 2024VideoICL: Confidence-based Iterative In-context Learning for Out-of-Distribution Video Understandingcited by 17
  8. 2025SportR: A Benchmark for Multimodal Large Language Model Reasoning in Sportscited by 17
  9. 2025Video Action Differencingcited by 14
  10. 2024Language and Multimodal Models in Sports: A Survey of Datasets and Applicationscited by 10
  11. 2025SoccerMaster: A Vision Foundation Model for Soccer Understandingcited by 10
  12. 2025Aurelia: Test-time Reasoning Distillation in Audio-Visual LLMscited by 9
29 more
  1. 2025Recurrent Attention-based Token Selection for Efficient Streaming Video-LLMscited by 9
  2. 2025SoccerChat: Integrating Multimodal Data for Enhanced Soccer Game Understandingcited by 8
  3. 2024When Reasoning Meets Information Aggregation: A Case Study with Sports Narrativescited by 7
  4. 2025Domain Adaptation of VLM for Soccer Video Understandingcited by 7
  5. 2024Sports Intelligence: Assessing the Sports Understanding Capabilities of Language Models through Question Answering from Text to Videocited by 6
  6. 2025FSBench: A Figure Skating Benchmark for Advancing Artistic Sports Understandingcited by 6
  7. 2025FineQuest: Adaptive Knowledge-Assisted Sports Video Understanding via Agent-of-Thoughts Reasoningcited by 5
  8. 2025DeepSport: A Multimodal Large Language Model for Comprehensive Sports Video Reasoning via Agentic Reinforcement Learningcited by 5
  9. 2025The Quest for Visual Understanding: A Journey Through the Evolution of Visual Question Answeringcited by 3
  10. 2025SV3.3B: A Sports Video Understanding Model for Action Recognitioncited by 3
  11. 2025TennisTV: Do Multimodal Large Language Models Understand Tennis Rallies?cited by 3
  12. 2025Let's Play Across Cultures: A Large Multilingual, Multicultural Benchmark for Assessing Language Models' Understanding of Sportscited by 3
  13. 2026SONIC-O1: A Real-World Benchmark for Evaluating Multimodal Large Language Models on Audio-Video Understandingcited by 3
  14. 2025DocVideoQA: Towards Comprehensive Understanding of Document-Centric Videos through Question Answeringcited by 2
  15. 2025Shot2Tactic-Caption: Multi-Scale Captioning of Badminton Videos for Tactical Understandingcited by 2
  16. 2026CL-VISTA: Benchmarking Continual Learning in Video Large Language Modelscited by 2
  17. 2026WorldCupArena: Fine-Grained Evaluation of Language Models and Deep-Research Agents on Football Forecastingcited by 2
  18. 2025Bridging the Gap Between Multimodal Foundation Models and World Modelscited by 1
  19. 2025COACH: Collaborative Agents for Contextual Highlighting -- A Multi-Agent Framework for Sports Video Analysiscited by 1
  20. 2026RefereeBench: Are Video MLLMs Ready to be Multi-Sport Refereescited by 1
  21. 2026Towards Temporal Compositional Reasoning in Long-Form Sports Videoscited by 1
  22. 2026Beyond the Single Camera: Agentic Multi-View Reasoning in Sports Video Understandingcited by 1
  23. 2026Towards Comprehensive Basketball Understandingcited by 1
  24. 2024Multimodal Language Models for Domain-Specific Procedural Video Summarizationcited by 0
  25. 2024QTG-VQA: Question-Type-Guided Architectural for VideoQA Systemscited by 0
  26. 2026SoccerRef-Agents: Multi-Agent System for Automated Soccer Refereeingcited by 0
  27. 2026Counterfactual Reasoning for Fine-Grained Evidence Disentanglement in VideoQAcited by 0
  28. 2026KeepLoRA++: Continual Learning with Layer-Scaled Residual Gradient Adaptationcited by 0
  29. 2026A Survey of Large Models in Sportscited by 0