mlsanityData to 7 Oct 2026

GOAL: A Challenging Knowledge-grounded Video Captioning Benchmark for Real-time Soccer Commentary Generation

arXiv 2303.14655 ↗First posted 26 Mar 2023cs.CV cs.CL cs.LGcited by 28

Not on the map. Why?

Abstract (arXiv)

Despite the recent emergence of video captioning models, how to generate vivid, fine-grained video descriptions based on the background knowledge (i.e., long and informative commentary about the domain-specific scenes with appropriate reasoning) is still far from being solved, which however has great applications such as automatic sports narrative. In this paper, we present GOAL, a benchmark of over 8.9k soccer video clips, 22k sentences, and 42k knowledge triples for proposing a challenging new task setting as Knowledge-grounded Video Captioning (KGVC). Moreover, we conduct experimental adaption of existing methods to show the difficulty and potential directions for solving this valuable and applicable task. Our data and code are available at https://github.com/THU-KEG/goal.

Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). Builds on 23 of its 46 references that are in the map. First posted on arXiv 26 Mar 2023.

Builds on

23 of 46 references.

References · 23

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2022Training language models to follow instructions with human feedbackcited by 15,712
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  6. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,027
  7. 2017Towards Automatic Learning of Procedures from Web Instructional Videoscited by 616
  8. 2021VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understandingcited by 596
  9. 2022Revisiting the "Video" in Video-Language Understandingcited by 167
  10. 2021SwinBERT: End-to-End Transformers with Sparse Attention for Video Captioningcited by 161
  11. 2015Sequence to Sequence -- Video to Textcited by 157
  12. 2021Align and Prompt: Video-and-Language Pre-training with Entity Promptscited by 149
11 more
  1. 2020SoccerNet-v2: A Dataset and Benchmarks for Holistic Understanding of Broadcast Soccer Videoscited by 129
  2. 2022End-to-end Generative Pretraining for Multimodal Video Captioningcited by 115
  3. 2020Object Relational Graph with Teacher-Recommended Learning for Video Captioningcited by 106
  4. 2021VLM: Task-agnostic Video-Language Model Pre-training for Video Understandingcited by 102
  5. 2019Central Similarity Quantization for Efficient Image and Video Retrievalcited by 77
  6. 2021Camera Calibration and Player Localization in SoccerNet-v2 and Investigation of their Representations for Action Spottingcited by 43
  7. 2021VX2TEXT: End-to-End Learning of Video-Based Text Generation From Multimodal Inputscited by 42
  8. 2020Video2Commonsense: Generating Commonsense Descriptions to Enrich Video Captioningcited by 36
  9. 2022WikiDiverse: A Multimodal Entity Linking Dataset with Diversified Contextual Topics and Entity Typescited by 33
  10. 2021Hierarchical Modular Network for Video Captioningcited by 31
  11. 2022Going for GOAL: A Resource for Grounded Football Commentariescited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 2; 2024: 7; 2025: 8; 2026: 11.

28 papers.

Sort:

By area:

  1. 2023SoccerNet-Caption: Dense Video Captioning for Soccer Broadcasts Commentariescited by 57
  2. 2024MatchTime: Towards Automatic Soccer Game Commentary Generationcited by 37
  3. 2024Towards Universal Soccer Video Understandingcited by 21
  4. 2025Multi-Agent System for Comprehensive Soccer Understandingcited by 18
  5. 2025SIV-Bench: A Video Benchmark for Social Interaction Understanding and Reasoningcited by 18
  6. 2024SoccerNet-Echoes: A Soccer Game Audio Commentary Datasetcited by 12
  7. 2023A Survey of Deep Learning in Sports Applications: Perception, Comprehension, and Decisioncited by 11
  8. 2024Language and Multimodal Models in Sports: A Survey of Datasets and Applicationscited by 10
  9. 2025SoccerMaster: A Vision Foundation Model for Soccer Understandingcited by 10
  10. 2024HOTVCOM: Generating Buzzworthy Comments for Videoscited by 7
  11. 2025Player-Centric Multimodal Prompt Generation for Large Language Model Based Identity-Aware Basketball Video Captioningcited by 7
  12. 2025From Multimodal Perception to Strategic Reasoning: A Survey on AI-Generated Game Commentarycited by 3
16 more
  1. 2024Knowledge Guided Entity-aware Video Captioning and A Basketball Benchmarkcited by 2
  2. 2025ExpStar: Towards Automatic Commentary Generation for Multi-discipline Scientific Experimentscited by 2
  3. 2025Shot2Tactic-Caption: Multi-Scale Captioning of Badminton Videos for Tactical Understandingcited by 2
  4. 2026TennisExpert: Towards Expert-Level Analytical Sports Video Understandingcited by 1
  5. 2026Towards Automatic Soccer Commentary Generation with Knowledge-Enhanced Visual Reasoningcited by 1
  6. 2026RefereeBench: Are Video MLLMs Ready to be Multi-Sport Refereescited by 1
  7. 2024PLayerTV: Advanced Player Tracking and Identification for Automatic Soccer Highlight Clipscited by 0
  8. 2025Commentary Generation for Soccer Highlightscited by 0
  9. 2026BFMD: A Full-Match Badminton Dense Dataset for Dense Shot Captioningcited by 0
  10. 2026BoxComm: Benchmarking Category-Aware Commentary Generation and Narration Rhythm in Boxingcited by 0
  11. 2026SoccerLens: Grounded Soccer Video Understanding Beyond Accuracycited by 0
  12. 2026BasketEvent: Understanding Who Did What and When in Basketball Videoscited by 0
  13. 2026NBA_Streaming: A Large-Scale Benchmark for Fine-Grained Basketball Commentary Generation in Continuous Streamscited by 0
  14. 2026Content Based Video Narration of Gameplay with Vision Language Modelscited by 0
  15. 2026PL-NBA: A Possession-level Universal Basketball Video Dataset Supporting Multiple Visual Understanding Taskscited by 0
  16. 2026StreamSoccer: Event-Driven Memory for Streaming Soccer Commentarycited by 0