From Multimodal Perception to Strategic Reasoning: A Survey on AI-Generated Game Commentary
Not on the map. Why?
Abstract (arXiv)
The advent of artificial intelligence has propelled AI-Generated Game Commentary (AI-GGC) into a rapidly expanding research area, offering advantages such as scalable availability and personalized narration. However, existing studies remain fragmented, and a systematic survey that unifies prior efforts is still lacking. To bridge this gap, our survey introduces a unified framework that systematically organizes the AI-GGC landscape. We present a novel taxonomy focused on three core commentator capabilities: Live Observation, Strategic Analysis, and Historical Recall, and further categorize commentary into three corresponding types: Descriptive Commentary, Analytical Commentary, and Background Commentary. Building on this structure, we provide an in-depth review of methods, datasets, and evaluation metrics, analyzing their strengths and limitations. Finally, we highlight key challenges and point out promising directions for future research in AI-GGC.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 43 of its 106 references that are in the map. First posted on arXiv 17 Jun 2025.
Builds on
43 of 106 references.
References · 43
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
- 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
- 2019EfficientDet: Scalable and Efficient Object Detectioncited by 1,020
- 2022YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectorscited by 982
- 2016SPICE: Semantic Propositional Image Caption Evaluationcited by 824
- 2024Justice or Prejudice? Quantifying Biases in LLM-as-a-Judgecited by 368
- 2023PandaLM: An Automatic Evaluation Benchmark for LLM Instruction Tuning Optimizationcited by 316
- 2020Evaluation of Text Generation: A Surveycited by 277
- 2024Judging the Judges: A Systematic Study of Position Bias in LLM-as-a-Judgecited by 269
- 2025Agentic Retrieval-Augmented Generation: A Survey on Agentic RAGcited by 249
31 more
- 2017Survey of the State of the Art in Natural Language Generation: Core tasks, applications and evaluationcited by 206
- 2018SoccerNet: A Scalable Dataset for Action Spotting in Soccer Videoscited by 150
- 2020SoccerNet-v2: A Dataset and Benchmarks for Holistic Understanding of Broadcast Soccer Videoscited by 131
- 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Modelscited by 90
- 2018RankME: Reliable Human Ratings for Natural Language Generationcited by 69
- 2023Suspicion-Agent: Playing Imperfect Information Games with Theory of Mind Aware GPT-4cited by 68
- 2023SoccerNet-Caption: Dense Video Captioning for Soccer Broadcasts Commentariescited by 57
- 2024Align Anything: Training All-Modality Models to Follow Instructions with Language Feedbackcited by 39
- 2024MatchTime: Towards Automatic Soccer Game Commentary Generationcited by 37
- 2015What to talk about and how? Selective Generation using LSTMs with Coarse-to-Fine Alignmentcited by 31
- 2023GOAL: A Challenging Knowledge-grounded Video Captioning Benchmark for Real-time Soccer Commentary Generationcited by 28
- 2021Feature Combination Meets Attention: Baidu Soccer Embeddings and Transformer based Temporal Detectioncited by 27
- 2023Exploring the Reliability of Large Language Models as Customized Evaluators for Diverse NLP Taskscited by 24
- 2023Simple LLM Prompting is State-of-the-Art for Robust and Multilingual Dialogue Evaluationcited by 19
- 2025Are Large Vision Language Models Good Game Players?cited by 19
- 2022Improving Chess Commentaries by Combining Language Models with Symbolic Reasoning Enginescited by 13
- 2025TimeSoccer: An End-to-End Multimodal Large Language Model for Soccer Commentary Generationcited by 13
- 2024SoccerNet-Echoes: A Soccer Game Audio Commentary Datasetcited by 12
- 2019Automated Chess Commentator Powered by Neural Chess Enginecited by 10
- 2019SentiMATE: Learning to play Chess through Natural Language Processingcited by 9
- 2024Bridging the Gap between Expert and Language Models: Concept-guided Chess Commentary Generation and Evaluationcited by 6
- 2021SOCCER: An Information-Sparse Discourse State Tracking Collection in the Sports Commentary Domaincited by 4
- 2021Fighting Game Commentator with Pitch and Loudness Adjustment Utilizing Highlight Cuescited by 4
- 2014Training a Multilingual Sportscaster: Using Perceptual Context to Learn Languagecited by 3
- 2019Multimodal Joint Emotion and Game Context Recognition in League of Legends Livestreamscited by 3
- 2022Understanding Game-Playing Agents with Natural Language Annotationscited by 3
- 2022Commentary Generation from Data Records of Multiplayer Strategy Esports Gamecited by 3
- 2024Game-MUG: Multimodal Oriented Game Situation Understanding and Commentary Generation Datasetcited by 3
- 2024Enhancing Commentary Strategies for Imperfect Information Card Games: A Study of Large Language Models in Guandan Commentarycited by 3
- 2023CS-lol: a Dataset of Viewer Comment with Scene in E-sports Live-streamingcited by 2
- 2024Aspect-based Sentiment Evaluation of Chess Moves (ASSESS): an NLP-based Method for Evaluating Chess Strategies from Textbookscited by 1
Built on by
Citing papers per year: 2026: 3.
3 papers.