mlsanityData to 14 Oct 2026

TimeSoccer: An End-to-End Multimodal Large Language Model for Soccer Commentary Generation

arXiv 2504.17365 ↗First posted 24 Apr 2025cs.CV cs.CLcited by 13

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

Abstract (arXiv)

Soccer is a globally popular sporting event, typically characterized by long matches and distinctive highlight moments. Recent advances in Multimodal Large Language Models (MLLMs) offer promising capabilities in temporal grounding and video understanding, soccer commentary generation often requires precise temporal localization and semantically rich descriptions over long-form video. However, existing soccer MLLMs often rely on the temporal a priori for caption generation, so they cannot process the soccer video end-to-end. While some traditional approaches follow a two-step paradigm that is complex and fails to capture the global context to achieve suboptimal performance. To solve the above issues, we present TimeSoccer, the first end-to-end soccer MLLM for Single-anchor Dense Video Captioning (SDVC) in full-match soccer videos. TimeSoccer jointly predicts timestamps and generates captions in a single pass, enabling global context modeling across 45-minute matches. To support long video understanding of soccer matches, we introduce MoFA-Select, a training-free, motion-aware frame compression module that adaptively selects representative frames via a coarse-to-fine strategy, and incorporates complementary training paradigms to strengthen the model's ability to handle long temporal sequences. Extensive experiments demonstrate that our TimeSoccer achieves State-of-The-Art (SoTA) performance on the SDVC task in an end-to-end form, generating high-quality commentary with accurate temporal alignment and strong semantic relevance.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 31 of its 43 references that are in the map. First posted on arXiv 24 Apr 2025.

Builds on

31 of 43 references.

References · 31

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  4. 2025Qwen2.5-VL Technical Reportcited by 5,587
  5. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  6. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
  7. 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,471
  8. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
  9. 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,062
  10. 2022Token Merging: Your ViT But Fastercited by 1,021
  11. 2023EVA-CLIP: Improved Training Techniques for CLIP at Scalecited by 798
  12. 2017Dense-Captioning Events in Videoscited by 793
19 more
  1. 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 583
  2. 2023MovieChat: From Dense Token to Sparse Memory for Long Video Understandingcited by 542
  3. 2022XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Modelcited by 439
  4. 2023TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understandingcited by 406
  5. 2023Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understandingcited by 371
  6. 2023Vid2Seq: Large-Scale Pretraining of a Visual Language Model for Dense Video Captioningcited by 263
  7. 2024VideoAgent: A Memory-augmented Multimodal Agent for Video Understandingcited by 229
  8. 2018SoccerNet: A Scalable Dataset for Action Spotting in Soccer Videoscited by 150
  9. 2020SoccerNet-v2: A Dataset and Benchmarks for Holistic Understanding of Broadcast Soccer Videoscited by 131
  10. 2024TimeSuite: Improving MLLMs for Long Video Understanding via Grounded Tuningcited by 106
  11. 2022SoccerNet-Tracking: Multiple Object Tracking Dataset and Benchmark in Soccer Videoscited by 80
  12. 2024Dynamic-LLaVA: Efficient Multimodal Large Language Models via Dynamic Vision-language Context Sparsificationcited by 59
  13. 2023SoccerNet-Caption: Dense Video Captioning for Soccer Broadcasts Commentariescited by 57
  14. 2024MatchTime: Towards Automatic Soccer Game Commentary Generationcited by 37
  15. 2025What Kind of Visual Tokens Do We Need? Training-free Visual Token Pruning for Multi-modal Large Language Models from the Perspective of Graphcited by 36
  16. 2023SoccerNet 2023 Challenges Resultscited by 20
  17. 2020Multimodal and multiview distillation for real-time player detection on a football fieldcited by 12
  18. 2025LLaVA-RadZ: Can Multimodal Large Language Models Effectively Tackle Zero-shot Radiology Recognition?cited by 6
  19. 2024MM-Forecast: A Multimodal Approach to Temporal Event Forecasting with Large Language Modelscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 5; 2026: 8.

13 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2025TennisTV: Do Multimodal Large Language Models Understand Tennis Rallies?
  2. 2026SoccerLens: Grounded Soccer Video Understanding Beyond Accuracy
  3. 2025Do We Need Large VLMs for Spotting Soccer Actions?
  4. 2026Beyond the Single Camera: Agentic Multi-View Reasoning in Sports Video Understanding
  5. 2025Domain Adaptation of VLM for Soccer Video Understanding
  6. 2026TreeSoc: Tree-Structured Dynamic Reasoning and Tool Synergy for Soccer Video Understanding
  7. 2024SCBench: A Sports Commentary Benchmark for Video LLMs
  8. 2024SoccerRAG: Multimodal Soccer Information Retrieval via Natural Queries