mlsanityData to 14 Oct 2026

Enhancing Sports Strategy with Video Analytics and Data Mining: Assessing the effectiveness of Multimodal LLMs in tennis video analysis

arXiv 2507.02904 ↗First posted 24 Jun 2025cs.CV cs.AIcited by 1

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

Abstract (arXiv)

The use of Large Language Models (LLMs) in recent years has also given rise to the development of Multimodal LLMs (MLLMs). These new MLLMs allow us to process images, videos and even audio alongside textual inputs. In this project, we aim to assess the effectiveness of MLLMs in analysing sports videos, focusing mainly on tennis videos. Despite research done on tennis analysis, there remains a gap in models that are able to understand and identify the sequence of events in a tennis rally, which would be useful in other fields of sports analytics. As such, we will mainly assess the MLLMs on their ability to fill this gap - to classify tennis actions, as well as their ability to identify these actions in a sequence of tennis actions in a rally. We further looked into ways we can improve the MLLMs' performance, including different training methods and even using them together with other traditional models.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 19 of its 38 references that are in the map. First posted on arXiv 24 Jun 2025.

Builds on

19 of 38 references.

References · 19

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
  4. 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,402
  5. 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,109
  6. 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 771
  7. 2023EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language Understandingcited by 680
  8. 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understandingcited by 665
  9. 2019ActivityNet-QA: A Dataset for Understanding Complex Web Videos via Question Answeringcited by 561
  10. 2023Perception Test: A Diagnostic Benchmark for Multimodal Video Modelscited by 314
  11. 2024Oryx MLLM: On-Demand Spatial-Temporal Understanding at Arbitrary Resolutioncited by 159
  12. 2024Aria: An Open Multimodal Native Mixture-of-Experts Modelcited by 138
7 more
  1. 2023TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language Understandingcited by 49
  2. 2024Surveying the MLLM Landscape: A Meta-Review of Current Surveyscited by 20
  3. 2023A Comparative Study between Full-Parameter and LoRA-based Fine-Tuning on Chinese Instruction Data for Instruction Following Large Language Modelcited by 19
  4. 2024LIME: Less Is More for MLLM Evaluationcited by 7
  5. 2025F3Set: Towards Analyzing Fast, Frequent, and Fine-grained Events from Videoscited by 7
  6. 2024MIP-GAF: A MLLM-annotated Benchmark for Most Important Person Localization and Group Context Understandingcited by 3
  7. 2024Imperfect Vision Encoders: Efficient and Robust Tuning for Vision-Language Modelscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

  1. 2026A Survey of Large Models in Sportscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025TennisTV: Do Multimodal Large Language Models Understand Tennis Rallies?
  2. 2025Do We Need Large VLMs for Spotting Soccer Actions?
  3. 2024SCBench: A Sports Commentary Benchmark for Video LLMs
  4. 2024SPORTU: A Comprehensive Sports Understanding Benchmark for Multimodal Large Language Models
  5. 2024SoccerRAG: Multimodal Soccer Information Retrieval via Natural Queries
  6. 2023Large Language Models in Sport Science & Medicine: Opportunities, Risks and Considerations
  7. 2026Beyond the Single Camera: Agentic Multi-View Reasoning in Sports Video Understanding
  8. 2025MVU-Eval: Towards Multi-Video Understanding Evaluation for Multimodal LLMs