SoccerMaster: A Vision Foundation Model for Soccer Understanding
Not on the map. Why?
Abstract (arXiv)
Soccer understanding has recently garnered growing research interest due to its domain-specific complexity and unique challenges. Unlike prior works that typically rely on isolated, task-specific expert models, this work aims to propose a unified model to handle diverse soccer visual understanding tasks, ranging from fine-grained perception (e.g., athlete detection and identification) to high-level semantic reasoning (e.g., event classification). Concretely, our contributions are threefold: (i) we present SoccerMaster, the first soccer-specific vision foundation model that unifies diverse tasks within a single framework via supervised multi-task pretraining; (ii) we develop an automated data curation pipeline, SoccerFactory, to generate scalable spatial annotations, and integrate multiple existing soccer video datasets as a comprehensive pretraining data resource for multi-task pretraining; and (iii) we conduct extensive evaluations demonstrating that SoccerMaster consistently outperforms task-specific expert models across diverse downstream tasks, highlighting its breadth and superiority. The data, code, and model will be publicly available.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 69 of its 93 references that are in the map. First posted on arXiv 11 Dec 2025.
Builds on
69 of 93 references.
References · 69
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,027
38 more
- 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,609
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2024Depth Anything V2cited by 1,385
- 2025DINOv3cited by 1,297
- 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,199
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
- 2021Scaling Vision Transformerscited by 993
- 2016Performance Measures and a Data Set for Multi-Target, Multi-Camera Trackingcited by 685
- 2020HOTA: A Higher Order Metric for Evaluating Multi-Object Trackingcited by 546
- 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 345
- 2020FineGym: A Hierarchical Video Dataset for Fine-grained Action Understandingcited by 232
- 2023Foundation Models in Robotics: Applications, Challenges, and the Futurecited by 212
- 2018SoccerNet: A Scalable Dataset for Action Spotting in Soccer Videoscited by 148
- 2023SportsMOT: A Large Multi-Object Tracking Dataset in Multiple Sports Scenescited by 130
- 2020SoccerNet-v2: A Dataset and Benchmarks for Holistic Understanding of Broadcast Soccer Videoscited by 129
- 2023Leapfrog Diffusion Model for Stochastic Trajectory Predictioncited by 129
- 2022FineDiving: A Fine-grained Dataset for Procedure-aware Action Quality Assessmentcited by 106
- 2016Hierarchical Deep Temporal Models for Group Activity Recognitioncited by 89
- 2021MultiSports: A Multi-Person Video Dataset of Spatio-Temporally Localized Sports Actionscited by 82
- 2022SoccerNet-Tracking: Multiple Object Tracking Dataset and Benchmark in Soccer Videoscited by 80
- 2024Multiple Object Tracking as ID Predictioncited by 58
- 2023SoccerNet-Caption: Dense Video Captioning for Soccer Broadcasts Commentariescited by 57
- 2024A Survey for Foundation Models in Autonomous Drivingcited by 51
- 2021Camera Calibration and Player Localization in SoccerNet-v2 and Investigation of their Representations for Action Spottingcited by 43
- 2023TacticAI: an AI assistant for football tacticscited by 43
- 2024Sports-QA: A Large-Scale Video Question Answering Benchmark for Complex and Professional Sportscited by 41
- 2023VARS: Video Assistant Referee System for Automated Soccer Decision Making from Multiple Viewscited by 38
- 2024MatchTime: Towards Automatic Soccer Game Commentary Generationcited by 37
- 2024SoccerNet Game State Reconstruction: End-to-End Athlete Tracking and Identification on a Minimapcited by 34
- 2022SoccerNet 2022 Challenges Resultscited by 28
- 2023GOAL: A Challenging Knowledge-grounded Video Captioning Benchmark for Real-time Soccer Commentary Generationcited by 28
- 2022Semi-Supervised Training to Improve Player and Ball Detection in Soccercited by 25
- 2024SPORTU: A Comprehensive Sports Understanding Benchmark for Multimodal Large Language Modelscited by 24
- 2024X-VARS: Introducing Explainability in Football Refereeing with Multi-Modal Large Language Modelcited by 22
- 2024Towards Universal Soccer Video Understandingcited by 21
- 2018Fine-grained Activity Recognition in Baseball Videoscited by 20
- 2023SoccerNet 2023 Challenges Resultscited by 20
- 2025Multi-Agent System for Comprehensive Soccer Understandingcited by 18
50 most cited of 69 All 69 (JSON)
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026GenTac: Generative Modeling and Forecasting of Soccer Tacticscited by 2
- 2026VersaViT: Enhancing MLLM Vision Backbones via Task-Guided Optimizationcited by 1
- 2026Learning Consistent Temporal Grounding between Related Tasks in Sports Coachingcited by 1
- 2026Towards Athlete Fatigue Assessment from Association Football Videoscited by 1
- 2026Towards Temporal Compositional Reasoning in Long-Form Sports Videoscited by 1
- 2026SoccerNet 2026 Challenges Resultscited by 1
- 2026SoccerLens: Grounded Soccer Video Understanding Beyond Accuracycited by 0
- 2026BasketEvent: Understanding Who Did What and When in Basketball Videoscited by 0
- 2026SportsGrounder: Proposal-Aided Interleaved Grounding for Dense Sports Video Reasoningcited by 0
- 2026StreamSoccer: Event-Driven Memory for Streaming Soccer Commentarycited by 0
- 2026StreamSoccer: Event-Driven Memory for Streaming Soccer Commentary20 Aug 2026
- 2026SportsGrounder: Proposal-Aided Interleaved Grounding for Dense Sports Video Reasoning8 Aug 2026
- 2026BasketEvent: Understanding Who Did What and When in Basketball Videos23 Jul 2026
- 2026SoccerNet 2026 Challenges Results8 Jul 2026
- 2026SoccerLens: Grounded Soccer Video Understanding Beyond Accuracy10 May 2026
- 2026Towards Temporal Compositional Reasoning in Long-Form Sports Videos24 Apr 2026
- 2026GenTac: Generative Modeling and Forecasting of Soccer Tactics13 Apr 2026
- 2026Towards Athlete Fatigue Assessment from Association Football Videos7 Apr 2026
- 2026Learning Consistent Temporal Grounding between Related Tasks in Sports Coaching19 Mar 2026
- 2026VersaViT: Enhancing MLLM Vision Backbones via Task-Guided Optimization10 Feb 2026