Survey of Action Recognition, Spotting and Spatio-Temporal Localization in Soccer -- Current Trends and Research Perspectives
Not on the map. Why?
Abstract (arXiv)
Action scene understanding in soccer is a challenging task due to the complex and dynamic nature of the game, as well as the interactions between players. This article provides a comprehensive overview of this task divided into action recognition, spotting, and spatio-temporal action localization, with a particular emphasis on the modalities used and multimodal methods. We explore the publicly available data sources and metrics used to evaluate models' performance. The article reviews recent state-of-the-art methods that leverage deep learning techniques and traditional methods. We focus on multimodal methods, which integrate information from multiple sources, such as video and audio data, and also those that represent one source in various ways. The advantages and limitations of methods are discussed, along with their potential for improving the accuracy and robustness of models. Finally, the article highlights some of the open research questions and future directions in the field of soccer action recognition, including the potential for multimodal methods to advance this field. Overall, this survey provides a valuable resource for researchers interested in the field of action scene understanding in soccer.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 77 of its 177 references that are in the map. First posted on arXiv 21 Sep 2023.
Builds on
77 of 177 references.
References · 77
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2017Mask R-CNNcited by 7,277
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
38 more
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
- 2015SSD: Single Shot MultiBox Detectorcited by 3,130
- 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,546
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
- 2017Non-local Neural Networkscited by 2,293
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
- 2018SlowFast Networks for Video Recognitioncited by 1,867
- 2021ViViT: A Video Vision Transformercited by 1,620
- 2020Sharpness-Aware Minimization for Efficiently Improving Generalizationcited by 1,417
- 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,322
- 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,135
- 2014Convolutional Neural Networks for Sentence Classificationcited by 1,127
- 2021Video Swin Transformercited by 1,091
- 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,013
- 2020Designing Network Design Spacescited by 960
- 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 941
- 2021Multiscale Vision Transformerscited by 897
- 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 784
- 2021AST: Audio Spectrogram Transformercited by 643
- 2019PointRend: Image Segmentation as Renderingcited by 440
- 2017Soft-NMS -- Improving Object Detection With One Line of Codecited by 382
- 2021Attention Bottlenecks for Multimodal Fusioncited by 361
- 2019Video Classification with Channel-Separated Convolutional Networkscited by 290
- 2021Video Transformer Networkcited by 272
- 20213D Human Pose Estimation with Spatial and Temporal Transformerscited by 272
- 2020DeeperGCN: All You Need to Train Deeper GCNscited by 250
- 2020Temporal Pyramid Network for Action Recognitioncited by 163
- 2018SoccerNet: A Scalable Dataset for Action Spotting in Soccer Videoscited by 150
- 2020SoccerNet-v2: A Dataset and Benchmarks for Holistic Understanding of Broadcast Soccer Videoscited by 131
- 2018ECO: Efficient Convolutional Network for Online Video Understandingcited by 115
- 2016Hierarchical Deep Temporal Models for Group Activity Recognitioncited by 89
- 2021MultiSports: A Multi-Person Video Dataset of Spatio-Temporally Localized Sports Actionscited by 84
- 2017Action Tubelet Detector for Spatio-Temporal Action Localizationcited by 77
- 2019Gate-Shift Networks for Video Action Recognitioncited by 76
- 2019You Only Watch Once: A Unified CNN Architecture for Real-Time Spatiotemporal Action Localizationcited by 59
- 2017Learnable pooling with Context Gating for video classificationcited by 58
- 2016Online Real-time Multiple Spatiotemporal Action Localisation and Predictioncited by 57
- 2019A Context-Aware Loss Function for Action Spotting in Soccer Videoscited by 56
50 most cited of 77 All 77 (JSON)
Built on by
Citing papers per year: 2024: 3; 2025: 2; 2026: 2.
7 papers.
- 2024X-VARS: Introducing Explainability in Football Refereeing with Multi-Modal Large Language Modelcited by 22
- 2025Action Anticipation from SoccerNet Football Video Broadcastscited by 9
- 2024Investigating Event-Based Cameras for Video Frame Interpolation in Sportscited by 1
- 2026Towards Athlete Fatigue Assessment from Association Football Videoscited by 1
- 2026SoccerNet 2026 Challenges Resultscited by 1
- 2024PLayerTV: Advanced Player Tracking and Identification for Automatic Soccer Highlight Clipscited by 0
- 2025UTAL-GNN: Unsupervised Temporal Action Localization using Graph Neural Networkscited by 0
- 2026SoccerNet 2026 Challenges Results8 Jul 2026
- 2026Towards Athlete Fatigue Assessment from Association Football Videos7 Apr 2026
- 2025UTAL-GNN: Unsupervised Temporal Action Localization using Graph Neural Networks27 Aug 2025
- 2025Action Anticipation from SoccerNet Football Video Broadcasts16 Apr 2025
- 2024PLayerTV: Advanced Player Tracking and Identification for Automatic Soccer Highlight Clips22 Jul 2024
- 2024Investigating Event-Based Cameras for Video Frame Interpolation in Sports2 Jul 2024
- 2024X-VARS: Introducing Explainability in Football Refereeing with Multi-Modal Large Language Model7 Apr 2024