A Comprehensive Review of Computer Vision in Sports: Open Issues, Future Trends and Research Directions
Not on the map. Why?
Abstract (arXiv)
Recent developments in video analysis of sports and computer vision techniques have achieved significant improvements to enable a variety of critical operations. To provide enhanced information, such as detailed complex analysis in sports like soccer, basketball, cricket, badminton, etc., studies have focused mainly on computer vision techniques employed to carry out different tasks. This paper presents a comprehensive review of sports video analysis for various applications high-level analysis such as detection and classification of players, tracking player or ball in sports and predicting the trajectories of player or ball, recognizing the teams strategies, classifying various events in sports. The paper further discusses published works in a variety of application-specific tasks related to sports and the present researchers views regarding them. Since there is a wide research scope in sports for deploying computer vision techniques in various sports, some of the publicly available datasets related to a particular sport have been provided. This work reviews a detailed discussion on some of the artificial intelligence(AI)applications in sports vision, GPU-based work stations, and embedded platforms. Finally, this review identifies the research directions, probable challenges, and future trends in the area of visual recognition in sports.
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 61 of its 282 references that are in the map. First posted on arXiv 3 Mar 2022.
Builds on
61 of 282 references.
References · 61
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2014Going Deeper with Convolutionscited by 4,231
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,827
- 2016SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model sizecited by 1,054
- 2017Simple Online and Realtime Tracking with a Deep Association Metriccited by 908
- 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
- 2020FairMOT: On the Fairness of Detection and Re-Identification in Multiple Object Trackingcited by 489
- 2021MOTR: End-to-End Multiple-Object Tracking with Transformercited by 379
- 2020TransTrack: Multiple Object Tracking with Transformercited by 370
- 2020Social-STGCNN: A Social Spatio-Temporal Graph Convolutional Neural Network for Human Trajectory Predictioncited by 324
- 2019CoverNet: Multimodal Behavior Prediction using Trajectory Setscited by 259
38 more
- 2020Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Predictioncited by 218
- 2014Recurrent Neural Network Regularizationcited by 189
- 2018SoccerNet: A Scalable Dataset for Action Spotting in Soccer Videoscited by 148
- 2020SoccerNet-v2: A Dataset and Benchmarks for Holistic Understanding of Broadcast Soccer Videoscited by 129
- 2016Hierarchical Deep Temporal Models for Group Activity Recognitioncited by 89
- 2021Video Summarization Using Deep Neural Networks: A Surveycited by 85
- 2021EagerMOT: 3D Multi-Object Tracking via Sensor Fusioncited by 83
- 2021Monocular Quasi-Dense 3D Object Trackingcited by 80
- 2019GRIP++: Enhanced Graph-based Interaction-aware Trajectory Prediction for Autonomous Drivingcited by 73
- 2019How To Train Your Deep Multi-Object Trackercited by 71
- 2021Stepwise Goal-Driven Networks for Trajectory Predictioncited by 62
- 2019A Context-Aware Loss Function for Action Spotting in Soccer Videoscited by 56
- 2021DEFT: Detection Embeddings for Trackingcited by 56
- 2020TTNet: Real-time temporal and spatial video analysis of table tenniscited by 35
- 2019TrackNet: A Deep Learning Network for Tracking High-speed and Tiny Objects in Sports Applicationscited by 33
- 2017A Survey on Content-Aware Video Analysis for Sportscited by 27
- 2015Detecting events and key actors in multi-person videoscited by 26
- 2017Generating Long-term Trajectories Using Deep Hierarchical Networkscited by 23
- 2020OpenTraj: Assessing Prediction Complexity in Human Trajectories Datasetscited by 20
- 2020Multi-Modal Trajectory Prediction of NBA Playerscited by 18
- 2015What Players do with the Ball: A Physically Constrained Interaction Modelingcited by 17
- 2020AC-VRNN: Attentive Conditional-VRNN for Multi-Future Trajectory Predictioncited by 16
- 2021Pose is all you need: The pose only group activity recognition system (POGARS)cited by 16
- 2018Temporal Hockey Action Recognition via Pose and Optical Flowscited by 13
- 2017Multi-label Class-imbalanced Action Recognition in Hockey Videos via 3D Convolutional Neural Networkscited by 12
- 2020Self-Supervised Small Soccer Player Detection and Trackingcited by 12
- 2019DeepBall: Deep Neural-Network Ball Detectorcited by 11
- 2020Real-time CNN-based Segmentation Architecture for Ball Detection in a Single View Setupcited by 8
- 2020Player Identification in Hockey Broadcast Videoscited by 8
- 2019FootAndBall: Integrated player and ball detectorcited by 7
- 2020PointTrack++ for Effective Online Multi-Object Tracking and Segmentationcited by 6
- 2021Puck localization and multi-task event recognition in broadcast hockey videoscited by 6
- 2017Summarization of User-Generated Sports Video by Using Deep Action Recognition Featurescited by 5
- 2019Memory Augmented Deep Generative models for Forecasting the Next Shot Location in Tenniscited by 5
- 2014Classification of Passes in Football Matches using Spatiotemporal Datacited by 4
- 2016QPass: a Merit-based Evaluation of Soccer Passescited by 4
- 2019Ontology Based Global and Collective Motion Patterns for Event Classification in Basketball Videoscited by 4
- 2021Evaluating Soccer Player: from Live Camera to Deep Reinforcement Learningcited by 4
50 most cited of 61 All 61 (JSON)
Built on by
Citing papers per year: 2023: 2; 2024: 6; 2025: 9; 2026: 4.
21 papers.
Sort:
By area:
- 2024SoccerNet Game State Reconstruction: End-to-End Athlete Tracking and Identification on a Minimapcited by 34
- 2024ASTRA: An Action Spotting TRAnsformer for Soccer Videoscited by 16
- 2023Survey of Action Recognition, Spotting and Spatio-Temporal Localization in Soccer -- Current Trends and Research Perspectivescited by 7
- 2025TT3D: Table Tennis 3D Reconstructioncited by 5
- 2025SoccerNet-v3D: Leveraging Sports Broadcast Replays for 3D Scene Understandingcited by 4
- 2025From Play to Replay: Composed Video Retrieval for Temporally Fine-Grained Videoscited by 4
- 2024FinePseudo: Improving Pseudo-Labelling through Temporal-Alignablity for Semi-Supervised Fine-Grained Action Recognitioncited by 3
- 2024OSL-ActionSpotting: A Unified Library for Action Spotting in Sports Videoscited by 2
- 2025TOTNet: Occlusion-Aware Temporal Tracking for Robust Ball Detection in Sports Videoscited by 2
- 2026AdaSpot: Spend Resolution Where It Matters for Precise Event Spottingcited by 2
- 2023An X3D Neural Network Analysis for Runner's Performance Assessment in a Wild Sporting Environmentcited by 1
- 2024Investigating Event-Based Cameras for Video Frame Interpolation in Sportscited by 1
9 more
- 2025Action Valuation in Sports: A Surveycited by 1
- 2025BlurBall: Joint Ball and Motion Blur Estimation for Table Tennis Ball Trackingcited by 1
- 2024PLayerTV: Advanced Player Tracking and Identification for Automatic Soccer Highlight Clipscited by 0
- 2025Women Sport Actions Dataset for Visual Classification Using Small Scale Training Datacited by 0
- 2025Transforming Football Data into Object-centric Event Logs with Spatial Context Informationcited by 0
- 2025Automated Wicket-Taking Delivery Segmentation and Trajectory-Based Dismissal-Zone Analysis in Cricket Videos Using OCR-Guided YOLOv8cited by 0
- 2026Toward Personalized Darts Training: A Data-Driven Framework Based on Skeleton-Based Biomechanical Analysis and Motion Modelingcited by 0
- 2026SoccerLens: Grounded Soccer Video Understanding Beyond Accuracycited by 0
- 2026MS-RFD: Multi-Signal Release Frame Detection in Hammer Throw from Reconstructed 3D Trajectoriescited by 0
- 2026MS-RFD: Multi-Signal Release Frame Detection in Hammer Throw from Reconstructed 3D Trajectories16 Sep 2026
- 2026SoccerLens: Grounded Soccer Video Understanding Beyond Accuracy10 May 2026
- 2026Toward Personalized Darts Training: A Data-Driven Framework Based on Skeleton-Based Biomechanical Analysis and Motion Modeling1 Apr 2026
- 2026AdaSpot: Spend Resolution Where It Matters for Precise Event Spotting25 Feb 2026
- 2025Automated Wicket-Taking Delivery Segmentation and Trajectory-Based Dismissal-Zone Analysis in Cricket Videos Using OCR-Guided YOLOv821 Oct 2025
- 2025BlurBall: Joint Ball and Motion Blur Estimation for Table Tennis Ball Tracking22 Sep 2025
- 2025TOTNet: Occlusion-Aware Temporal Tracking for Robust Ball Detection in Sports Videos13 Aug 2025
- 2025Transforming Football Data into Object-centric Event Logs with Spatial Context Information16 Jul 2025
- 2025Women Sport Actions Dataset for Visual Classification Using Small Scale Training Data15 Jul 2025
- 2025From Play to Replay: Composed Video Retrieval for Temporally Fine-Grained Videos5 Jun 2025
- 2025SoccerNet-v3D: Leveraging Sports Broadcast Replays for 3D Scene Understanding14 Apr 2025
- 2025TT3D: Table Tennis 3D Reconstruction14 Apr 2025
9 more
- 2025Action Valuation in Sports: A Survey8 Apr 2025
- 2024FinePseudo: Improving Pseudo-Labelling through Temporal-Alignablity for Semi-Supervised Fine-Grained Action Recognition2 Sep 2024
- 2024PLayerTV: Advanced Player Tracking and Identification for Automatic Soccer Highlight Clips22 Jul 2024
- 2024Investigating Event-Based Cameras for Video Frame Interpolation in Sports2 Jul 2024
- 2024OSL-ActionSpotting: A Unified Library for Action Spotting in Sports Videos1 Jul 2024
- 2024SoccerNet Game State Reconstruction: End-to-End Athlete Tracking and Identification on a Minimap17 Apr 2024
- 2024ASTRA: An Action Spotting TRAnsformer for Soccer Videos2 Apr 2024
- 2023Survey of Action Recognition, Spotting and Spatio-Temporal Localization in Soccer -- Current Trends and Research Perspectives21 Sep 2023
- 2023An X3D Neural Network Analysis for Runner's Performance Assessment in a Wild Sporting Environment22 Jul 2023
- 2024SoccerNet Game State Reconstruction: End-to-End Athlete Tracking and Identification on a Minimapcited by 34
- 2024ASTRA: An Action Spotting TRAnsformer for Soccer Videoscited by 16
- 2023Survey of Action Recognition, Spotting and Spatio-Temporal Localization in Soccer -- Current Trends and Research Perspectivescited by 7
- 2025TT3D: Table Tennis 3D Reconstructioncited by 5
- 2025SoccerNet-v3D: Leveraging Sports Broadcast Replays for 3D Scene Understandingcited by 4
- 2025From Play to Replay: Composed Video Retrieval for Temporally Fine-Grained Videoscited by 4
- 2024FinePseudo: Improving Pseudo-Labelling through Temporal-Alignablity for Semi-Supervised Fine-Grained Action Recognitioncited by 3
- 2024OSL-ActionSpotting: A Unified Library for Action Spotting in Sports Videoscited by 2
- 2025TOTNet: Occlusion-Aware Temporal Tracking for Robust Ball Detection in Sports Videoscited by 2
- 2026AdaSpot: Spend Resolution Where It Matters for Precise Event Spottingcited by 2
- 2023An X3D Neural Network Analysis for Runner's Performance Assessment in a Wild Sporting Environmentcited by 1
- 2024Investigating Event-Based Cameras for Video Frame Interpolation in Sportscited by 1
12 most cited of 20 All 20 (JSON)
- 2026MS-RFD: Multi-Signal Release Frame Detection in Hammer Throw from Reconstructed 3D Trajectories16 Sep 2026
- 2026Toward Personalized Darts Training: A Data-Driven Framework Based on Skeleton-Based Biomechanical Analysis and Motion Modeling1 Apr 2026
- 2026AdaSpot: Spend Resolution Where It Matters for Precise Event Spotting25 Feb 2026
- 2025Automated Wicket-Taking Delivery Segmentation and Trajectory-Based Dismissal-Zone Analysis in Cricket Videos Using OCR-Guided YOLOv821 Oct 2025
- 2025BlurBall: Joint Ball and Motion Blur Estimation for Table Tennis Ball Tracking22 Sep 2025
- 2025TOTNet: Occlusion-Aware Temporal Tracking for Robust Ball Detection in Sports Videos13 Aug 2025
- 2025Transforming Football Data into Object-centric Event Logs with Spatial Context Information16 Jul 2025
- 2025Women Sport Actions Dataset for Visual Classification Using Small Scale Training Data15 Jul 2025
- 2025From Play to Replay: Composed Video Retrieval for Temporally Fine-Grained Videos5 Jun 2025
- 2025SoccerNet-v3D: Leveraging Sports Broadcast Replays for 3D Scene Understanding14 Apr 2025
- 2025TT3D: Table Tennis 3D Reconstruction14 Apr 2025
- 2025Action Valuation in Sports: A Survey8 Apr 2025
12 newest of 20 All 20 (JSON)