SoccerNet-v2: A Dataset and Benchmarks for Holistic Understanding of Broadcast Soccer Videos
Not on the map. Why?
Abstract (arXiv)
Understanding broadcast videos is a challenging task in computer vision, as it requires generic reasoning capabilities to appreciate the content offered by the video editing. In this work, we propose SoccerNet-v2, a novel large-scale corpus of manual annotations for the SoccerNet video dataset, along with open challenges to encourage more research in soccer understanding and broadcast production. Specifically, we release around 300k annotations within SoccerNet's 500 untrimmed broadcast soccer videos. We extend current tasks in the realm of soccer to include action spotting, camera shot segmentation with boundary detection, and we define a novel replay grounding task. For each task, we provide and discuss benchmark results, reproducible with our open-source adapted implementations of the most relevant works in the field. SoccerNet-v2 is presented to the broader research community to help push computer vision closer to automatic solutions for more general video understanding and production purposes.
Key facts. Cited by 131 papers in the map (data through 14 Oct 2026). First posted on arXiv 26 Nov 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 24; 2023: 15; 2024: 25; 2025: 27; 2026: 35.
131 papers.
Sort:
By area:
- 2023Deep Learning for Event-based Vision: A Comprehensive Survey and Benchmarkscited by 90
- 2022SoccerNet-Tracking: Multiple Object Tracking Dataset and Benchmark in Soccer Videoscited by 80
- 2022Hard to Track Objects with Irregular Motions and Similar Appearances? Make It Easier by Buffering the Matching Spacecited by 66
- 2023SoccerNet-Caption: Dense Video Captioning for Soccer Broadcasts Commentariescited by 57
- 2023TacticAI: an AI assistant for football tacticscited by 44
- 2021Camera Calibration and Player Localization in SoccerNet-v2 and Investigation of their Representations for Action Spottingcited by 43
- 2024Sports-QA: A Large-Scale Video Question Answering Benchmark for Complex and Professional Sportscited by 41
- 2022Spotting Temporally Precise, Fine-Grained Events in Videocited by 40
- 2023VARS: Video Assistant Referee System for Automated Soccer Decision Making from Multiple Viewscited by 38
- 2022DeepSportradar-v1: Computer Vision Dataset for Sports Understanding with High Quality Annotationscited by 37
- 2024MatchTime: Towards Automatic Soccer Game Commentary Generationcited by 37
- 2024SoccerNet Game State Reconstruction: End-to-End Athlete Tracking and Identification on a Minimapcited by 34
38 more
- 2021Temporally-Aware Feature Pooling for Action Spotting in Soccer Broadcastscited by 30
- 2022A Survey on Video Action Recognition in Sports: Datasets, Methods and Applicationscited by 28
- 2022SoccerNet 2022 Challenges Resultscited by 28
- 2023GOAL: A Challenging Knowledge-grounded Video Captioning Benchmark for Real-time Soccer Commentary Generationcited by 28
- 2021Feature Combination Meets Attention: Baidu Soccer Embeddings and Transformer based Temporal Detectioncited by 27
- 2022Temporally Precise Action Spotting in Soccer Videos Using Dense Detection Anchorscited by 27
- 2022Semi-Supervised Training to Improve Player and Ball Detection in Soccercited by 25
- 2022TVCalib: Camera Calibration for Sports Field Registration in Soccercited by 22
- 2024X-VARS: Introducing Explainability in Football Refereeing with Multi-Modal Large Language Modelcited by 22
- 2022A Comprehensive Review of Computer Vision in Sports: Open Issues, Future Trends and Research Directionscited by 21
- 2024T-DEED: Temporal-Discriminability Enhancer Encoder-Decoder for Precise Event Spotting in Sports Videoscited by 21
- 2024Towards Universal Soccer Video Understandingcited by 21
- 2022Evaluation of creating scoring opportunities for teammates in soccer via trajectory predictioncited by 20
- 2023SoccerNet 2023 Challenges Resultscited by 20
- 2025Multi-Agent System for Comprehensive Soccer Understandingcited by 18
- 2022Efficient tracking of team sport players with few game-specific annotationscited by 17
- 2023COMEDIAN: Self-Supervised Learning and Knowledge Distillation for Action Spotting using Transformerscited by 17
- 2024ASTRA: An Action Spotting TRAnsformer for Soccer Videoscited by 16
- 2023ShuttleSet: A Human-Annotated Stroke-Level Singles Dataset for Badminton Tactical Analysiscited by 15
- 2024AutoSoccerPose: Automated 3D posture Analysis of Soccer Shot Movementscited by 15
- 2022Action Spotting using Dense Detection Anchors Revisited: Submission to the SoccerNet Challenge 2022cited by 14
- 2023Towards Active Learning for Action Spotting in Association Football Videoscited by 14
- 2024PnLCalib: Sports Field Registration via Points and Lines Optimizationcited by 14
- 2024A Universal Protocol to Benchmark Camera Calibration for Sportscited by 14
- 2025WorldPose: A World Cup Dataset for Global 3D Human Pose Estimationcited by 14
- 2025TimeSoccer: An End-to-End Multimodal Large Language Model for Soccer Commentary Generationcited by 13
- 2022Temporal Perceiver: A General Architecture for Arbitrary Boundary Detectioncited by 12
- 2024SoccerNet-Echoes: A Soccer Game Audio Commentary Datasetcited by 12
- 2023A Survey of Deep Learning in Sports Applications: Perception, Comprehension, and Decisioncited by 11
- 2022Automatic event detection in football using tracking datacited by 10
- 2022A Graph-Based Method for Soccer Action Spotting Using Unsupervised Player Classificationcited by 10
- 2025SoccerMaster: A Vision Foundation Model for Soccer Understandingcited by 10
- 2025Action Anticipation from SoccerNet Football Video Broadcastscited by 9
- 2026Attend Before Attention: Efficient and Scalable Video Understanding via Autoregressive Gazingcited by 9
- 2024Unifying Global and Local Scene Entities Modelling for Precise Action Spottingcited by 8
- 2024Towards AI-Powered Video Assistant Referee System (VARS) for Association Footballcited by 8
- 2024SoccerNet 2024 Challenges Resultscited by 8
- 2025SoccerChat: Integrating Multimodal Data for Enhanced Soccer Game Understandingcited by 8
50 most cited of 131 All 131 (JSON)
- 2026Throwing4: Phase-Aware Pose Modeling for Throw-Distance Prediction in Elite Athletics12 Oct 2026
- 2026BMASH: Ball-Motion-Aware Soccer Header Spotting30 Sep 2026
- 2026DShuttleNet: A Badminton Doubles Dataset for Evaluating Team Coordination29 Sep 2026
- 2026ProTracer: Proprioception-Guided Failure Diagnosis in Robot Manipulation18 Sep 2026
- 2026Semantic Action Graph: A Shared Representation for Agent Grounding and Human Interpretation of Sports Highlights17 Sep 2026
- 2026Audio for Sports Highlight Detection: A Comparative Empirical Study15 Sep 2026
- 2026DoublesEval: Diagnosing Multi-Agent Tactical Reasoning in Vision-Language Models via Professional Doubles Badminton25 Aug 2026
- 2026StreamSoccer: Event-Driven Memory for Streaming Soccer Commentary20 Aug 2026
- 2026CAS-FD: Contact-Aware Temporal Sampling for Single-View Foul vs Dive Recognition17 Aug 2026
- 2026A Survey of Large Models in Sports14 Aug 2026
- 2026Entity-Aware Sequence Transduction for Player-Centric Ball Action Spotting3 Aug 2026
- 2026BasketEvent: Understanding Who Did What and When in Basketball Videos23 Jul 2026
38 more
- 2026WorldCupArena: Fine-Grained Evaluation of Language Models and Deep-Research Agents on Football Forecasting20 Jul 2026
- 2026SportD: How do VLMs physically strategize?16 Jul 2026
- 2026SoccerNet 2026 Challenges Results8 Jul 2026
- 2026SkillSpotter: Pose-Aware Multi-View Skilled Action Detection and Grading in Ego-Exo Videos30 Jun 2026
- 2026AVTrack: Audio-Visual Tracking in Human-centric Complex Scenes1 Jun 2026
- 2026SVI-Bench: A Dynamic Microworld for Strategic Video Intelligence29 May 2026
- 2026SoccerLens: Grounded Soccer Video Understanding Beyond Accuracy10 May 2026
- 2026Retrieving Any Relevant Moments: Benchmark and Models for Generalized Moment Retrieval4 May 2026
- 2026Towards Temporal Compositional Reasoning in Long-Form Sports Videos24 Apr 2026
- 2026RefereeBench: Are Video MLLMs Ready to be Multi-Sport Referees17 Apr 2026
- 2026Detecting Precise Hand Touch Moments in Egocentric Video14 Apr 2026
- 2026GenTac: Generative Modeling and Forecasting of Soccer Tactics13 Apr 2026
- 2026Towards Athlete Fatigue Assessment from Association Football Videos7 Apr 2026
- 2026BoxComm: Benchmarking Category-Aware Commentary Generation and Narration Rhythm in Boxing6 Apr 2026
- 2026Are VLMs Lost Between Sky and Space? LinkS2Bench for UAV-Satellite Dynamic Cross-View Spatial Intelligence2 Apr 2026
- 2026Towards Automatic Soccer Commentary Generation with Knowledge-Enhanced Visual Reasoning31 Mar 2026
- 2026TacSIm: A Dataset and Benchmark for Football Tactical Style Imitation26 Mar 2026
- 2026Em-Garde: A Propose-Match Framework for Proactive Streaming Video Understanding19 Mar 2026
- 2026Attend Before Attention: Efficient and Scalable Video Understanding via Autoregressive Gazing12 Mar 2026
- 2026AdaSpot: Spend Resolution Where It Matters for Precise Event Spotting25 Feb 2026
- 2026GTATrack: Winner Solution to SoccerTrack 2025 with Deep-EIoU and Global Tracklet Association31 Jan 2026
- 2026Where is the multimodal goal post? On the Ability of Foundation Models to Recognize Highlights in Videos22 Jan 2026
- 2026VideoHEDGE: Entropy-Based Hallucination Detection for Video-VLMs via Semantic Clustering and Spatiotemporal Perturbations13 Jan 2026
- 2025SoccerMaster: A Vision Foundation Model for Soccer Understanding11 Dec 2025
- 2025CompanionCast: Toward Social Collaboration with Multi-Agent Systems in Shared Experiences11 Dec 2025
- 2025RacketVision: A Multiple Racket Sports Benchmark for Unified Ball and Racket Analysis21 Nov 2025
- 2025FOOTPASS: A Multi-Modal Multi-Agent Tactical Context Dataset for Play-by-Play Action Spotting in Soccer Broadcast Videos20 Nov 2025
- 2025Pixels or Positions? Benchmarking Modalities in Group Activity Recognition16 Nov 2025
- 2025MCAD: Multimodal Context-Aware Audio Description Generation For Soccer12 Nov 2025
- 2025X-Ego: Acquiring Team-Level Tactical Situational Awareness via Cross-Egocentric Contrastive Video Representation Learning22 Oct 2025
- 2025TennisTV: Do Multimodal Large Language Models Understand Tennis Rallies?19 Sep 2025
- 2025SoccerHigh: A Benchmark Dataset for Automatic Soccer Video Summarization1 Sep 2025
- 2025TrajSV: A Trajectory-based Model for Sports Video Representations and Applications15 Aug 2025
- 2025SoccerTrack v2: A Full-Pitch Panoramic Video Dataset for Game State Reconstruction and Ball Action Spotting3 Aug 2025
- 2025SV3.3B: A Sports Video Understanding Model for Action Recognition23 Jul 2025
- 2025Predicting Soccer Penalty Kick Direction Using Human Action Recognition16 Jul 2025
- 2025Do We Need Large VLMs for Spotting Soccer Actions?20 Jun 2025
- 2025From Multimodal Perception to Strategic Reasoning: A Survey on AI-Generated Game Commentary17 Jun 2025
50 newest of 131 All 131 (JSON)
- 2024X-VARS: Introducing Explainability in Football Refereeing with Multi-Modal Large Language Modelcited by 22
- 2025TimeSoccer: An End-to-End Multimodal Large Language Model for Soccer Commentary Generationcited by 13
- 2026Attend Before Attention: Efficient and Scalable Video Understanding via Autoregressive Gazingcited by 9
- 2025Domain Adaptation of VLM for Soccer Video Understandingcited by 7
- 2025TennisTV: Do Multimodal Large Language Models Understand Tennis Rallies?cited by 3
- 2026VideoHEDGE: Entropy-Based Hallucination Detection for Video-VLMs via Semantic Clustering and Spatiotemporal Perturbationscited by 1
- 2026SoccerLens: Grounded Soccer Video Understanding Beyond Accuracycited by 1
- 2025Temporally-Grounded Language Generation: Towards Real-Time Vision-Language Modelscited by 0
- 2026BoxComm: Benchmarking Category-Aware Commentary Generation and Narration Rhythm in Boxingcited by 0
- 2026SoccerLens: Grounded Soccer Video Understanding Beyond Accuracy10 May 2026
- 2026BoxComm: Benchmarking Category-Aware Commentary Generation and Narration Rhythm in Boxing6 Apr 2026
- 2026Attend Before Attention: Efficient and Scalable Video Understanding via Autoregressive Gazing12 Mar 2026
- 2026VideoHEDGE: Entropy-Based Hallucination Detection for Video-VLMs via Semantic Clustering and Spatiotemporal Perturbations13 Jan 2026
- 2025TennisTV: Do Multimodal Large Language Models Understand Tennis Rallies?19 Sep 2025
- 2025Domain Adaptation of VLM for Soccer Video Understanding20 May 2025
- 2025Temporally-Grounded Language Generation: Towards Real-Time Vision-Language Models16 May 2025
- 2025TimeSoccer: An End-to-End Multimodal Large Language Model for Soccer Commentary Generation24 Apr 2025
- 2024X-VARS: Introducing Explainability in Football Refereeing with Multi-Modal Large Language Model7 Apr 2024
- 2025Multi-Agent System for Comprehensive Soccer Understandingcited by 18
- 2026WorldCupArena: Fine-Grained Evaluation of Language Models and Deep-Research Agents on Football Forecastingcited by 2
- 2026SVI-Bench: A Dynamic Microworld for Strategic Video Intelligencecited by 1
- 2026Semantic Action Graph: A Shared Representation for Agent Grounding and Human Interpretation of Sports Highlightscited by 0
- 2026Semantic Action Graph: A Shared Representation for Agent Grounding and Human Interpretation of Sports Highlights17 Sep 2026
- 2026WorldCupArena: Fine-Grained Evaluation of Language Models and Deep-Research Agents on Football Forecasting20 Jul 2026
- 2026SVI-Bench: A Dynamic Microworld for Strategic Video Intelligence29 May 2026
- 2025Multi-Agent System for Comprehensive Soccer Understanding6 May 2025
- 2026Towards Automatic Soccer Commentary Generation with Knowledge-Enhanced Visual Reasoningcited by 1
- 2026Towards Temporal Compositional Reasoning in Long-Form Sports Videoscited by 1
- 2026DoublesEval: Diagnosing Multi-Agent Tactical Reasoning in Vision-Language Models via Professional Doubles Badmintoncited by 0
- 2026DoublesEval: Diagnosing Multi-Agent Tactical Reasoning in Vision-Language Models via Professional Doubles Badminton25 Aug 2026
- 2026Towards Temporal Compositional Reasoning in Long-Form Sports Videos24 Apr 2026
- 2026Towards Automatic Soccer Commentary Generation with Knowledge-Enhanced Visual Reasoning31 Mar 2026
- 2023Deep Learning for Event-based Vision: A Comprehensive Survey and Benchmarkscited by 90
- 2022SoccerNet-Tracking: Multiple Object Tracking Dataset and Benchmark in Soccer Videoscited by 80
- 2022Hard to Track Objects with Irregular Motions and Similar Appearances? Make It Easier by Buffering the Matching Spacecited by 66
- 2023SoccerNet-Caption: Dense Video Captioning for Soccer Broadcasts Commentariescited by 57
- 2023TacticAI: an AI assistant for football tacticscited by 44
- 2021Camera Calibration and Player Localization in SoccerNet-v2 and Investigation of their Representations for Action Spottingcited by 43
- 2024Sports-QA: A Large-Scale Video Question Answering Benchmark for Complex and Professional Sportscited by 41
- 2022Spotting Temporally Precise, Fine-Grained Events in Videocited by 40
- 2023VARS: Video Assistant Referee System for Automated Soccer Decision Making from Multiple Viewscited by 38
- 2022DeepSportradar-v1: Computer Vision Dataset for Sports Understanding with High Quality Annotationscited by 37
- 2024MatchTime: Towards Automatic Soccer Game Commentary Generationcited by 37
- 2024SoccerNet Game State Reconstruction: End-to-End Athlete Tracking and Identification on a Minimapcited by 34
12 most cited of 113 All 113 (JSON)
- 2026Throwing4: Phase-Aware Pose Modeling for Throw-Distance Prediction in Elite Athletics12 Oct 2026
- 2026BMASH: Ball-Motion-Aware Soccer Header Spotting30 Sep 2026
- 2026DShuttleNet: A Badminton Doubles Dataset for Evaluating Team Coordination29 Sep 2026
- 2026ProTracer: Proprioception-Guided Failure Diagnosis in Robot Manipulation18 Sep 2026
- 2026Audio for Sports Highlight Detection: A Comparative Empirical Study15 Sep 2026
- 2026StreamSoccer: Event-Driven Memory for Streaming Soccer Commentary20 Aug 2026
- 2026CAS-FD: Contact-Aware Temporal Sampling for Single-View Foul vs Dive Recognition17 Aug 2026
- 2026A Survey of Large Models in Sports14 Aug 2026
- 2026Entity-Aware Sequence Transduction for Player-Centric Ball Action Spotting3 Aug 2026
- 2026BasketEvent: Understanding Who Did What and When in Basketball Videos23 Jul 2026
- 2026SportD: How do VLMs physically strategize?16 Jul 2026
- 2026SoccerNet 2026 Challenges Results8 Jul 2026
12 newest of 113 All 113 (JSON)