Feature Combination Meets Attention: Baidu Soccer Embeddings and Transformer based Temporal Detection
Not on the map. Why?
Abstract (arXiv)
With rapidly evolving internet technologies and emerging tools, sports related videos generated online are increasing at an unprecedentedly fast pace. To automate sports video editing/highlight generation process, a key task is to precisely recognize and locate the events in the long untrimmed videos. In this tech report, we present a two-stage paradigm to detect what and when events happen in soccer broadcast videos. Specifically, we fine-tune multiple action recognition models on soccer data to extract high-level semantic features, and design a transformer based temporal detection module to locate the target events. This approach achieved the state-of-the-art performance in both two tasks, i.e., action spotting and replay grounding, in the SoccerNet-v2 Challenge, under CVPR 2021 ActivityNet workshop. Our soccer embedding features are released at https://github.com/baidu-research/vidpress-sports. By sharing these features with the broader community, we hope to accelerate the research into soccer video understanding.
Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). Builds on 19 of its 22 references that are in the map. First posted on arXiv 28 Jun 2021.
Builds on
19 of 22 references.
References · 19
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2017The Kinetics Human Action Video Datasetcited by 1,894
- 2018SlowFast Networks for Video Recognitioncited by 1,862
- 2019Video Classification with Channel-Separated Convolutional Networkscited by 290
- 2021Video Transformer Networkcited by 271
- 2020Temporal Pyramid Network for Action Recognitioncited by 163
- 2018SoccerNet: A Scalable Dataset for Action Spotting in Soccer Videoscited by 148
- 2019Large-scale weakly-supervised pre-training for video action recognitioncited by 130
- 2020SoccerNet-v2: A Dataset and Benchmarks for Holistic Understanding of Broadcast Soccer Videoscited by 129
- 2019A Context-Aware Loss Function for Action Spotting in Soccer Videoscited by 56
7 more
- 2020Omni-sourced Webly-supervised Learning for Video Recognitioncited by 48
- 2021Temporally-Aware Feature Pooling for Action Spotting in Soccer Broadcastscited by 30
- 2020Improved Soccer Action Spotting using both Audio and Video Streamscited by 21
- 2020Using Player's Body-Orientation to Model Pass Feasibility in Soccercited by 20
- 2020GTA: Global Temporal Attention for Video Action Understandingcited by 20
- 2020Group Activity Detection from Trajectory and Video Data in Soccercited by 17
- 2020Multimodal and multiview distillation for real-time player detection on a football fieldcited by 12
Built on by
Citing papers per year: 2022: 6; 2023: 5; 2024: 7; 2025: 7; 2026: 2.
27 papers.
Sort:
By area:
- 2023SoccerNet-Caption: Dense Video Captioning for Soccer Broadcasts Commentariescited by 57
- 2022Spotting Temporally Precise, Fine-Grained Events in Videocited by 40
- 2024MatchTime: Towards Automatic Soccer Game Commentary Generationcited by 37
- 2024SoccerNet Game State Reconstruction: End-to-End Athlete Tracking and Identification on a Minimapcited by 34
- 2022SoccerNet 2022 Challenges Resultscited by 28
- 2022Temporally Precise Action Spotting in Soccer Videos Using Dense Detection Anchorscited by 27
- 2024Towards Universal Soccer Video Understandingcited by 21
- 2023SoccerNet 2023 Challenges Resultscited by 20
- 2023COMEDIAN: Self-Supervised Learning and Knowledge Distillation for Action Spotting using Transformerscited by 17
- 2024ASTRA: An Action Spotting TRAnsformer for Soccer Videoscited by 16
- 2022Action Spotting using Dense Detection Anchors Revisited: Submission to the SoccerNet Challenge 2022cited by 14
- 2022Faster-TAD: Towards Temporal Action Detection with Proposal Generation and Classification in a Unified Networkcited by 10
15 more
- 2022A Graph-Based Method for Soccer Action Spotting Using Unsupervised Player Classificationcited by 10
- 2025Action Anticipation from SoccerNet Football Video Broadcastscited by 9
- 2024Unifying Global and Local Scene Entities Modelling for Precise Action Spottingcited by 8
- 2023Survey of Action Recognition, Spotting and Spatio-Temporal Localization in Soccer -- Current Trends and Research Perspectivescited by 7
- 2024Deep learning for action spotting in association football videoscited by 7
- 2025Domain Adaptation of VLM for Soccer Video Understandingcited by 7
- 2025Precise Event Spotting in Sports Videos: Solving Long-Range Dependency and Class Imbalancecited by 6
- 2023A Boosted Model Ensembling Approach to Ball Action Spotting in Videos: The Runner-Up Solution to CVPR'23 SoccerNet Challengecited by 4
- 2025Deep Learning for Sports Video Event Detection: Tasks, Datasets, Methods, and Challengescited by 3
- 2025From Multimodal Perception to Strategic Reasoning: A Survey on AI-Generated Game Commentarycited by 3
- 2026AdaSpot: Spend Resolution Where It Matters for Precise Event Spottingcited by 2
- 2026Detecting Precise Hand Touch Moments in Egocentric Videocited by 2
- 2025Do We Need Large VLMs for Spotting Soccer Actions?cited by 1
- 2024Technical Report for SoccerNet Challenge 2022 -- Replay Grounding Taskcited by 0
- 2025TrajSV: A Trajectory-based Model for Sports Video Representations and Applicationscited by 0
- 2026Detecting Precise Hand Touch Moments in Egocentric Video14 Apr 2026
- 2026AdaSpot: Spend Resolution Where It Matters for Precise Event Spotting25 Feb 2026
- 2025TrajSV: A Trajectory-based Model for Sports Video Representations and Applications15 Aug 2025
- 2025Do We Need Large VLMs for Spotting Soccer Actions?20 Jun 2025
- 2025From Multimodal Perception to Strategic Reasoning: A Survey on AI-Generated Game Commentary17 Jun 2025
- 2025Domain Adaptation of VLM for Soccer Video Understanding20 May 2025
- 2025Deep Learning for Sports Video Event Detection: Tasks, Datasets, Methods, and Challenges6 May 2025
- 2025Action Anticipation from SoccerNet Football Video Broadcasts16 Apr 2025
- 2025Precise Event Spotting in Sports Videos: Solving Long-Range Dependency and Class Imbalance28 Feb 2025
- 2024Towards Universal Soccer Video Understanding2 Dec 2024
- 2024Technical Report for SoccerNet Challenge 2022 -- Replay Grounding Task31 Oct 2024
- 2024Deep learning for action spotting in association football videos2 Oct 2024
15 more
- 2024MatchTime: Towards Automatic Soccer Game Commentary Generation26 Jun 2024
- 2024SoccerNet Game State Reconstruction: End-to-End Athlete Tracking and Identification on a Minimap17 Apr 2024
- 2024Unifying Global and Local Scene Entities Modelling for Precise Action Spotting15 Apr 2024
- 2024ASTRA: An Action Spotting TRAnsformer for Soccer Videos2 Apr 2024
- 2023Survey of Action Recognition, Spotting and Spatio-Temporal Localization in Soccer -- Current Trends and Research Perspectives21 Sep 2023
- 2023SoccerNet 2023 Challenges Results12 Sep 2023
- 2023COMEDIAN: Self-Supervised Learning and Knowledge Distillation for Action Spotting using Transformers3 Sep 2023
- 2023A Boosted Model Ensembling Approach to Ball Action Spotting in Videos: The Runner-Up Solution to CVPR'23 SoccerNet Challenge9 Jun 2023
- 2023SoccerNet-Caption: Dense Video Captioning for Soccer Broadcasts Commentaries10 Apr 2023
- 2022A Graph-Based Method for Soccer Action Spotting Using Unsupervised Player Classification22 Nov 2022
- 2022SoccerNet 2022 Challenges Results5 Oct 2022
- 2022Spotting Temporally Precise, Fine-Grained Events in Video20 Jul 2022
- 2022Action Spotting using Dense Detection Anchors Revisited: Submission to the SoccerNet Challenge 202215 Jun 2022
- 2022Temporally Precise Action Spotting in Soccer Videos Using Dense Detection Anchors20 May 2022
- 2022Faster-TAD: Towards Temporal Action Detection with Proposal Generation and Classification in a Unified Network6 Apr 2022
- 2025Domain Adaptation of VLM for Soccer Video Understandingcited by 7
- 2025Domain Adaptation of VLM for Soccer Video Understanding20 May 2025
- 2023SoccerNet-Caption: Dense Video Captioning for Soccer Broadcasts Commentariescited by 57
- 2022Spotting Temporally Precise, Fine-Grained Events in Videocited by 40
- 2024MatchTime: Towards Automatic Soccer Game Commentary Generationcited by 37
- 2024SoccerNet Game State Reconstruction: End-to-End Athlete Tracking and Identification on a Minimapcited by 34
- 2022SoccerNet 2022 Challenges Resultscited by 28
- 2022Temporally Precise Action Spotting in Soccer Videos Using Dense Detection Anchorscited by 27
- 2024Towards Universal Soccer Video Understandingcited by 21
- 2023SoccerNet 2023 Challenges Resultscited by 20
- 2023COMEDIAN: Self-Supervised Learning and Knowledge Distillation for Action Spotting using Transformerscited by 17
- 2024ASTRA: An Action Spotting TRAnsformer for Soccer Videoscited by 16
- 2022Action Spotting using Dense Detection Anchors Revisited: Submission to the SoccerNet Challenge 2022cited by 14
- 2022Faster-TAD: Towards Temporal Action Detection with Proposal Generation and Classification in a Unified Networkcited by 10
12 most cited of 26 All 26 (JSON)
- 2026Detecting Precise Hand Touch Moments in Egocentric Video14 Apr 2026
- 2026AdaSpot: Spend Resolution Where It Matters for Precise Event Spotting25 Feb 2026
- 2025TrajSV: A Trajectory-based Model for Sports Video Representations and Applications15 Aug 2025
- 2025Do We Need Large VLMs for Spotting Soccer Actions?20 Jun 2025
- 2025From Multimodal Perception to Strategic Reasoning: A Survey on AI-Generated Game Commentary17 Jun 2025
- 2025Deep Learning for Sports Video Event Detection: Tasks, Datasets, Methods, and Challenges6 May 2025
- 2025Action Anticipation from SoccerNet Football Video Broadcasts16 Apr 2025
- 2025Precise Event Spotting in Sports Videos: Solving Long-Range Dependency and Class Imbalance28 Feb 2025
- 2024Towards Universal Soccer Video Understanding2 Dec 2024
- 2024Technical Report for SoccerNet Challenge 2022 -- Replay Grounding Task31 Oct 2024
- 2024Deep learning for action spotting in association football videos2 Oct 2024
- 2024MatchTime: Towards Automatic Soccer Game Commentary Generation26 Jun 2024
12 newest of 26 All 26 (JSON)