# Jersey Number Recognition using Keyframe Identification from Low-Resolution Broadcast Videos

arXiv: https://arxiv.org/abs/2309.06285 · HTML: https://mlsanity.com/paper/2309.06285/

## Key facts

- Cited by 10 papers in the map (data through 14 Oct 2026).
- Builds on 9 of its 22 references that are in the map.
- First posted on arXiv 12 Sep 2023.

## Builds on (most cited first, 9 of 9)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale](https://mlsanity.com/paper/2010.11929/) (2020)
- [Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift](https://mlsanity.com/paper/1502.03167/) (2015)
- [Temporal Convolutional Networks for Action Segmentation and Detection](https://mlsanity.com/paper/1611.05267/) (2016)
- [Multi-task learning for jersey number recognition in Ice Hockey](https://mlsanity.com/paper/2108.07848/) (2021)
- [Ice hockey player identification via transformers and weakly supervised learning](https://mlsanity.com/paper/2111.11535/) (2021)
- [Player Identification in Hockey Broadcast Videos](https://mlsanity.com/paper/2009.02429/) (2020)
- [Knock, knock. Who's there? -- Identifying football player jersey numbers with synthetic data](https://mlsanity.com/paper/2203.00734/) (2022)
- [Automated player identification and indexing using two-stage deep learning network](https://mlsanity.com/paper/2204.13809/) (2022)

## Built on by (most cited first, 10 of 10)

- [SoccerNet Game State Reconstruction: End-to-End Athlete Tracking and Identification on a Minimap](https://mlsanity.com/paper/2404.11335/) (2024)
- [A General Framework for Jersey Number Recognition in Sports Video](https://mlsanity.com/paper/2405.13896/) (2024)
- [SoccerMaster: A Vision Foundation Model for Soccer Understanding](https://mlsanity.com/paper/2512.11016/) (2025)
- [PitcherNet: Powering the Moneyball Evolution in Baseball Video Analytics](https://mlsanity.com/paper/2405.07407/) (2024)
- [Domain-Guided Masked Autoencoders for Unique Player Identification](https://mlsanity.com/paper/2403.11328/) (2024)
- [From Broadcast to Minimap: Achieving State-of-the-Art SoccerNet Game State Reconstruction](https://mlsanity.com/paper/2504.06357/) (2025)
- [Towards Automatic Soccer Commentary Generation with Knowledge-Enhanced Visual Reasoning](https://mlsanity.com/paper/2604.00057/) (2026)
- [Towards Athlete Fatigue Assessment from Association Football Videos](https://mlsanity.com/paper/2604.05636/) (2026)
- [SoccerNet 2026 Challenges Results](https://mlsanity.com/paper/2607.07320/) (2026)
- [Generalized Jersey Number Recognition Using Multi-task Learning With Orientation-guided Weight Refinement](https://mlsanity.com/paper/2406.01033/) (2024)

## Abstract (arXiv)

Player identification is a crucial component in vision-driven soccer analytics, enabling various downstream tasks such as player assessment, in-game analysis, and broadcast production. However, automatically detecting jersey numbers from player tracklets in videos presents challenges due to motion blur, low resolution, distortions, and occlusions. Existing methods, utilizing Spatial Transformer Networks, CNNs, and Vision Transformers, have shown success in image data but struggle with real-world video data, where jersey numbers are not visible in most of the frames. Hence, identifying frames that contain the jersey number is a key sub-problem to tackle. To address these issues, we propose a robust keyframe identification module that extracts frames containing essential high-level information about the jersey number. A spatio-temporal network is then employed to model spatial and temporal context and predict the probabilities of jersey numbers in the video. Additionally, we adopt a multi-task loss function to predict the probability distribution of each digit separately. Extensive evaluations on the SoccerNet dataset demonstrate that incorporating our proposed keyframe identification module results in a significant 37.81% and 37.70% increase in the accuracies of 2 different test sets with domain gaps. These results highlight the effectiveness and importance of our approach in tackling the challenges of automatic jersey number detection in sports videos.
