mlsanityData to 7 Oct 2026

TrackNetV5: Residual-Driven Spatio-Temporal Refinement and Motion Direction Decoupling for Fast Object Tracking

arXiv 2512.02789 ↗First posted 2 Dec 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

The TrackNet series has established a strong baseline for fast-moving small object tracking in sports. However, existing iterations face significant limitations: V1-V3 struggle with occlusions due to a reliance on purely visual cues, while TrackNetV4, despite introducing motion inputs, suffers from directional ambiguity as its absolute difference method discards motion polarity. To overcome these bottlenecks, we propose TrackNetV5, a robust architecture integrating two novel mechanisms. First, to recover lost directional priors, we introduce the Motion Direction Decoupling (MDD) module. Unlike V4, MDD decomposes temporal dynamics into signed polarity fields, explicitly encoding both movement occurrence and trajectory direction. Second, we propose the Residual-Driven Spatio-Temporal Refinement (R-STR) head. Operating on a coarse-to-fine paradigm, this Transformer-based module leverages factorized spatio-temporal contexts to estimate a corrective residual, effectively recovering occluded targets. Extensive experiments on the TrackNetV2 dataset demonstrate that TrackNetV5 achieves a new state-of-the-art F1-score of 0.9859 and an accuracy of 0.9733, significantly outperforming previous versions. Notably, this performance leap is achieved with a marginal 3.7% increase in FLOPs compared to V4, maintaining real-time inference capabilities while delivering superior tracking precision.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 16 references that are in the map. First posted on arXiv 2 Dec 2025.

Builds on

11 of 16 references.

References · 11

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,259
  5. 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,609
  6. 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,199
  7. 2021Video Swin Transformercited by 1,090
  8. 2016Convolutional Pose Machinescited by 325
  9. 2019TrackNet: A Deep Learning Network for Tracking High-speed and Tiny Objects in Sports Applicationscited by 33
  10. 2024TrackNetV4: Enhancing Fast Sports Object Tracking with Motion Attention Mapscited by 11
  11. 2025TOTNet: Occlusion-Aware Temporal Tracking for Robust Ball Detection in Sports Videoscited by 2

Built on by

Not cited yet.