RTrack: Accelerating Convergence for Visual Object Tracking via Pseudo-Boxes Exploration
Not on the map. Why?
Abstract (arXiv)
Single object tracking (SOT) heavily relies on the representation of the target object as a bounding box. However, due to the potential deformation and rotation experienced by the tracked targets, the genuine bounding box fails to capture the appearance information explicitly and introduces cluttered background. This paper proposes RTrack, a novel object representation baseline tracker that utilizes a set of sample points to get a pseudo bounding box. RTrack automatically arranges these points to define the spatial extents and highlight local areas. Building upon the baseline, we conducted an in-depth exploration of the training potential and introduced a one-to-many leading assignment strategy. It is worth noting that our approach achieves competitive performance to the state-of-the-art trackers on the GOT-10k dataset while reducing training time to just 10% of the previous state-of-the-art (SOTA) trackers' training costs. The substantial reduction in training costs brings single-object tracking (SOT) closer to the object detection (OD) task. Extensive experiments demonstrate that our proposed RTrack achieves SOTA results with faster convergence.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 43 of its 51 references that are in the map. First posted on arXiv 23 Sep 2023.
Builds on
43 of 51 references.
References · 43
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2015SSD: Single Shot MultiBox Detectorcited by 3,130
- 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,577
- 2017Deformable Convolutional Networkscited by 1,488
- 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,368
- 2022YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectorscited by 982
- 2021DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsificationcited by 864
- 2018CornerNet: Detecting Objects as Paired Keypointscited by 763
31 more
- 2018Deformable ConvNets v2: More Deformable, Better Resultscited by 670
- 2019CenterNet: Keypoint Triplets for Object Detectioncited by 654
- 2016Fully-Convolutional Siamese Networks for Object Trackingcited by 568
- 2019Bridging the Gap Between Anchor-based and Anchor-free Detection via Adaptive Training Sample Selectioncited by 540
- 2018GOT-10k: A Large High-Diversity Benchmark for Generic Object Tracking in the Wildcited by 475
- 2018LaSOT: A High-quality Benchmark for Large-scale Single Object Trackingcited by 429
- 2021Transformer Trackingcited by 412
- 2021Learning Spatio-Temporal Transformer for Visual Trackingcited by 350
- 2022Mask DINO: Towards A Unified Transformer-based Framework for Object Detection and Segmentationcited by 344
- 2018TrackingNet: A Large-Scale Dataset and Benchmark for Object Tracking in the Wildcited by 343
- 2022Joint Feature Learning and Relation Modeling for Tracking: A One-Stream Frameworkcited by 330
- 2022MixFormer: End-to-End Tracking with Iterative Mixed Attentioncited by 281
- 2019RepPoints: Point Set Representation for Object Detectioncited by 264
- 2021OTA: Optimal Transport Assignment for Object Detectioncited by 178
- 2018Acquisition of Localization Confidence for Accurate Object Detectioncited by 176
- 2019Bottom-up Object Detection by Grouping Extreme and Center Pointscited by 156
- 2022AiATrack: Attention in Attention for Transformer Visual Trackingcited by 137
- 2022Backbone is All Your Need: A Simplified Architecture for Visual Object Trackingcited by 119
- 2022Revealing the Dark Secrets of Masked Image Modelingcited by 117
- 2020AutoAssign: Differentiable Label Assignment for Dense Object Detectioncited by 100
- 2023Generalized Relation Modeling for Transformer Trackingcited by 93
- 2022Transformer Tracking with Cyclic Shifting Window Attentioncited by 75
- 2022Correlation-Aware Deep Trackingcited by 62
- 2020RepPoints V2: Verification Meets Regression for Object Detectioncited by 40
- 2022SparseTT: Visual Tracking with Sparse Transformerscited by 36
- 2019Learning from Noisy Anchors for One-stage Object Detectioncited by 35
- 2023Target-Aware Tracking with Long-term Context Attentioncited by 27
- 2020RPT: Learning Point Set Representation for Siamese Visual Trackingcited by 26
- 2023Unified Sequence-to-Sequence Learning for Single- and Multi-Modal Visual Object Trackingcited by 21
- 2021IQDet: Instance-wise Quality Distribution Sampling for Object Detectioncited by 20
- 2023Correlation Loss: Enforcing Correlation between Classification and Localizationcited by 4
Built on by
Not cited yet.