Leveraging the Power of Data Augmentation for Transformer-based Tracking
Not on the map. Why?
Abstract (arXiv)
Due to long-distance correlation and powerful pretrained models, transformer-based methods have initiated a breakthrough in visual object tracking performance. Previous works focus on designing effective architectures suited for tracking, but ignore that data augmentation is equally crucial for training a well-performing model. In this paper, we first explore the impact of general data augmentations on transformer-based trackers via systematic experiments, and reveal the limited effectiveness of these common strategies. Motivated by experimental observations, we then propose two data augmentation methods customized for tracking. First, we optimize existing random cropping via a dynamic search radius mechanism and simulation for boundary samples. Second, we propose a token-level feature mixing augmentation strategy, which enables the model against challenges like background interference. Extensive experiments on two transformer-based trackers and six benchmarks demonstrate the effectiveness and data efficiency of our methods, especially under challenging settings, like one-shot tracking and small image resolutions.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 60 of its 73 references that are in the map. First posted on arXiv 15 Sep 2023.
Builds on
60 of 73 references.
References · 60
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
- 2020Simple Copy-Paste is a Strong Data Augmentation Method for Instance Segmentationcited by 595
- 2016Fully-Convolutional Siamese Networks for Object Trackingcited by 566
- 2018GOT-10k: A Large High-Diversity Benchmark for Generic Object Tracking in the Wildcited by 471
- 2021Intriguing Properties of Vision Transformerscited by 446
- 2018SiamRPN++: Evolution of Siamese Visual Tracking with Very Deep Networkscited by 445
- 2018LaSOT: A High-quality Benchmark for Large-scale Single Object Trackingcited by 424
38 more
- 2021Transformer Trackingcited by 412
- 2021Learning Spatio-Temporal Transformer for Visual Trackingcited by 348
- 2019Learning Discriminative Model Prediction for Trackingcited by 344
- 2018TrackingNet: A Large-Scale Dataset and Benchmark for Object Tracking in the Wildcited by 342
- 2022Joint Feature Learning and Relation Modeling for Tracking: A One-Stream Frameworkcited by 328
- 2018ATOM: Accurate Tracking by Overlap Maximizationcited by 285
- 2022MixFormer: End-to-End Tracking with Iterative Mixed Attentioncited by 278
- 2018Fast Online Object Tracking and Segmentation: A Unifying Approachcited by 272
- 2021Understanding Robustness of Transformers for Image Classificationcited by 250
- 2016ECO: Efficient Convolution Operators for Trackingcited by 239
- 2020Probabilistic Regression for Visual Trackingcited by 231
- 2021Transformer Meets Tracker: Exploiting Temporal Context for Robust Visual Trackingcited by 220
- 2020Ocean: Object-aware Anchor-free Trackingcited by 212
- 2015Learning Multi-Domain Convolutional Neural Networks for Visual Trackingcited by 209
- 2017Cut, Paste and Learn: Surprisingly Easy Synthesis for Instance Detectioncited by 209
- 2021Vision Transformers are Robust Learnerscited by 208
- 2020Siamese Box Adaptive Network for Visual Trackingcited by 189
- 2018Distractor-aware Siamese Networks for Visual Object Trackingcited by 187
- 2019SiamFC++: Towards Robust and Accurate Visual Tracking with Target Estimation Guidelinescited by 177
- 2019Siam R-CNN: Visual Tracking by Re-Detectioncited by 174
- 2019Deeper and Wider Siamese Networks for Real-Time Visual Trackingcited by 156
- 2019SiamCAR: Siamese Fully Convolutional Classification and Regression for Visual Trackingcited by 147
- 2017Need for Speed: A Benchmark for Higher Frame Rate Object Trackingcited by 137
- 2022AiATrack: Attention in Attention for Transformer Visual Trackingcited by 137
- 2021Learning Target Candidate Association to Keep Track of What Not to Trackcited by 131
- 2020LaSOT: A High-quality Large-scale Single Object Tracking Benchmarkcited by 130
- 2021SwinTrack: A Simple and Strong Baseline for Transformer Trackingcited by 126
- 2020Know Your Surroundings: Exploiting Scene Information for Object Trackingcited by 119
- 2022Backbone is All Your Need: A Simplified Architecture for Visual Object Trackingcited by 119
- 2022Transforming Model Prediction for Trackingcited by 117
- 2020Deformable Siamese Attention Networks for Visual Object Trackingcited by 97
- 2021STMTrack: Template-free Visual Tracking with Space-time Memory Networkscited by 91
- 2020Alpha-Refine: Boosting Tracking Performance by Precise Bounding Box Estimationcited by 81
- 2022Transformer Tracking with Cyclic Shifting Window Attentioncited by 75
- 2020Graph Attention Trackingcited by 70
- 2019D3S -- A Discriminative Single Shot Segmentation Trackercited by 69
- 2021Learn to Match: Automatic Matching Network Design for Visual Trackingcited by 67
- 2022Correlation-Aware Deep Trackingcited by 62
50 most cited of 60 All 60 (JSON)
Built on by
Citing papers per year: 2024: 1; 2025: 1.
2 papers.