mlsanityData to 7 Oct 2026

Leveraging the Power of Data Augmentation for Transformer-based Tracking

arXiv 2309.08264 ↗First posted 15 Sep 2023cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Due to long-distance correlation and powerful pretrained models, transformer-based methods have initiated a breakthrough in visual object tracking performance. Previous works focus on designing effective architectures suited for tracking, but ignore that data augmentation is equally crucial for training a well-performing model. In this paper, we first explore the impact of general data augmentations on transformer-based trackers via systematic experiments, and reveal the limited effectiveness of these common strategies. Motivated by experimental observations, we then propose two data augmentation methods customized for tracking. First, we optimize existing random cropping via a dynamic search radius mechanism and simulation for boundary samples. Second, we propose a token-level feature mixing augmentation strategy, which enables the model against challenges like background interference. Extensive experiments on two transformer-based trackers and six benchmarks demonstrate the effectiveness and data efficiency of our methods, especially under challenging settings, like one-shot tracking and small image resolutions.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 60 of its 73 references that are in the map. First posted on arXiv 15 Sep 2023.

Builds on

60 of 73 references.

References · 60

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  3. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  4. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
  5. 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
  6. 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
  7. 2020Simple Copy-Paste is a Strong Data Augmentation Method for Instance Segmentationcited by 595
  8. 2016Fully-Convolutional Siamese Networks for Object Trackingcited by 566
  9. 2018GOT-10k: A Large High-Diversity Benchmark for Generic Object Tracking in the Wildcited by 471
  10. 2021Intriguing Properties of Vision Transformerscited by 446
  11. 2018SiamRPN++: Evolution of Siamese Visual Tracking with Very Deep Networkscited by 445
  12. 2018LaSOT: A High-quality Benchmark for Large-scale Single Object Trackingcited by 424
38 more
  1. 2021Transformer Trackingcited by 412
  2. 2021Learning Spatio-Temporal Transformer for Visual Trackingcited by 348
  3. 2019Learning Discriminative Model Prediction for Trackingcited by 344
  4. 2018TrackingNet: A Large-Scale Dataset and Benchmark for Object Tracking in the Wildcited by 342
  5. 2022Joint Feature Learning and Relation Modeling for Tracking: A One-Stream Frameworkcited by 328
  6. 2018ATOM: Accurate Tracking by Overlap Maximizationcited by 285
  7. 2022MixFormer: End-to-End Tracking with Iterative Mixed Attentioncited by 278
  8. 2018Fast Online Object Tracking and Segmentation: A Unifying Approachcited by 272
  9. 2021Understanding Robustness of Transformers for Image Classificationcited by 250
  10. 2016ECO: Efficient Convolution Operators for Trackingcited by 239
  11. 2020Probabilistic Regression for Visual Trackingcited by 231
  12. 2021Transformer Meets Tracker: Exploiting Temporal Context for Robust Visual Trackingcited by 220
  13. 2020Ocean: Object-aware Anchor-free Trackingcited by 212
  14. 2015Learning Multi-Domain Convolutional Neural Networks for Visual Trackingcited by 209
  15. 2017Cut, Paste and Learn: Surprisingly Easy Synthesis for Instance Detectioncited by 209
  16. 2021Vision Transformers are Robust Learnerscited by 208
  17. 2020Siamese Box Adaptive Network for Visual Trackingcited by 189
  18. 2018Distractor-aware Siamese Networks for Visual Object Trackingcited by 187
  19. 2019SiamFC++: Towards Robust and Accurate Visual Tracking with Target Estimation Guidelinescited by 177
  20. 2019Siam R-CNN: Visual Tracking by Re-Detectioncited by 174
  21. 2019Deeper and Wider Siamese Networks for Real-Time Visual Trackingcited by 156
  22. 2019SiamCAR: Siamese Fully Convolutional Classification and Regression for Visual Trackingcited by 147
  23. 2017Need for Speed: A Benchmark for Higher Frame Rate Object Trackingcited by 137
  24. 2022AiATrack: Attention in Attention for Transformer Visual Trackingcited by 137
  25. 2021Learning Target Candidate Association to Keep Track of What Not to Trackcited by 131
  26. 2020LaSOT: A High-quality Large-scale Single Object Tracking Benchmarkcited by 130
  27. 2021SwinTrack: A Simple and Strong Baseline for Transformer Trackingcited by 126
  28. 2020Know Your Surroundings: Exploiting Scene Information for Object Trackingcited by 119
  29. 2022Backbone is All Your Need: A Simplified Architecture for Visual Object Trackingcited by 119
  30. 2022Transforming Model Prediction for Trackingcited by 117
  31. 2020Deformable Siamese Attention Networks for Visual Object Trackingcited by 97
  32. 2021STMTrack: Template-free Visual Tracking with Space-time Memory Networkscited by 91
  33. 2020Alpha-Refine: Boosting Tracking Performance by Precise Bounding Box Estimationcited by 81
  34. 2022Transformer Tracking with Cyclic Shifting Window Attentioncited by 75
  35. 2020Graph Attention Trackingcited by 70
  36. 2019D3S -- A Discriminative Single Shot Segmentation Trackercited by 69
  37. 2021Learn to Match: Automatic Matching Network Design for Visual Trackingcited by 67
  38. 2022Correlation-Aware Deep Trackingcited by 62

50 most cited of 60 All 60 (JSON)

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 1.

2 papers.