Transformers in Single Object Tracking: An Experimental Survey
Not on the map. Why?
Abstract (arXiv)
Single-object tracking is a well-known and challenging research topic in computer vision. Over the last two decades, numerous researchers have proposed various algorithms to solve this problem and achieved promising results. Recently, Transformer-based tracking approaches have ushered in a new era in single-object tracking by introducing new perspectives and achieving superior tracking robustness. In this paper, we conduct an in-depth literature analysis of Transformer tracking approaches by categorizing them into CNN-Transformer based trackers, Two-stream Two-stage fully-Transformer based trackers, and One-stream One-stage fully-Transformer based trackers. In addition, we conduct experimental evaluations to assess their tracking robustness and computational efficiency using publicly available benchmark datasets. Furthermore, we measure their performances on different tracking scenarios to identify their strengths and weaknesses in particular situations. Our survey provides insights into the underlying principles of Transformer tracking approaches, the challenges they encounter, and the future directions they may take.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 67 of its 124 references that are in the map. First posted on arXiv 23 Feb 2023.
Builds on
67 of 124 references.
References · 67
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2016Gaussian Error Linear Units (GELUs)cited by 3,431
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
- 2021Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetcited by 1,096
- 2021Transformers in Vision: A Surveycited by 1,009
- 2021CvT: Introducing Convolutions to Vision Transformerscited by 946
38 more
- 2021Segmenter: Transformer for Semantic Segmentationcited by 855
- 2021CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classificationcited by 806
- 2020PCT: Point cloud transformercited by 730
- 2020A Survey on Visual Transformercited by 653
- 2021Transformer in Transformercited by 632
- 2016Fully-Convolutional Siamese Networks for Object Trackingcited by 566
- 2018GOT-10k: A Large High-Diversity Benchmark for Generic Object Tracking in the Wildcited by 471
- 2018SiamRPN++: Evolution of Siamese Visual Tracking with Very Deep Networkscited by 445
- 2018LaSOT: A High-quality Benchmark for Large-scale Single Object Trackingcited by 424
- 2021Transformer Trackingcited by 412
- 2021Conditional Positional Encodings for Vision Transformerscited by 402
- 2021Learning Spatio-Temporal Transformer for Visual Trackingcited by 348
- 2019Learning Discriminative Model Prediction for Trackingcited by 344
- 2018TrackingNet: A Large-Scale Dataset and Benchmark for Object Tracking in the Wildcited by 342
- 2022Joint Feature Learning and Relation Modeling for Tracking: A One-Stream Frameworkcited by 328
- 2022MixFormer: End-to-End Tracking with Iterative Mixed Attentioncited by 278
- 2020Probabilistic Regression for Visual Trackingcited by 231
- 2021Transformer Meets Tracker: Exploiting Temporal Context for Robust Visual Trackingcited by 220
- 2020Ocean: Object-aware Anchor-free Trackingcited by 212
- 2020Siamese Box Adaptive Network for Visual Trackingcited by 189
- 2018Distractor-aware Siamese Networks for Visual Object Trackingcited by 187
- 2019SiamFC++: Towards Robust and Accurate Visual Tracking with Target Estimation Guidelinescited by 177
- 2019Siam R-CNN: Visual Tracking by Re-Detectioncited by 174
- 2021VOLO: Vision Outlooker for Visual Recognitioncited by 164
- 2019Deeper and Wider Siamese Networks for Real-Time Visual Trackingcited by 156
- 2019SiamCAR: Siamese Fully Convolutional Classification and Regression for Visual Trackingcited by 147
- 2022AiATrack: Attention in Attention for Transformer Visual Trackingcited by 137
- 2020A Spatio-temporal Transformer for 3D Human Motion Predictioncited by 133
- 2021Learning Target Candidate Association to Keep Track of What Not to Trackcited by 131
- 2021SwinTrack: A Simple and Strong Baseline for Transformer Trackingcited by 126
- 2022Backbone is All Your Need: A Simplified Architecture for Visual Object Trackingcited by 119
- 2022Transforming Model Prediction for Trackingcited by 117
- 2017YouTube-BoundingBoxes: A Large High-Precision Human-Annotated Data Set for Object Detection in Videocited by 109
- 2019Deep Learning in Video Multi-Object Tracking: A Surveycited by 107
- 2020Deformable Siamese Attention Networks for Visual Object Trackingcited by 97
- 2022Transformer Tracking with Cyclic Shifting Window Attentioncited by 75
- 2021HiFT: Hierarchical Feature Transformer for Aerial Trackingcited by 72
- 2020Graph Attention Trackingcited by 70
50 most cited of 67 All 67 (JSON)
Built on by
Citing papers per year: 2023: 1; 2024: 6; 2025: 3.
10 papers.
- 2023LiteTrack: Layer Pruning with Asynchronous Feature Extraction for Lightweight and Efficient Visual Trackingcited by 16
- 2024Improving Visual Object Tracking through Visual Promptingcited by 9
- 2025CLDTracker: A Comprehensive Language Description for Visual Trackingcited by 2
- 2024Self-Supervised Learning for Interventional Image Analytics: Towards Robust Device Trackerscited by 1
- 2024FMRFT: Fusion Mamba and DETR for Query Time Sequence Intersection Fish Trackingcited by 1
- 2024Optimized Information Flow for Transformer Trackingcited by 0
- 2024Beyond Traditional Single Object Tracking: A Surveycited by 0
- 2024Predicting the Best of N Visual Trackerscited by 0
- 2025T-SiamTPN: Temporal Siamese Transformer Pyramid Networks for Robust and Efficient UAV Trackingcited by 0
- 2025Context-Aware Token Pruning and Discriminative Selective Attention for Transformer Trackingcited by 0
- 2025Context-Aware Token Pruning and Discriminative Selective Attention for Transformer Tracking25 Nov 2025
- 2025T-SiamTPN: Temporal Siamese Transformer Pyramid Networks for Robust and Efficient UAV Tracking16 Sep 2025
- 2025CLDTracker: A Comprehensive Language Description for Visual Tracking29 May 2025
- 2024Improving Visual Object Tracking through Visual Prompting27 Sep 2024
- 2024FMRFT: Fusion Mamba and DETR for Query Time Sequence Intersection Fish Tracking2 Sep 2024
- 2024Predicting the Best of N Visual Trackers22 Jul 2024
- 2024Beyond Traditional Single Object Tracking: A Survey16 May 2024
- 2024Self-Supervised Learning for Interventional Image Analytics: Towards Robust Device Trackers2 May 2024
- 2024Optimized Information Flow for Transformer Tracking13 Feb 2024
- 2023LiteTrack: Layer Pruning with Asynchronous Feature Extraction for Lightweight and Efficient Visual Tracking17 Sep 2023