SiamRPN++: Evolution of Siamese Visual Tracking with Very Deep Networks
Not on the map. Why?
Abstract (arXiv)
Siamese network based trackers formulate tracking as convolutional feature cross-correlation between target template and searching region. However, Siamese trackers still have accuracy gap compared with state-of-the-art algorithms and they cannot take advantage of feature from deep networks, such as ResNet-50 or deeper. In this work we prove the core reason comes from the lack of strict translation invariance. By comprehensive theoretical analysis and experimental validations, we break this restriction through a simple yet effective spatial aware sampling strategy and successfully train a ResNet-driven Siamese tracker with significant performance gain. Moreover, we propose a new model architecture to perform depth-wise and layer-wise aggregations, which not only further improves the accuracy but also reduces the model size. We conduct extensive ablation studies to demonstrate the effectiveness of the proposed tracker, which obtains currently the best results on four large tracking benchmarks, including OTB2015, VOT2018, UAV123, and LaSOT. Our model will be released to facilitate further studies based on this problem.
Key facts. Cited by 446 papers in the map (data through 14 Oct 2026). First posted on arXiv 31 Dec 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 111; 2022: 92; 2023: 76; 2024: 78; 2025: 55; 2026: 34.
446 papers.
Sort:
By area:
- 2021Transformer Trackingcited by 412
- 2021Learning Spatio-Temporal Transformer for Visual Trackingcited by 350
- 2022Joint Feature Learning and Relation Modeling for Tracking: A One-Stream Frameworkcited by 330
- 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 317
- 2022MixFormer: End-to-End Tracking with Iterative Mixed Attentioncited by 281
- 2021Transformer Meets Tracker: Exploiting Temporal Context for Robust Visual Trackingcited by 220
- 2025InternVideo2.5: Empowering Video MLLMs with Long and Rich Context Modelingcited by 211
- 2021Hypercorrelation Squeeze for Few-Shot Segmentationcited by 193
- 2023Universal Instance Perception as Object Discovery and Retrievalcited by 192
- 2023Visual Prompt Multi-Modal Trackingcited by 142
- 2022AiATrack: Attention in Attention for Transformer Visual Trackingcited by 137
- 2021Learning Target Candidate Association to Keep Track of What Not to Trackcited by 131
38 more
- 2021VisEvent: Reliable Object Tracking via Collaboration of Frame and Event Flowscited by 129
- 2024ODTrack: Online Dense Temporal Token Learning for Visual Trackingcited by 129
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2021Towards More Flexible and Accurate Object Tracking with Natural Language: Algorithms and Benchmarkcited by 126
- 2021SwinTrack: A Simple and Strong Baseline for Transformer Trackingcited by 126
- 2022Backbone is All Your Need: A Simplified Architecture for Visual Object Trackingcited by 119
- 2022Transforming Model Prediction for Trackingcited by 117
- 2024SAMURAI: Adapting Segment Anything Model for Zero-Shot Visual Tracking with Motion-Aware Memorycited by 94
- 2022Towards Grand Unification of Object Trackingcited by 93
- 2023Generalized Relation Modeling for Transformer Trackingcited by 93
- 2021STMTrack: Template-free Visual Tracking with Space-time Memory Networkscited by 91
- 2022Visible-Thermal UAV Tracking: A Large-Scale Benchmark and New Baselinecited by 91
- 2021LightTrack: Finding Lightweight Neural Networks for Object Tracking via One-Shot Architecture Searchcited by 82
- 2023Robust Object Modeling for Visual Trackingcited by 80
- 2024Autoregressive Queries for Adaptive Tracking with Spatio-TemporalTransformerscited by 76
- 2022Transformer Tracking with Cyclic Shifting Window Attentioncited by 75
- 2021HiFT: Hierarchical Feature Transformer for Aerial Trackingcited by 72
- 2023HIPTrack: Visual Tracking with Historical Promptscited by 71
- 2024Tracking Meets LoRA: Faster Training, Larger Model, Stronger Performancecited by 70
- 2022TCTrack: Temporal Contexts for Aerial Trackingcited by 69
- 2021Learn to Match: Automatic Matching Network Design for Visual Trackingcited by 67
- 2021Box-Aware Feature Enhancement for Single Object Tracking on Point Cloudscited by 66
- 2021PTTR: Relational 3D Point Cloud Object Tracking with Transformercited by 65
- 2023Single-Model and Any-Modality for Video Object Trackingcited by 65
- 2024OneTracker: Unifying Visual Object Tracking with Foundation Models and Efficient Tuningcited by 65
- 2021SiamMOT: Siamese Multi-Object Trackingcited by 62
- 2021Do Different Tracking Tasks Require Different Appearance Models?cited by 62
- 2022Correlation-Aware Deep Trackingcited by 62
- 2023Towards Unified Token Learning for Vision-Language Trackingcited by 62
- 2023Joint Visual Grounding and Tracking with Natural Language Specificationcited by 59
- 2022Accelerating DETR Convergence via Semantic-Aligned Matchingcited by 58
- 2023MixFormerV2: Efficient Fully Transformer Trackingcited by 57
- 2022Unsupervised Domain Adaptation for Nighttime Aerial Trackingcited by 56
- 2022APT-36K: A Large-scale Benchmark for Animal Pose Estimation and Trackingcited by 56
- 2022Beyond 3D Siamese Tracking: A Motion-Centric Paradigm for 3D Single Object Tracking in Point Cloudscited by 55
- 20213D Siamese Voxel-to-BEV Tracker for Sparse Point Cloudscited by 54
- 2023Exploring Lightweight Hierarchical Vision Transformers for Efficient Visual Trackingcited by 53
- 2021RelationTrack: Relation-aware Multiple Object Tracking with Decoupled Representationcited by 52
50 most cited of 446 All 446 (JSON)
- 2026Difference Feature Map Distillation: Transferring Inter-Sample Relational Knowledge Towards Efficient Transformer-Based Tracking5 Oct 2026
- 2026Back-Tracking from Clarity: Self-Learning to See Text from Afar26 Sep 2026
- 2026SBMVTrack: Spike-Budgeted Multi-View Learning for Power-Efficient UAV Tracking21 Sep 2026
- 2026Longitudinal tracking of multiple sclerosis lesions in the spinal cord: A validation study8 Sep 2026
- 2026Continuous Token-Level Spatio-Temporal Context Modeling for Visual Object Tracking7 Sep 2026
- 2026Efficient Language-to-Vision Feature Injection for Referring Single-Object Tracking29 Aug 2026
- 2026MaST: Motion-aware Sparse Pipeline for Lightweight Object Tracking25 Aug 2026
- 2026FeedbackTrack: Visual-Cortex-Inspired Cross-Frame Feedback for Transformer Tracking10 Aug 2026
- 2026Models as Tools: An Agentic Coordination Framework for Unified Multimodal Visual Tracking1 Aug 2026
- 2026Semantic-Aware Temporal Adaptation for UAV Anti-UAV Tracking29 Jul 2026
- 2026Counterfactual Motion Reliability Learning for Robust UAV Tracking25 Jul 2026
- 2026AdvSerial: Physical Adversarial Attacks on Infrastructure-mounted Pedestrian Detectors via Semantic Feature Suppression19 Jul 2026
38 more
- 2026Banshee: Target Switch Attacks on Gimbal-Stabilized Visual Tracking Systems via Acoustic Injection10 Jul 2026
- 2026SFDATrack: Generalized Source-Free Domain Adaptive Tracking Under Adverse Weather Conditions1 Jul 2026
- 2026SUMO: Segment and Track Any Motion with Nonlinear State Space Models29 Jun 2026
- 2026Leveraging Text-to-Image Diffusion Models for Unsupervised Visual Object Tracking26 May 2026
- 2026Segment Anything with Motion, Geometry, and Semantic Adaptation for Complex Nonlinear Visual Object Tracking21 May 2026
- 2026End-to-End Unmixing with Material Prompts for Hyperspectral Object Tracking20 May 2026
- 2026An Efficient Token Compression Framework for Visual Object Tracking8 May 2026
- 2026Boosting Self-Supervised Tracking with Contextual Prompts and Noise Learning7 May 2026
- 2026Unified Multimodal Visual Tracking with Dual Mixture-of-Experts5 May 2026
- 2026Instance-level Visual Active Tracking with Occlusion-Aware Planning23 Apr 2026
- 2026A Vision-Language-Action Model for Adaptive Ultrasound-Guided Needle Insertion and Needle Tracking22 Apr 2026
- 2026STORM: End-to-End Referring Multi-Object Tracking in Videos12 Apr 2026
- 2026Spatial Orthogonal Refinement for Robust RGB-Event Visual Object Tracking29 Mar 2026
- 2026Video Understanding: From Geometry and Semantics to Unified Models18 Mar 2026
- 2026Geometric-Topological Perception and Motion Prior for Real-Time Satellite Video Object Tracking8 Mar 2026
- 2026Search Multilayer Perceptron-Based Fusion for Efficient and Accurate Siamese Tracking2 Mar 2026
- 2026Uncertainty-Guided Inference-Time Depth Adaptation for Transformer-Based Visual Tracking18 Feb 2026
- 2026GOT-JEPA: Generic Object Tracking with Model Adaptation and Occlusion Handling using Joint-Embedding Predictive Architecture16 Feb 2026
- 2026GOT-Edit: Geometry-Aware Generic Object Tracking via Online Model Editing9 Feb 2026
- 2026FARTrack: Fast Autoregressive Visual Tracking with High Performance3 Feb 2026
- 2026SMTrack: State-Aware Mamba for Efficient Temporal Modeling in Visual Tracking2 Feb 2026
- 2026Detector-Augmented SAMURAI for Long-Duration Drone Tracking8 Jan 2026
- 2025How Far are Modern Trackers from UAV-Anti-UAV? A Million-Scale Benchmark and New Baseline8 Dec 2025
- 2025Infrared UAV Target Tracking with Dynamic Feature Refinement and Global Contextual Attention Knowledge Distillation4 Dec 2025
- 2025UAUTrack: Towards Unified Multimodal Anti-UAV Visual Tracking2 Dec 2025
- 2025MANTA: Physics-Informed Generalized Underwater Object Tracking28 Nov 2025
- 2025Context-Aware Token Pruning and Discriminative Selective Attention for Transformer Tracking25 Nov 2025
- 2025A Tri-Modal Dataset and a Baseline System for Tracking Unmanned Aerial Vehicles23 Nov 2025
- 2025SwiTrack: Tri-State Switch for Cross-Modal Object Tracking20 Nov 2025
- 2025UniSOT: A Unified Framework for Multi-Modality Single Object Tracking3 Nov 2025
- 2025MATrack: Efficient Multiscale Adaptive Tracker for Real-Time Nighttime UAV Operations24 Oct 2025
- 2025DPTrack:Directional Kernel-Guided Prompt Learning for Robust Nighttime Aerial Tracking17 Oct 2025
- 2025Deep Learning-based Lightweight RGB Object Tracking for Augmented Reality Devices4 Oct 2025
- 2025Distractor-Aware Memory-Based Visual Object Tracking17 Sep 2025
- 2025Hyperspectral Mamba for Hyperspectral Object Tracking10 Sep 2025
- 2025Omni Survey for Multimodality Analysis in Visual Object Tracking18 Aug 2025
- 2025Multi-State Tracker: Enhancing Efficient Object Tracking via Multi-State Specialization and Interaction15 Aug 2025
- 2025SUIT: Spatial-Spectral Union-Intersection Interaction Network for Hyperspectral Object Tracking10 Aug 2025
50 newest of 446 All 446 (JSON)
- 2024SDSTrack: Self-Distillation Symmetric Adapter Learning for Multi-Modal Visual Object Trackingcited by 44
- 2022Tiny Object Tracking: A Large-scale Dataset and A Baselinecited by 11
- 2024General Compression Framework for Efficient Transformer Object Trackingcited by 10
- 2021Weakly-Supervised Domain Adaptation of Deep Regression Trackers via Reinforced Knowledge Distillationcited by 9
- 2023Mutual-Learning Knowledge Distillation for Nighttime UAV Trackingcited by 2
- 2026FARTrack: Fast Autoregressive Visual Tracking with High Performancecited by 2
- 2026Difference Feature Map Distillation: Transferring Inter-Sample Relational Knowledge Towards Efficient Transformer-Based Trackingcited by 0
- 2026Difference Feature Map Distillation: Transferring Inter-Sample Relational Knowledge Towards Efficient Transformer-Based Tracking5 Oct 2026
- 2026FARTrack: Fast Autoregressive Visual Tracking with High Performance3 Feb 2026
- 2024General Compression Framework for Efficient Transformer Object Tracking26 Sep 2024
- 2024SDSTrack: Self-Distillation Symmetric Adapter Learning for Multi-Modal Visual Object Tracking24 Mar 2024
- 2023Mutual-Learning Knowledge Distillation for Nighttime UAV Tracking13 Dec 2023
- 2022Tiny Object Tracking: A Large-scale Dataset and A Baseline11 Feb 2022
- 2021Weakly-Supervised Domain Adaptation of Deep Regression Trackers via Reinforced Knowledge Distillation26 Mar 2021
- 2024Exploring Enhanced Contextual Information for Video-Level Object Trackingcited by 37
- 2024Robust Tracking via Mamba-based Context-aware Token Learningcited by 15
- 2024MambaXCTrack: Mamba-based Tracker with SSM Cross-correlation and Motion Prompt for Ultrasound Needle Trackingcited by 4
- 2025MrTrack: Register Mamba for Needle Tracking with Rapid Reciprocating Motion during Ultrasound-Guided Aspiration Biopsycited by 2
- 2025SMMT: Siamese Motion Mamba with Self-attention for Thermal Infrared Target Trackingcited by 1
- 2026SMTrack: State-Aware Mamba for Efficient Temporal Modeling in Visual Trackingcited by 1
- 2026SMTrack: State-Aware Mamba for Efficient Temporal Modeling in Visual Tracking2 Feb 2026
- 2025MrTrack: Register Mamba for Needle Tracking with Rapid Reciprocating Motion during Ultrasound-Guided Aspiration Biopsy14 May 2025
- 2025SMMT: Siamese Motion Mamba with Self-attention for Thermal Infrared Target Tracking7 May 2025
- 2024Robust Tracking via Mamba-based Context-aware Token Learning18 Dec 2024
- 2024Exploring Enhanced Contextual Information for Video-Level Object Tracking15 Dec 2024
- 2024MambaXCTrack: Mamba-based Tracker with SSM Cross-correlation and Motion Prompt for Ultrasound Needle Tracking13 Nov 2024
- 2024Diff-Tracker: Text-to-Image Diffusion Models are Unsupervised Trackerscited by 24
- 2025DeTrack: In-model Latent Denoising Learning for Visual Object Trackingcited by 5
- 2024DaDiff: Domain-aware Diffusion Model for Nighttime UAV Trackingcited by 1
- 2026Leveraging Text-to-Image Diffusion Models for Unsupervised Visual Object Trackingcited by 1
- 2026Leveraging Text-to-Image Diffusion Models for Unsupervised Visual Object Tracking26 May 2026
- 2025DeTrack: In-model Latent Denoising Learning for Visual Object Tracking5 Jan 2025
- 2024DaDiff: Domain-aware Diffusion Model for Nighttime UAV Tracking16 Oct 2024
- 2024Diff-Tracker: Text-to-Image Diffusion Models are Unsupervised Trackers11 Jul 2024
- 2025InternVideo2.5: Empowering Video MLLMs with Long and Rich Context Modelingcited by 211
- 2024Elysium: Exploring Object-level Perception in Videos via MLLMcited by 48
- 2023Merlin:Empowering Multimodal LLMs with Foresight Mindscited by 46
- 2024Task Preference Optimization: Improving Multimodal Large Language Models with Vision Task Alignmentcited by 29
- 2025InternVideo2.5: Empowering Video MLLMs with Long and Rich Context Modeling21 Jan 2025
- 2024Task Preference Optimization: Improving Multimodal Large Language Models with Vision Task Alignment26 Dec 2024
- 2024Elysium: Exploring Object-level Perception in Videos via MLLM25 Mar 2024
- 2023Merlin:Empowering Multimodal LLMs with Foresight Minds30 Nov 2023
- 2021Transformer Trackingcited by 412
- 2021Learning Spatio-Temporal Transformer for Visual Trackingcited by 350
- 2022Joint Feature Learning and Relation Modeling for Tracking: A One-Stream Frameworkcited by 330
- 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 317
- 2022MixFormer: End-to-End Tracking with Iterative Mixed Attentioncited by 281
- 2021Transformer Meets Tracker: Exploiting Temporal Context for Robust Visual Trackingcited by 220
- 2021Hypercorrelation Squeeze for Few-Shot Segmentationcited by 193
- 2023Universal Instance Perception as Object Discovery and Retrievalcited by 192
- 2023Visual Prompt Multi-Modal Trackingcited by 142
- 2022AiATrack: Attention in Attention for Transformer Visual Trackingcited by 137
- 2021Learning Target Candidate Association to Keep Track of What Not to Trackcited by 131
- 2021VisEvent: Reliable Object Tracking via Collaboration of Frame and Event Flowscited by 129
12 most cited of 421 All 421 (JSON)
- 2026Back-Tracking from Clarity: Self-Learning to See Text from Afar26 Sep 2026
- 2026SBMVTrack: Spike-Budgeted Multi-View Learning for Power-Efficient UAV Tracking21 Sep 2026
- 2026Longitudinal tracking of multiple sclerosis lesions in the spinal cord: A validation study8 Sep 2026
- 2026Continuous Token-Level Spatio-Temporal Context Modeling for Visual Object Tracking7 Sep 2026
- 2026Efficient Language-to-Vision Feature Injection for Referring Single-Object Tracking29 Aug 2026
- 2026MaST: Motion-aware Sparse Pipeline for Lightweight Object Tracking25 Aug 2026
- 2026FeedbackTrack: Visual-Cortex-Inspired Cross-Frame Feedback for Transformer Tracking10 Aug 2026
- 2026Semantic-Aware Temporal Adaptation for UAV Anti-UAV Tracking29 Jul 2026
- 2026Counterfactual Motion Reliability Learning for Robust UAV Tracking25 Jul 2026
- 2026AdvSerial: Physical Adversarial Attacks on Infrastructure-mounted Pedestrian Detectors via Semantic Feature Suppression19 Jul 2026
- 2026Banshee: Target Switch Attacks on Gimbal-Stabilized Visual Tracking Systems via Acoustic Injection10 Jul 2026
- 2026SFDATrack: Generalized Source-Free Domain Adaptive Tracking Under Adverse Weather Conditions1 Jul 2026
12 newest of 421 All 421 (JSON)