Siam R-CNN: Visual Tracking by Re-Detection
Not on the map. Why?
Abstract (arXiv)
We present Siam R-CNN, a Siamese re-detection architecture which unleashes the full power of two-stage object detection approaches for visual object tracking. We combine this with a novel tracklet-based dynamic programming algorithm, which takes advantage of re-detections of both the first-frame template and previous-frame predictions, to model the full history of both the object to be tracked and potential distractor objects. This enables our approach to make better tracking decisions, as well as to re-detect tracked objects after long occlusion. Finally, we propose a novel hard example mining strategy to improve Siam R-CNN's robustness to similar looking objects. Siam R-CNN achieves the current best performance on ten tracking benchmarks, with especially strong results for long-term tracking. We make our code and models available at www.vision.rwth-aachen.de/page/siamrcnn.
Key facts. Cited by 174 papers in the map (data through 14 Oct 2026). First posted on arXiv 28 Nov 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 42; 2022: 33; 2023: 37; 2024: 26; 2025: 24; 2026: 12.
174 papers.
Sort:
By area:
- 2021Transformer Trackingcited by 412
- 2021Learning Spatio-Temporal Transformer for Visual Trackingcited by 350
- 2022Joint Feature Learning and Relation Modeling for Tracking: A One-Stream Frameworkcited by 330
- 2022MixFormer: End-to-End Tracking with Iterative Mixed Attentioncited by 281
- 2021Transformer Meets Tracker: Exploiting Temporal Context for Robust Visual Trackingcited by 220
- 2023Universal Instance Perception as Object Discovery and Retrievalcited by 192
- 2021Learning Target Candidate Association to Keep Track of What Not to Trackcited by 131
- 2021VisEvent: Reliable Object Tracking via Collaboration of Frame and Event Flowscited by 129
- 2024ODTrack: Online Dense Temporal Token Learning for Visual Trackingcited by 129
- 2021Towards More Flexible and Accurate Object Tracking with Natural Language: Algorithms and Benchmarkcited by 126
- 2021SwinTrack: A Simple and Strong Baseline for Transformer Trackingcited by 126
- 2022Transforming Model Prediction for Trackingcited by 117
38 more
- 2022Towards Grand Unification of Object Trackingcited by 93
- 2021STMTrack: Template-free Visual Tracking with Space-time Memory Networkscited by 91
- 2021LightTrack: Finding Lightweight Neural Networks for Object Tracking via One-Shot Architecture Searchcited by 82
- 2023Robust Object Modeling for Visual Trackingcited by 80
- 2022Transformer Tracking with Cyclic Shifting Window Attentioncited by 75
- 2023General Object Foundation Model for Images and Videos at Scalecited by 71
- 2023Single-Model and Any-Modality for Video Object Trackingcited by 65
- 2024OneTracker: Unifying Visual Object Tracking with Foundation Models and Efficient Tuningcited by 65
- 2021Joint Inductive and Transductive Learning for Video Object Segmentationcited by 61
- 2022Accelerating DETR Convergence via Semantic-Aligned Matchingcited by 58
- 20213D Siamese Voxel-to-BEV Tracker for Sparse Point Cloudscited by 54
- 2022Revisiting Color-Event based Tracking: A Unified Network, Dataset, and Metriccited by 52
- 2023Compact Transformer Tracker with Correlative Masked Modelingcited by 50
- 2021Efficient Visual Tracking with Exemplar Transformerscited by 48
- 2022Divert More Attention to Vision-Language Trackingcited by 47
- 2021Visual Object Tracking with Discriminative Filters and Siamese Networks: A Survey and Outlookcited by 46
- 20213D-SiamRPN: An End-to-End Learning Method for Real-Time 3D Single Object Tracking Using Raw Point Cloudcited by 45
- 2024SDSTrack: Self-Distillation Symmetric Adapter Learning for Multi-Modal Visual Object Trackingcited by 44
- 2023Cross-modal Orthogonal High-rank Augmentation for RGB-Event Transformer-trackerscited by 43
- 2022Robust Visual Tracking by Segmentationcited by 38
- 2024Exploring Enhanced Contextual Information for Video-Level Object Trackingcited by 37
- 2023CiteTracker: Correlating Image and Text for Visual Trackingcited by 36
- 2021Anti-UAV: A Large Multi-Modal Benchmark for UAV Trackingcited by 31
- 2025Towards Universal Modal Tracking with Online Dense Temporal Token Learningcited by 30
- 2022Real-time 3D Single Object Tracking with Transformercited by 27
- 2023EgoTracks: A Long-term Egocentric Visual Object Tracking Datasetcited by 27
- 2023All in One: Exploring Unified Vision-Language Tracking with Multi-Modal Alignmentcited by 27
- 2023Towards Real-World Visual Tracking with Temporal Contextscited by 26
- 2021IoU Attack: Towards Temporally Coherent Black-Box Adversarial Attack for Visual Object Trackingcited by 25
- 2021Slot-VPS: Object-centric Representation Learning for Video Panoptic Segmentationcited by 24
- 2022Guide Local Feature Matching by Overlap Estimationcited by 24
- 2022Efficient Visual Tracking via Hierarchical Cross-Attention Transformercited by 24
- 2024DTLLM-VLT: Diverse Text Generation for Visual Language Tracking Based on LLMcited by 24
- 2025Exploring Decoupled Spatio-Temporal Consistency Learning and Self-Prompting Evolution for Self-Supervised Trackingcited by 23
- 2023DropMAE: Learning Representations via Masked Autoencoders with Spatial-Attention Dropout for Temporal Matching Taskscited by 22
- 2023UniRef++: Segment Every Reference Object in Spatial and Temporal Spacescited by 22
- 2024OmniVid: A Generative Framework for Universal Video Understandingcited by 22
- 2021Learning to Track Objects from Unlabeled Videoscited by 21
50 most cited of 174 All 174 (JSON)
- 2026Towards Compact Unified Multimodal Tracking: Synergizing Knowledge Distillation with Structural Pruning2 Aug 2026
- 2026Counterfactual Motion Reliability Learning for Robust UAV Tracking25 Jul 2026
- 2026MobileSAM2: Lightweight Segment Anything for Spatial Intelligence14 Jul 2026
- 2026Active Adversarial Perturbation-driven Associative Memory Retrieval for RGB-Event Visual Object Tracking24 Jun 2026
- 2026Segment Anything with Motion, Geometry, and Semantic Adaptation for Complex Nonlinear Visual Object Tracking21 May 2026
- 2026Interactive Tracking: A Human-in-the-Loop Paradigm with Memory-Augmented Adaptation2 Apr 2026
- 2026GOT-JEPA: Generic Object Tracking with Model Adaptation and Occlusion Handling using Joint-Embedding Predictive Architecture16 Feb 2026
- 2026GOT-Edit: Geometry-Aware Generic Object Tracking via Online Model Editing9 Feb 2026
- 2026SMTrack: State-Aware Mamba for Efficient Temporal Modeling in Visual Tracking2 Feb 2026
- 2026UBATrack: Spatio-Temporal State Space Model for General Multi-Modal Tracking21 Jan 2026
- 2026Detector-Augmented SAMURAI for Long-Duration Drone Tracking8 Jan 2026
- 2026Decoupling Amplitude and Phase Attention in Frequency Domain for RGB-Event based Visual Object Tracking3 Jan 2026
38 more
- 2025Context-Aware Token Pruning and Discriminative Selective Attention for Transformer Tracking25 Nov 2025
- 2025STORM: Segment, Track, and Object Re-Localization from a Single Image12 Nov 2025
- 2025UniSOT: A Unified Framework for Multi-Modality Single Object Tracking3 Nov 2025
- 2025SOI is the Root of All Evil: Quantifying and Breaking Similar Object Interference in Single Object Tracking13 Aug 2025
- 2025DMTrack: Spatio-Temporal Multimodal Tracking via Dual-Adapter3 Aug 2025
- 2025SAMITE: Position Prompted SAM2 with Calibrated Memory for Visual Object Tracking29 Jul 2025
- 2025Exploring Decoupled Spatio-Temporal Consistency Learning and Self-Prompting Evolution for Self-Supervised Tracking29 Jul 2025
- 2025Towards Universal Modal Tracking with Online Dense Temporal Token Learning27 Jul 2025
- 2025Vision-Based Anti Unmanned Aerial Technology: Opportunities and Challenges14 Jul 2025
- 2025What You Have is What You Track: Adaptive and Robust Multimodal Tracking8 Jul 2025
- 2025Mamba-FETrack V2: Revisiting State Space Model for Frame-Event based Visual Object Tracking30 Jun 2025
- 2025Fully Spiking Neural Networks for Unified Frame-Event Object Tracking27 May 2025
- 2025Progressive Scaling Visual Object Tracking26 May 2025
- 2025Efficient Motion Prompt Learning for Robust Visual Tracking22 May 2025
- 2025A Simple Detector with Frame Dynamics is a Strong Tracker8 May 2025
- 2025FocusTrack: A Self-Adaptive Local Sampling Algorithm for Efficient Anti-UAV Tracking18 Apr 2025
- 2025COST: Contrastive One-Stage Transformer for Vision-Language Small Object Tracking2 Apr 2025
- 2025Hyperspectral Adapter for Object Tracking based on Hyperspectral Video28 Mar 2025
- 2025Dynamic Attention Mechanism in Spatiotemporal Memory Networks for Object Tracking21 Mar 2025
- 2025UncTrack: Reliable Visual Object Tracking with Uncertainty-Aware Prototype Memory Network17 Mar 2025
- 2025TrackOcc: Camera-based 4D Panoptic Occupancy Tracking11 Mar 2025
- 2025LightFC-X: Lightweight Convolutional Tracker for RGB-X Tracking25 Feb 2025
- 2025PRVQL: Progressive Knowledge-guided Refinement for Robust Egocentric Visual Query Localization11 Feb 2025
- 2025DeTrack: In-model Latent Denoising Learning for Visual Object Tracking5 Jan 2025
- 2024Exploring Enhanced Contextual Information for Video-Level Object Tracking15 Dec 2024
- 2024Online Episodic Memory Visual Query Localization with Egocentric Streaming Object Memory25 Nov 2024
- 2024DINTR: Tracking via Diffusion-based Interpolation14 Oct 2024
- 2024XS-VID: A Large-Scale Benchmark for Small Object Detection and Tracking in Videos25 Jul 2024
- 2024Adaptively Bypassing Vision Transformer Blocks for Efficient Visual Tracking12 Jun 2024
- 2024XTrack: Multimodal Training Boosts RGB-X Video Object Trackers28 May 2024
- 2024DTLLM-VLT: Diverse Text Generation for Visual Language Tracking Based on LLM20 May 2024
- 2024A Novel Bounding Box Regression Method for Single Object Tracking16 May 2024
- 2024TENet: Targetness Entanglement Incorporating with Multi-Scale Pooling and Mutually-Guided Fusion for RGB-E Object Tracking8 May 2024
- 2024RTracker: Recoverable Tracking via PN Tree Structured Memory28 Mar 2024
- 2024OmniVid: A Generative Framework for Universal Video Understanding26 Mar 2024
- 2024Exploring Dynamic Transformer for Efficient Object Tracking26 Mar 2024
- 2024Multi-attention Associate Prediction Network for Visual Tracking25 Mar 2024
- 2024SDSTrack: Self-Distillation Symmetric Adapter Learning for Multi-Modal Visual Object Tracking24 Mar 2024
50 newest of 174 All 174 (JSON)
- 2024SDSTrack: Self-Distillation Symmetric Adapter Learning for Multi-Modal Visual Object Trackingcited by 44
- 2022Tiny Object Tracking: A Large-scale Dataset and A Baselinecited by 11
- 2026MobileSAM2: Lightweight Segment Anything for Spatial Intelligencecited by 0
- 2026Towards Compact Unified Multimodal Tracking: Synergizing Knowledge Distillation with Structural Pruningcited by 0
- 2026Towards Compact Unified Multimodal Tracking: Synergizing Knowledge Distillation with Structural Pruning2 Aug 2026
- 2026MobileSAM2: Lightweight Segment Anything for Spatial Intelligence14 Jul 2026
- 2024SDSTrack: Self-Distillation Symmetric Adapter Learning for Multi-Modal Visual Object Tracking24 Mar 2024
- 2022Tiny Object Tracking: A Large-scale Dataset and A Baseline11 Feb 2022
- 2024Exploring Enhanced Contextual Information for Video-Level Object Trackingcited by 37
- 2025Mamba-FETrack V2: Revisiting State Space Model for Frame-Event based Visual Object Trackingcited by 2
- 2026SMTrack: State-Aware Mamba for Efficient Temporal Modeling in Visual Trackingcited by 1
- 2026UBATrack: Spatio-Temporal State Space Model for General Multi-Modal Trackingcited by 0
- 2026SMTrack: State-Aware Mamba for Efficient Temporal Modeling in Visual Tracking2 Feb 2026
- 2026UBATrack: Spatio-Temporal State Space Model for General Multi-Modal Tracking21 Jan 2026
- 2025Mamba-FETrack V2: Revisiting State Space Model for Frame-Event based Visual Object Tracking30 Jun 2025
- 2024Exploring Enhanced Contextual Information for Video-Level Object Tracking15 Dec 2024
- 2021Transformer Trackingcited by 412
- 2021Learning Spatio-Temporal Transformer for Visual Trackingcited by 350
- 2022Joint Feature Learning and Relation Modeling for Tracking: A One-Stream Frameworkcited by 330
- 2022MixFormer: End-to-End Tracking with Iterative Mixed Attentioncited by 281
- 2021Transformer Meets Tracker: Exploiting Temporal Context for Robust Visual Trackingcited by 220
- 2023Universal Instance Perception as Object Discovery and Retrievalcited by 192
- 2021Learning Target Candidate Association to Keep Track of What Not to Trackcited by 131
- 2021VisEvent: Reliable Object Tracking via Collaboration of Frame and Event Flowscited by 129
- 2024ODTrack: Online Dense Temporal Token Learning for Visual Trackingcited by 129
- 2021Towards More Flexible and Accurate Object Tracking with Natural Language: Algorithms and Benchmarkcited by 126
- 2021SwinTrack: A Simple and Strong Baseline for Transformer Trackingcited by 126
- 2022Transforming Model Prediction for Trackingcited by 117
12 most cited of 163 All 163 (JSON)
- 2026Counterfactual Motion Reliability Learning for Robust UAV Tracking25 Jul 2026
- 2026Active Adversarial Perturbation-driven Associative Memory Retrieval for RGB-Event Visual Object Tracking24 Jun 2026
- 2026Segment Anything with Motion, Geometry, and Semantic Adaptation for Complex Nonlinear Visual Object Tracking21 May 2026
- 2026Interactive Tracking: A Human-in-the-Loop Paradigm with Memory-Augmented Adaptation2 Apr 2026
- 2026GOT-JEPA: Generic Object Tracking with Model Adaptation and Occlusion Handling using Joint-Embedding Predictive Architecture16 Feb 2026
- 2026GOT-Edit: Geometry-Aware Generic Object Tracking via Online Model Editing9 Feb 2026
- 2026Detector-Augmented SAMURAI for Long-Duration Drone Tracking8 Jan 2026
- 2026Decoupling Amplitude and Phase Attention in Frequency Domain for RGB-Event based Visual Object Tracking3 Jan 2026
- 2025Context-Aware Token Pruning and Discriminative Selective Attention for Transformer Tracking25 Nov 2025
- 2025STORM: Segment, Track, and Object Re-Localization from a Single Image12 Nov 2025
- 2025UniSOT: A Unified Framework for Multi-Modality Single Object Tracking3 Nov 2025
- 2025SOI is the Root of All Evil: Quantifying and Breaking Similar Object Interference in Single Object Tracking13 Aug 2025
12 newest of 163 All 163 (JSON)