Fully-Convolutional Siamese Networks for Object Tracking
Not on the map. Why?
Abstract (arXiv)
The problem of arbitrary object tracking has traditionally been tackled by learning a model of the object's appearance exclusively online, using as sole training data the video itself. Despite the success of these methods, their online-only approach inherently limits the richness of the model they can learn. Recently, several attempts have been made to exploit the expressive power of deep convolutional networks. However, when the object to track is not known beforehand, it is necessary to perform Stochastic Gradient Descent online to adapt the weights of the network, severely compromising the speed of the system. In this paper we equip a basic tracking algorithm with a novel fully-convolutional Siamese network trained end-to-end on the ILSVRC15 dataset for object detection in video. Our tracker operates at frame-rates beyond real-time and, despite its extreme simplicity, achieves state-of-the-art performance in multiple benchmarks.
Key facts. Cited by 566 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Jun 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2018: 1; 2019: 0; 2020: 0; 2021: 145; 2022: 120; 2023: 96; 2024: 97; 2025: 66; 2026: 41.
566 papers.
Sort:
By area:
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 812
- 2023CoTracker: It is Better to Track Togethercited by 516
- 2021Transformer Trackingcited by 412
- 2021Learning Spatio-Temporal Transformer for Visual Trackingcited by 348
- 2022Joint Feature Learning and Relation Modeling for Tracking: A One-Stream Frameworkcited by 328
- 2023Perception Test: A Diagnostic Benchmark for Multimodal Video Modelscited by 310
- 2022MixFormer: End-to-End Tracking with Iterative Mixed Attentioncited by 278
- 2021Transformer Meets Tracker: Exploiting Temporal Context for Robust Visual Trackingcited by 220
- 2025InternVideo2.5: Empowering Video MLLMs with Long and Rich Context Modelingcited by 203
- 2021Rethinking Space-Time Networks with Improved Memory Coverage for Efficient Video Object Segmentationcited by 200
- 2023Universal Instance Perception as Object Discovery and Retrievalcited by 190
- 2021PiCIE: Unsupervised Semantic Segmentation using Invariance and Equivariance in Clusteringcited by 163
38 more
- 2023Visual Prompt Multi-Modal Trackingcited by 141
- 2022AiATrack: Attention in Attention for Transformer Visual Trackingcited by 137
- 2021Learning Target Candidate Association to Keep Track of What Not to Trackcited by 131
- 2021VisEvent: Reliable Object Tracking via Collaboration of Frame and Event Flowscited by 128
- 2021SwinTrack: A Simple and Strong Baseline for Transformer Trackingcited by 126
- 2021Towards More Flexible and Accurate Object Tracking with Natural Language: Algorithms and Benchmarkcited by 124
- 2022Backbone is All Your Need: A Simplified Architecture for Visual Object Trackingcited by 119
- 2024One Token to Seg Them All: Language Instructed Reasoning Segmentation in Videoscited by 99
- 2021Locate then Segment: A Strong Pipeline for Referring Image Segmentationcited by 98
- 2022Towards Grand Unification of Object Trackingcited by 93
- 2023Generalized Relation Modeling for Transformer Trackingcited by 93
- 2021STMTrack: Template-free Visual Tracking with Space-time Memory Networkscited by 91
- 2022Visible-Thermal UAV Tracking: A Large-Scale Benchmark and New Baselinecited by 90
- 2021Object Tracking by Jointly Exploiting Frame and Event Domaincited by 83
- 2021LightTrack: Finding Lightweight Neural Networks for Object Tracking via One-Shot Architecture Searchcited by 82
- 2021Rethinking Self-supervised Correspondence Learning: A Video Frame-level Similarity Perspectivecited by 81
- 2021Monocular Quasi-Dense 3D Object Trackingcited by 80
- 2022Represent, Compare, and Learn: A Similarity-Aware Framework for Class-Agnostic Countingcited by 80
- 2023Robust Object Modeling for Visual Trackingcited by 80
- 2024Autoregressive Queries for Adaptive Tracking with Spatio-TemporalTransformerscited by 76
- 2022Transformer Tracking with Cyclic Shifting Window Attentioncited by 75
- 2023Siamese Masked Autoencoderscited by 75
- 2023Event Stream-based Visual Object Tracking: A High-Resolution Benchmark Dataset and A Novel Baselinecited by 73
- 2021HiFT: Hierarchical Feature Transformer for Aerial Trackingcited by 72
- 2023HIPTrack: Visual Tracking with Historical Promptscited by 71
- 2024Tracking Meets LoRA: Faster Training, Larger Model, Stronger Performancecited by 70
- 2022TCTrack: Temporal Contexts for Aerial Trackingcited by 69
- 2021Multiple Object Tracking with Correlation Learningcited by 67
- 2021Learn to Match: Automatic Matching Network Design for Visual Trackingcited by 67
- 2021Box-Aware Feature Enhancement for Single Object Tracking on Point Cloudscited by 66
- 2021DepthTrack : Unveiling the Power of RGBD Trackingcited by 66
- 2021PTTR: Relational 3D Point Cloud Object Tracking with Transformercited by 65
- 2022A Low-Shot Object Counting Network With Iterative Prototype Adaptationcited by 65
- 2024OneTracker: Unifying Visual Object Tracking with Foundation Models and Efficient Tuningcited by 64
- 2021Learning Position and Target Consistency for Memory-based Video Object Segmentationcited by 63
- 2024A Distractor-Aware Memory for Visual Object Tracking with SAM2cited by 63
- 2021SiamMOT: Siamese Multi-Object Trackingcited by 62
- 2021Do Different Tracking Tasks Require Different Appearance Models?cited by 62
50 most cited of 566 All 566 (JSON)
- 2026Back-Tracking from Clarity: Self-Learning to See Text from Afar26 Sep 2026
- 2026TFTrack: A Template-Free Framework for Efficient 3D Point Cloud Tracking7 Sep 2026
- 2026Continuous Token-Level Spatio-Temporal Context Modeling for Visual Object Tracking7 Sep 2026
- 2026Learning to Track from Privileged Target Appearances2 Sep 2026
- 2026MaST: Motion-aware Sparse Pipeline for Lightweight Object Tracking25 Aug 2026
- 2026MSP-Net: Manifold-Guided Spectral Prompt Network for Hyperspectral Object Tracking10 Aug 2026
- 2026AnyTrack: Unifying Visual Object Tracking with Any Modalities7 Aug 2026
- 2026Models as Tools: An Agentic Coordination Framework for Unified Multimodal Visual Tracking1 Aug 2026
- 2026Semantic-Aware Temporal Adaptation for UAV Anti-UAV Tracking29 Jul 2026
- 2026Counterfactual Motion Reliability Learning for Robust UAV Tracking25 Jul 2026
- 2026SFDATrack: Generalized Source-Free Domain Adaptive Tracking Under Adverse Weather Conditions1 Jul 2026
- 2026DrivenMorph: Bridging Attention Mechanism and Variational Image Registration via Difference Modeling29 Jun 2026
38 more
- 2026SUMO: Segment and Track Any Motion with Nonlinear State Space Models29 Jun 2026
- 2026VisCritic: Visual State Comparison as Process Reward for GUI Agents23 Jun 2026
- 20264DVLT: Dynamic Scene Understanding with Worldline-Centered Vision-Language Tracking21 Jun 2026
- 2026Dual-branch Distilled Transformer for Efficient Asymmetric UAV Tracking27 May 2026
- 2026Leveraging Text-to-Image Diffusion Models for Unsupervised Visual Object Tracking26 May 2026
- 2026Segment Anything with Motion, Geometry, and Semantic Adaptation for Complex Nonlinear Visual Object Tracking21 May 2026
- 2026An Efficient Token Compression Framework for Visual Object Tracking8 May 2026
- 2026VL-UniTrack: A Unified Framework with Visual-Language Prompts for UAV-Ground Visual Tracking6 May 2026
- 2026Unified Multimodal Visual Tracking with Dual Mixture-of-Experts5 May 2026
- 2026Instance-level Visual Active Tracking with Occlusion-Aware Planning23 Apr 2026
- 2026STORM: End-to-End Referring Multi-Object Tracking in Videos12 Apr 2026
- 2026Interactive Tracking: A Human-in-the-Loop Paradigm with Memory-Augmented Adaptation2 Apr 2026
- 2026Polarization-Based Eye Tracking with Personalized Siamese Architectures26 Mar 2026
- 2026Learning Progressive Adaptation for Multi-Modal Tracking22 Mar 2026
- 2026Geometric-Topological Perception and Motion Prior for Real-Time Satellite Video Object Tracking8 Mar 2026
- 2026EdgeDAM: Real-time Object Tracking for Mobile Devices5 Mar 2026
- 2026Architecture and evaluation protocol for transformer-based visual object tracking in UAV applications4 Mar 2026
- 2026Search Multilayer Perceptron-Based Fusion for Efficient and Accurate Siamese Tracking2 Mar 2026
- 2026MUOT_3M: A 3 Million Frame Multimodal Underwater Benchmark and the MUTrack Tracking Method20 Feb 2026
- 2026Uncertainty-Guided Inference-Time Depth Adaptation for Transformer-Based Visual Tracking18 Feb 2026
- 2026GOT-JEPA: Generic Object Tracking with Model Adaptation and Occlusion Handling using Joint-Embedding Predictive Architecture16 Feb 2026
- 2026Detecting Object Tracking Failure via Sequential Hypothesis Testing13 Feb 2026
- 2026GOT-Edit: Geometry-Aware Generic Object Tracking via Online Model Editing9 Feb 2026
- 2026FARTrack: Fast Autoregressive Visual Tracking with High Performance3 Feb 2026
- 2026SMTrack: State-Aware Mamba for Efficient Temporal Modeling in Visual Tracking2 Feb 2026
- 2026UBATrack: Spatio-Temporal State Space Model for General Multi-Modal Tracking21 Jan 2026
- 2026Exploring Reliable Spatiotemporal Dependencies for Efficient Visual Tracking14 Jan 2026
- 2026Detector-Augmented SAMURAI for Long-Duration Drone Tracking8 Jan 2026
- 2026Better, But Not Sufficient: Testing Video ANNs Against Macaque IT Dynamics6 Jan 2026
- 2025VPTracker: Global Vision-Language Tracking via Visual Prompt28 Dec 2025
- 2025Recurrent Video Masked Autoencoders15 Dec 2025
- 2025How Far are Modern Trackers from UAV-Anti-UAV? A Million-Scale Benchmark and New Baseline8 Dec 2025
- 2025Infrared UAV Target Tracking with Dynamic Feature Refinement and Global Contextual Attention Knowledge Distillation4 Dec 2025
- 2025MANTA: Physics-Informed Generalized Underwater Object Tracking28 Nov 2025
- 2025Context-Aware Token Pruning and Discriminative Selective Attention for Transformer Tracking25 Nov 2025
- 2025SwiTrack: Tri-State Switch for Cross-Modal Object Tracking20 Nov 2025
- 2025UniSOT: A Unified Framework for Multi-Modality Single Object Tracking3 Nov 2025
- 2025Deep Learning-based Lightweight RGB Object Tracking for Augmented Reality Devices4 Oct 2025
50 newest of 566 All 566 (JSON)
- 2024Mamba-FETrack: Frame-Event Tracking via State Space Modelcited by 21
- 2024Robust Tracking via Mamba-based Context-aware Token Learningcited by 15
- 2024MambaXCTrack: Mamba-based Tracker with SSM Cross-correlation and Motion Prompt for Ultrasound Needle Trackingcited by 4
- 2025SMMT: Siamese Motion Mamba with Self-attention for Thermal Infrared Target Trackingcited by 1
- 2026SMTrack: State-Aware Mamba for Efficient Temporal Modeling in Visual Trackingcited by 1
- 2026UBATrack: Spatio-Temporal State Space Model for General Multi-Modal Trackingcited by 0
- 2026SMTrack: State-Aware Mamba for Efficient Temporal Modeling in Visual Tracking2 Feb 2026
- 2026UBATrack: Spatio-Temporal State Space Model for General Multi-Modal Tracking21 Jan 2026
- 2025SMMT: Siamese Motion Mamba with Self-attention for Thermal Infrared Target Tracking7 May 2025
- 2024Robust Tracking via Mamba-based Context-aware Token Learning18 Dec 2024
- 2024MambaXCTrack: Mamba-based Tracker with SSM Cross-correlation and Motion Prompt for Ultrasound Needle Tracking13 Nov 2024
- 2024Mamba-FETrack: Frame-Event Tracking via State Space Model28 Apr 2024
- 2024Diff-Tracker: Text-to-Image Diffusion Models are Unsupervised Trackerscited by 24
- 2025DeTrack: In-model Latent Denoising Learning for Visual Object Trackingcited by 5
- 2025Towards Effective and Efficient Adversarial Defense with Diffusion Models for Robust Visual Trackingcited by 2
- 2024DaDiff: Domain-aware Diffusion Model for Nighttime UAV Trackingcited by 1
- 2026Leveraging Text-to-Image Diffusion Models for Unsupervised Visual Object Trackingcited by 1
- 2026Leveraging Text-to-Image Diffusion Models for Unsupervised Visual Object Tracking26 May 2026
- 2025Towards Effective and Efficient Adversarial Defense with Diffusion Models for Robust Visual Tracking31 May 2025
- 2025DeTrack: In-model Latent Denoising Learning for Visual Object Tracking5 Jan 2025
- 2024DaDiff: Domain-aware Diffusion Model for Nighttime UAV Tracking16 Oct 2024
- 2024Diff-Tracker: Text-to-Image Diffusion Models are Unsupervised Trackers11 Jul 2024
- 2023Perception Test: A Diagnostic Benchmark for Multimodal Video Modelscited by 310
- 2024One Token to Seg Them All: Language Instructed Reasoning Segmentation in Videoscited by 99
- 2025VideoChat-R1.5: Visual Test-Time Scaling to Reinforce Multimodal Reasoning by Iterative Perceptioncited by 60
- 2023Tracking with Human-Intent Reasoningcited by 32
- 2025ReasoningTrack: Chain-of-Thought Reasoning for Long-term Vision-Language Trackingcited by 9
- 2025VideoChat-R1.5: Visual Test-Time Scaling to Reinforce Multimodal Reasoning by Iterative Perception25 Sep 2025
- 2025ReasoningTrack: Chain-of-Thought Reasoning for Long-term Vision-Language Tracking7 Aug 2025
- 2024One Token to Seg Them All: Language Instructed Reasoning Segmentation in Videos29 Sep 2024
- 2023Tracking with Human-Intent Reasoning29 Dec 2023
- 2023Perception Test: A Diagnostic Benchmark for Multimodal Video Models23 May 2023
- 2025InternVideo2.5: Empowering Video MLLMs with Long and Rich Context Modelingcited by 203
- 2024Elysium: Exploring Object-level Perception in Videos via MLLMcited by 48
- 2023Merlin:Empowering Multimodal LLMs with Foresight Mindscited by 46
- 2024Task Preference Optimization: Improving Multimodal Large Language Models with Vision Task Alignmentcited by 29
- 2026VisCritic: Visual State Comparison as Process Reward for GUI Agentscited by 0
- 2026VisCritic: Visual State Comparison as Process Reward for GUI Agents23 Jun 2026
- 2025InternVideo2.5: Empowering Video MLLMs with Long and Rich Context Modeling21 Jan 2025
- 2024Task Preference Optimization: Improving Multimodal Large Language Models with Vision Task Alignment26 Dec 2024
- 2024Elysium: Exploring Object-level Perception in Videos via MLLM25 Mar 2024
- 2023Merlin:Empowering Multimodal LLMs with Foresight Minds30 Nov 2023
- 2018Learning from Demonstration in the Wildcited by 25
- 2018Learning from Demonstration in the Wild8 Nov 2018
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 812
- 2023CoTracker: It is Better to Track Togethercited by 516
- 2021Transformer Trackingcited by 412
- 2021Learning Spatio-Temporal Transformer for Visual Trackingcited by 348
- 2022Joint Feature Learning and Relation Modeling for Tracking: A One-Stream Frameworkcited by 328
- 2022MixFormer: End-to-End Tracking with Iterative Mixed Attentioncited by 278
- 2021Transformer Meets Tracker: Exploiting Temporal Context for Robust Visual Trackingcited by 220
- 2021Rethinking Space-Time Networks with Improved Memory Coverage for Efficient Video Object Segmentationcited by 200
- 2023Universal Instance Perception as Object Discovery and Retrievalcited by 190
- 2021PiCIE: Unsupervised Semantic Segmentation using Invariance and Equivariance in Clusteringcited by 163
- 2023Visual Prompt Multi-Modal Trackingcited by 141
- 2022AiATrack: Attention in Attention for Transformer Visual Trackingcited by 137
12 most cited of 542 All 542 (JSON)
- 2026Back-Tracking from Clarity: Self-Learning to See Text from Afar26 Sep 2026
- 2026TFTrack: A Template-Free Framework for Efficient 3D Point Cloud Tracking7 Sep 2026
- 2026Continuous Token-Level Spatio-Temporal Context Modeling for Visual Object Tracking7 Sep 2026
- 2026Learning to Track from Privileged Target Appearances2 Sep 2026
- 2026MaST: Motion-aware Sparse Pipeline for Lightweight Object Tracking25 Aug 2026
- 2026MSP-Net: Manifold-Guided Spectral Prompt Network for Hyperspectral Object Tracking10 Aug 2026
- 2026AnyTrack: Unifying Visual Object Tracking with Any Modalities7 Aug 2026
- 2026Semantic-Aware Temporal Adaptation for UAV Anti-UAV Tracking29 Jul 2026
- 2026Counterfactual Motion Reliability Learning for Robust UAV Tracking25 Jul 2026
- 2026SFDATrack: Generalized Source-Free Domain Adaptive Tracking Under Adverse Weather Conditions1 Jul 2026
- 2026DrivenMorph: Bridging Attention Mechanism and Variational Image Registration via Difference Modeling29 Jun 2026
- 2026SUMO: Segment and Track Any Motion with Nonlinear State Space Models29 Jun 2026
12 newest of 542 All 542 (JSON)