A Twofold Siamese Network for Real-Time Object Tracking
Not on the map. Why?
Abstract (arXiv)
Observing that Semantic features learned in an image classification task and Appearance features learned in a similarity matching task complement each other, we build a twofold Siamese network, named SA-Siam, for real-time object tracking. SA-Siam is composed of a semantic branch and an appearance branch. Each branch is a similarity-learning Siamese network. An important design choice in SA-Siam is to separately train the two branches to keep the heterogeneity of the two types of features. In addition, we propose a channel attention mechanism for the semantic branch. Channel-wise weights are computed according to the channel activations around the target position. While the inherited architecture from SiamFC citeSiamFC allows our tracker to operate beyond real-time, the twofold design and the attention mechanism significantly improve the tracking performance. The proposed SA-Siam outperforms all other real-time trackers by a large margin on OTB-2013/50/100 benchmarks.
Key facts. Cited by 62 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Feb 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 23; 2022: 13; 2023: 9; 2024: 7; 2025: 5; 2026: 5.
62 papers.
Sort:
By area:
- 2021Transformer Trackingcited by 412
- 2024Flash-VStream: Memory-Based Real-Time Understanding for Long Video Streamscited by 160
- 2025Flash-VStream: Efficient Real-Time Understanding for Long Video Streamscited by 78
- 2021SiamMOT: Siamese Multi-Object Trackingcited by 62
- 2024GuardT2I: Defending Text-to-Image Models from Adversarial Promptscited by 61
- 2022Accelerating DETR Convergence via Semantic-Aligned Matchingcited by 58
- 20213D Siamese Voxel-to-BEV Tracker for Sparse Point Cloudscited by 54
- 2021Attention, please! A survey of Neural Attention Models in Deep Learningcited by 50
- 2021Visual Object Tracking with Discriminative Filters and Siamese Networks: A Survey and Outlookcited by 45
- 2023Synchronize Feature Extracting and Matching: A Single Branch Framework for 3D Object Trackingcited by 16
- 2021Learning Tracking Representations via Dual-Branch Fully Transformer Networkscited by 15
- 2022High-Performance Transformer Trackingcited by 14
38 more
- 2024Generative AI for Unmanned Vehicle Swarms: Challenges, Applications and Opportunitiescited by 14
- 2022SiamMask: A Framework for Fast Online Object Tracking and Segmentationcited by 13
- 2023The Evolution of Distributed Systems for Graph Neural Networks and their Origin in Graph Processing and Deep Learning: A Surveycited by 13
- 2022Siamese Object Tracking for Unmanned Aerial Vehicle: A Review and Comprehensive Analysiscited by 11
- 2023T-MAE: Temporal Masked Autoencoders for Point Cloud Representation Learningcited by 11
- 2023Correlation Pyramid Network for 3D Single Object Trackingcited by 10
- 2022Learning Localization-aware Target Confidence for Siamese Visual Trackingcited by 7
- 2022Vision-based Human Fall Detection Systems using Deep Learning: A Reviewcited by 7
- 2022Semantic-Aligned Matching for Enhanced DETR Convergence and Multi-Scale Feature Fusioncited by 7
- 2026Speak While Watching: Unleashing TRUE Real-Time Video Understanding Capability of Multimodal Large Language Modelscited by 7
- 2021Multi-domain Collaborative Feature Representation for Robust Visual Object Trackingcited by 6
- 2021UHP-SOT: An Unsupervised High-Performance Single Object Trackercited by 6
- 2023FlakyFix: Using Large Language Models for Predicting Flaky Test Fix Categories and Test Code Repaircited by 6
- 2022Ad2Attack: Adaptive Adversarial Attack on Real-Time UAV Trackingcited by 5
- 2023Adaptive Siamese Tracking with a Compact Latent Networkcited by 5
- 2024Distilling Channels for Efficient Deep Trackingcited by 5
- 2021SiamEvent: Event-based Object Tracking via Edge-aware Similarity Learning with Siamese Networkscited by 4
- 2021A Discriminative Single-Shot Segmentation Network for Visual Object Trackingcited by 4
- 2021Unsupervised Lightweight Single Object Tracking with UHP-SOT++cited by 3
- 2023SiamTHN: Siamese Target Highlight Network for Visual Trackingcited by 3
- 2023DFR-Net: Density Feature Refinement Network for Image Dehazing Utilizing Haze Density Differencecited by 3
- 2024SurgiTrack: Fine-Grained Multi-Class Multi-Tool Tracking in Surgical Videoscited by 3
- 2025A Simple Detector with Frame Dynamics is a Strong Trackercited by 3
- 2025Track-On2: Enhancing Online Point Tracking with Memorycited by 3
- 2021Classification of Long Noncoding RNA Elements Using Deep Convolutional Neural Networks and Siamese Networkscited by 2
- 2021Benchmarking Deep Trackers on Aerial Videoscited by 2
- 2021Object Tracking by Detection with Visual and Motion Cuescited by 1
- 2022SiamHAN: IPv6 Address Correlation Attacks on TLS Encrypted Traffic via Siamese Heterogeneous Graph Attention Networkcited by 1
- 2022SQ-Swin: a Pretrained Siamese Quadratic Swin Transformer for Lettuce Browning Predictioncited by 1
- 2022PhysiQ: Off-site Quality Assessment of Exercise in Physical Therapycited by 1
- 2024Multi-attention Associate Prediction Network for Visual Trackingcited by 1
- 2026DeTracker: Motion-decoupled Vehicle Detection and Tracking in Unstabilized Satellite Videoscited by 1
- 2021MFST: Multi-Features Siamese Trackercited by 0
- 2021Multiple Convolutional Features in Siamese Networks for Object Trackingcited by 0
- 2021Higher Performance Visual Tracking with Dual-Modal Localizationcited by 0
- 2021Matching Targets Across Domains with RADON, the Re-Identification Across Domain Networkcited by 0
- 2021DeepTracks: Geopositioning Maritime Vehicles in Video Acquired from a Moving Platformcited by 0
- 2021Improving Object Permanence using Agent Actions and Reasoningcited by 0
50 most cited of 62 All 62 (JSON)
- 2026SFDATrack: Generalized Source-Free Domain Adaptive Tracking Under Adverse Weather Conditions1 Jul 2026
- 2026Cross Paraphrastic Invariance Learning for Hallucination Detection6 Jun 2026
- 2026Geometric-Topological Perception and Motion Prior for Real-Time Satellite Video Object Tracking8 Mar 2026
- 2026DeTracker: Motion-decoupled Vehicle Detection and Tracking in Unstabilized Satellite Videos14 Jan 2026
- 2026Speak While Watching: Unleashing TRUE Real-Time Video Understanding Capability of Multimodal Large Language Models11 Jan 2026
- 2025Track-On2: Enhancing Online Point Tracking with Memory23 Sep 2025
- 2025Flash-VStream: Efficient Real-Time Understanding for Long Video Streams30 Jun 2025
- 2025Subgraph Gaussian Embedding Contrast for Self-Supervised Graph Representation Learning29 May 2025
- 2025A Simple Detector with Frame Dynamics is a Strong Tracker8 May 2025
- 2025Dynamic Attention Mechanism in Spatiotemporal Memory Networks for Object Tracking21 Mar 2025
- 2024Distilling Channels for Efficient Deep Tracking18 Sep 2024
- 2024Predicting the Best of N Visual Trackers22 Jul 2024
38 more
- 2024Flash-VStream: Memory-Based Real-Time Understanding for Long Video Streams12 Jun 2024
- 2024SurgiTrack: Fine-Grained Multi-Class Multi-Tool Tracking in Surgical Videos30 May 2024
- 2024Multi-attention Associate Prediction Network for Visual Tracking25 Mar 2024
- 2024GuardT2I: Defending Text-to-Image Models from Adversarial Prompts3 Mar 2024
- 2024Generative AI for Unmanned Vehicle Swarms: Challenges, Applications and Opportunities28 Feb 2024
- 2023T-MAE: Temporal Masked Autoencoders for Point Cloud Representation Learning15 Dec 2023
- 2023Synchronize Feature Extracting and Matching: A Single Branch Framework for 3D Object Tracking24 Aug 2023
- 2023DFR-Net: Density Feature Refinement Network for Image Dehazing Utilizing Haze Density Difference26 Jul 2023
- 2023FlakyFix: Using Large Language Models for Predicting Flaky Test Fix Categories and Test Code Repair21 Jun 2023
- 2023Generated Graph Detection13 Jun 2023
- 2023The Evolution of Distributed Systems for Graph Neural Networks and their Origin in Graph Processing and Deep Learning: A Survey23 May 2023
- 2023Correlation Pyramid Network for 3D Single Object Tracking16 May 2023
- 2023SiamTHN: Siamese Target Highlight Network for Visual Tracking22 Mar 2023
- 2023Adaptive Siamese Tracking with a Compact Latent Network2 Feb 2023
- 2022PhysiQ: Off-site Quality Assessment of Exercise in Physical Therapy12 Nov 2022
- 2022SQ-Swin: a Pretrained Siamese Quadratic Swin Transformer for Lettuce Browning Prediction16 Sep 2022
- 2022Semantic-Aligned Matching for Enhanced DETR Convergence and Multi-Scale Feature Fusion28 Jul 2022
- 2022Vision-based Human Fall Detection Systems using Deep Learning: A Review22 Jul 2022
- 2022SiamMask: A Framework for Fast Online Object Tracking and Segmentation5 Jul 2022
- 2022Siamese Object Tracking for Unmanned Aerial Vehicle: A Review and Comprehensive Analysis9 May 2022
- 2022Learning Localization-aware Target Confidence for Siamese Visual Tracking29 Apr 2022
- 2022SiamHAN: IPv6 Address Correlation Attacks on TLS Encrypted Traffic via Siamese Heterogeneous Graph Attention Network20 Apr 2022
- 2022High-Performance Transformer Tracking25 Mar 2022
- 2022Accelerating DETR Convergence via Semantic-Aligned Matching14 Mar 2022
- 2022Dynamic Template Selection Through Change Detection for Adaptive Siamese Tracking7 Mar 2022
- 2022Ad2Attack: Adaptive Adversarial Attack on Real-Time UAV Tracking3 Mar 2022
- 2022Generative Target Update for Adaptive Siamese Tracking21 Feb 2022
- 2021A Discriminative Single-Shot Segmentation Network for Visual Object Tracking22 Dec 2021
- 2021Visual Object Tracking with Discriminative Filters and Siamese Networks: A Survey and Outlook6 Dec 2021
- 2021Learning Tracking Representations via Dual-Branch Fully Transformer Networks5 Dec 2021
- 2021Unsupervised Lightweight Single Object Tracking with UHP-SOT++15 Nov 2021
- 20213D Siamese Voxel-to-BEV Tracker for Sparse Point Clouds8 Nov 2021
- 2021Explicitly Modeling the Discriminability for Instance-Aware Visual Object Tracking28 Oct 2021
- 2021Where were my keys? -- Aggregating Spatial-Temporal Instances of Objects for Efficient Retrieval over Long Periods of Time25 Oct 2021
- 2021Protecting Anonymous Speech: A Generative Adversarial Network Methodology for Removing Stylistic Indicators in Text18 Oct 2021
- 2021UHP-SOT: An Unsupervised High-Performance Single Object Tracker5 Oct 2021
- 2021Improving Object Permanence using Agent Actions and Reasoning1 Oct 2021
- 2021SiamEvent: Event-based Object Tracking via Edge-aware Similarity Learning with Siamese Networks28 Sep 2021
50 newest of 62 All 62 (JSON)
- 2021Transformer Trackingcited by 412
- 2024Flash-VStream: Memory-Based Real-Time Understanding for Long Video Streamscited by 160
- 2021SiamMOT: Siamese Multi-Object Trackingcited by 62
- 2022Accelerating DETR Convergence via Semantic-Aligned Matchingcited by 58
- 20213D Siamese Voxel-to-BEV Tracker for Sparse Point Cloudscited by 54
- 2021Attention, please! A survey of Neural Attention Models in Deep Learningcited by 50
- 2021Visual Object Tracking with Discriminative Filters and Siamese Networks: A Survey and Outlookcited by 45
- 2023Synchronize Feature Extracting and Matching: A Single Branch Framework for 3D Object Trackingcited by 16
- 2021Learning Tracking Representations via Dual-Branch Fully Transformer Networkscited by 15
- 2022High-Performance Transformer Trackingcited by 14
- 2024Generative AI for Unmanned Vehicle Swarms: Challenges, Applications and Opportunitiescited by 14
- 2022SiamMask: A Framework for Fast Online Object Tracking and Segmentationcited by 13
12 most cited of 59 All 59 (JSON)
- 2026SFDATrack: Generalized Source-Free Domain Adaptive Tracking Under Adverse Weather Conditions1 Jul 2026
- 2026Cross Paraphrastic Invariance Learning for Hallucination Detection6 Jun 2026
- 2026Geometric-Topological Perception and Motion Prior for Real-Time Satellite Video Object Tracking8 Mar 2026
- 2026DeTracker: Motion-decoupled Vehicle Detection and Tracking in Unstabilized Satellite Videos14 Jan 2026
- 2025Track-On2: Enhancing Online Point Tracking with Memory23 Sep 2025
- 2025Subgraph Gaussian Embedding Contrast for Self-Supervised Graph Representation Learning29 May 2025
- 2025A Simple Detector with Frame Dynamics is a Strong Tracker8 May 2025
- 2025Dynamic Attention Mechanism in Spatiotemporal Memory Networks for Object Tracking21 Mar 2025
- 2024Distilling Channels for Efficient Deep Tracking18 Sep 2024
- 2024Predicting the Best of N Visual Trackers22 Jul 2024
- 2024Flash-VStream: Memory-Based Real-Time Understanding for Long Video Streams12 Jun 2024
- 2024SurgiTrack: Fine-Grained Multi-Class Multi-Tool Tracking in Surgical Videos30 May 2024
12 newest of 59 All 59 (JSON)