FEAR: Fast, Efficient, Accurate and Robust Visual Tracker
Not on the map. Why?
Abstract (arXiv)
We present FEAR, a family of fast, efficient, accurate, and robust Siamese visual trackers. We present a novel and efficient way to benefit from dual-template representation for object model adaption, which incorporates temporal information with only a single learnable parameter. We further improve the tracker architecture with a pixel-wise fusion block. By plugging-in sophisticated backbones with the abovementioned modules, FEAR-M and FEAR-L trackers surpass most Siamese trackers on several academic benchmarks in both accuracy and efficiency. Employed with the lightweight backbone, the optimized version FEAR-XS offers more than 10 times faster tracking than current Siamese trackers while maintaining near state-of-the-art results. FEAR-XS tracker is 2.4x smaller and 4.3x faster than LightTrack with superior accuracy. In addition, we expand the definition of the model efficiency by introducing FEAR benchmark that assesses energy consumption and execution speed. We show that energy consumption is a limiting factor for trackers on mobile devices. Source code, pretrained models, and evaluation protocol are available at https://github.com/PinataFarms/FEARTracker.
Key facts. Cited by 38 papers in the map (data through 14 Oct 2026). Builds on 53 of its 75 references that are in the map. First posted on arXiv 15 Dec 2021.
Builds on
53 of 75 references.
References · 53
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
- 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,577
- 2017ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devicescited by 1,200
- 2016SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model sizecited by 1,060
- 2018Efficient Neural Architecture Search via Parameter Sharingcited by 837
38 more
- 2017Focal Loss for Dense Object Detectioncited by 752
- 2016TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systemscited by 664
- 2016Fully-Convolutional Siamese Networks for Object Trackingcited by 568
- 2018Albumentations: fast and flexible image augmentationscited by 560
- 2018FBNet: Hardware-Aware Efficient ConvNet Design via Differentiable Neural Architecture Searchcited by 485
- 2018GOT-10k: A Large High-Diversity Benchmark for Generic Object Tracking in the Wildcited by 475
- 2018SiamRPN++: Evolution of Siamese Visual Tracking with Very Deep Networkscited by 446
- 2018LaSOT: A High-quality Benchmark for Large-scale Single Object Trackingcited by 429
- 2014Deep metric learning using Triplet networkcited by 422
- 2021Transformer Trackingcited by 412
- 2021Learning Spatio-Temporal Transformer for Visual Trackingcited by 350
- 2019Learning Discriminative Model Prediction for Trackingcited by 344
- 2018TrackingNet: A Large-Scale Dataset and Benchmark for Object Tracking in the Wildcited by 343
- 2018ATOM: Accurate Tracking by Overlap Maximizationcited by 285
- 2016ECO: Efficient Convolution Operators for Trackingcited by 239
- 2020Probabilistic Regression for Visual Trackingcited by 231
- 2021Transformer Meets Tracker: Exploiting Temporal Context for Robust Visual Trackingcited by 220
- 2020Ocean: Object-aware Anchor-free Trackingcited by 212
- 2015Learning Multi-Domain Convolutional Neural Networks for Visual Trackingcited by 209
- 2018Distractor-aware Siamese Networks for Visual Object Trackingcited by 187
- 2019SiamFC++: Towards Robust and Accurate Visual Tracking with Target Estimation Guidelinescited by 177
- 2019Deeper and Wider Siamese Networks for Real-Time Visual Trackingcited by 156
- 2017Need for Speed: A Benchmark for Higher Frame Rate Object Trackingcited by 137
- 2020LaSOT: A High-quality Large-scale Single Object Tracking Benchmarkcited by 132
- 2020Know Your Surroundings: Exploiting Scene Information for Object Trackingcited by 119
- 2015A Novel Performance Evaluation Methodology for Single-Target Trackerscited by 113
- 2017YouTube-BoundingBoxes: A Large High-Precision Human-Annotated Data Set for Object Detection in Videocited by 109
- 2017Shift: A Zero FLOP, Zero Parameter Alternative to Spatial Convolutionscited by 93
- 2016Learning to Track at 100 FPS with Deep Regression Networkscited by 89
- 2021LightTrack: Finding Lightweight Neural Networks for Object Tracking via One-Shot Architecture Searchcited by 82
- 2019DetNAS: Backbone Search for Object Detectioncited by 81
- 2020Alpha-Refine: Boosting Tracking Performance by Precise Bounding Box Estimationcited by 81
- 2018SqueezeNext: Hardware-Aware Neural Network Designcited by 61
- 2019Deep Learning for Visual Tracking: A Comprehensive Surveycited by 61
- 2015Staple: Complementary Learners for Real-Time Trackingcited by 60
- 2016Siamese Instance Search for Trackingcited by 60
- 2021RegNet: Self-Regulated Network for Image Classificationcited by 44
- 2015Generalizing Pooling Functions in Convolutional Neural Networks: Mixed, Gated, and Treecited by 36
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2022: 2; 2023: 12; 2024: 10; 2025: 9; 2026: 5.
38 papers.
Sort:
By area:
- 2023PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Trackingcited by 276
- 2023MixFormerV2: Efficient Fully Transformer Trackingcited by 57
- 2023Exploring Lightweight Hierarchical Vision Transformers for Efficient Visual Trackingcited by 53
- 2023Separable Self and Mixed Attention Transformers for Efficient Object Trackingcited by 31
- 2023ZoomTrack: Target-aware Non-uniform Resizing for Efficient Visual Trackingcited by 25
- 2023LiteTrack: Layer Pruning with Asynchronous Feature Extraction for Lightweight and Efficient Visual Trackingcited by 16
- 2025Two-stream Beats One-stream: Asymmetric Siamese Network for Efficient Visual Trackingcited by 15
- 2024Transformer RGBT Tracking with Spatio-Temporal Multimodal Tokenscited by 11
- 2024General Compression Framework for Efficient Transformer Object Trackingcited by 10
- 2024Correlation-Embedded Transformer Tracking: A Single-Branch Frameworkcited by 9
- 2025CompTrack: Information Bottleneck-Guided Low-Rank Dynamic Token Compression for Point Cloud Trackingcited by 9
- 2023Lightweight Full-Convolutional Siamese Trackercited by 8
26 more
- 2024Exploring Dynamic Transformer for Efficient Object Trackingcited by 7
- 2023Tracking Skiers from the Top to the Bottomcited by 6
- 2024RGB-Sonar Tracking Benchmark and Spatial Cross-Attention Transformer Trackercited by 6
- 2023Adaptive Siamese Tracking with a Compact Latent Networkcited by 5
- 2024An Experimental Study on Exploring Strong Lightweight Vision Transformers via Masked Image Modeling Pre-Trainingcited by 4
- 2024SSF-Net: Spatial-Spectral Fusion Network with Spectral Angle Awareness for Hyperspectral Object Trackingcited by 3
- 2024LoReTrack: Efficient and Accurate Low-Resolution Transformer Trackingcited by 3
- 2024Improving Accuracy and Generalization for Efficient Visual Trackingcited by 3
- 2025Towards Low-Latency Event Stream-based Visual Object Tracking: A Slow-Fast Approachcited by 3
- 2025Exploiting Lightweight Hierarchical ViT and Dynamic Framework for Efficient Visual Trackingcited by 3
- 2025Track-On2: Enhancing Online Point Tracking with Memorycited by 3
- 2026RELO: Reinforcement Learning to Localize for Visual Object Trackingcited by 3
- 2022SRRT: Exploring Search Region Regulation for Visual Object Trackingcited by 2
- 2023Mobile Vision Transformer-based Visual Object Trackingcited by 2
- 2023AViTMP: A Tracking-Specific Transformer for Single-Branch Visual Trackingcited by 2
- 2026FARTrack: Fast Autoregressive Visual Tracking with High Performancecited by 2
- 2026UETrack: A Unified and Efficient Framework for Single Object Trackingcited by 2
- 2022On Designing Light-Weight Object Trackers through Network Pruning: Use CNNs or Transformers?cited by 1
- 2024Adaptively Bypassing Vision Transformer Blocks for Efficient Visual Trackingcited by 1
- 2025LightFC-X: Lightweight Convolutional Tracker for RGB-X Trackingcited by 1
- 2025CFTrack: Enhancing Lightweight Visual Tracking through Contrastive Learning and Feature Matchingcited by 1
- 2025Learning Frequency and Memory-Aware Prompts for Multi-Modal Object Trackingcited by 1
- 2025Multi-State Tracker: Enhancing Efficient Object Tracking via Multi-State Specialization and Interactioncited by 1
- 2023Unsupervised Green Object Tracker (GOT) without Offline Pre-trainingcited by 0
- 2026Search Multilayer Perceptron-Based Fusion for Efficient and Accurate Siamese Trackingcited by 0
- 2026MaST: Motion-aware Sparse Pipeline for Lightweight Object Trackingcited by 0
- 2026MaST: Motion-aware Sparse Pipeline for Lightweight Object Tracking25 Aug 2026
- 2026RELO: Reinforcement Learning to Localize for Visual Object Tracking8 May 2026
- 2026Search Multilayer Perceptron-Based Fusion for Efficient and Accurate Siamese Tracking2 Mar 2026
- 2026UETrack: A Unified and Efficient Framework for Single Object Tracking2 Mar 2026
- 2026FARTrack: Fast Autoregressive Visual Tracking with High Performance3 Feb 2026
- 2025CompTrack: Information Bottleneck-Guided Low-Rank Dynamic Token Compression for Point Cloud Tracking19 Nov 2025
- 2025Track-On2: Enhancing Online Point Tracking with Memory23 Sep 2025
- 2025Multi-State Tracker: Enhancing Efficient Object Tracking via Multi-State Specialization and Interaction15 Aug 2025
- 2025Learning Frequency and Memory-Aware Prompts for Multi-Modal Object Tracking30 Jun 2025
- 2025Exploiting Lightweight Hierarchical ViT and Dynamic Framework for Efficient Visual Tracking25 Jun 2025
- 2025Towards Low-Latency Event Stream-based Visual Object Tracking: A Slow-Fast Approach19 May 2025
- 2025Two-stream Beats One-stream: Asymmetric Siamese Network for Efficient Visual Tracking1 Mar 2025
26 more
- 2025CFTrack: Enhancing Lightweight Visual Tracking through Contrastive Learning and Feature Matching27 Feb 2025
- 2025LightFC-X: Lightweight Convolutional Tracker for RGB-X Tracking25 Feb 2025
- 2024Improving Accuracy and Generalization for Efficient Visual Tracking28 Nov 2024
- 2024General Compression Framework for Efficient Transformer Object Tracking26 Sep 2024
- 2024Adaptively Bypassing Vision Transformer Blocks for Efficient Visual Tracking12 Jun 2024
- 2024RGB-Sonar Tracking Benchmark and Spatial Cross-Attention Transformer Tracker11 Jun 2024
- 2024LoReTrack: Efficient and Accurate Low-Resolution Transformer Tracking27 May 2024
- 2024An Experimental Study on Exploring Strong Lightweight Vision Transformers via Masked Image Modeling Pre-Training18 Apr 2024
- 2024Exploring Dynamic Transformer for Efficient Object Tracking26 Mar 2024
- 2024SSF-Net: Spatial-Spectral Fusion Network with Spectral Angle Awareness for Hyperspectral Object Tracking9 Mar 2024
- 2024Correlation-Embedded Transformer Tracking: A Single-Branch Framework23 Jan 2024
- 2024Transformer RGBT Tracking with Spatio-Temporal Multimodal Tokens3 Jan 2024
- 2023Tracking Skiers from the Top to the Bottom15 Dec 2023
- 2023AViTMP: A Tracking-Specific Transformer for Single-Branch Visual Tracking30 Oct 2023
- 2023ZoomTrack: Target-aware Non-uniform Resizing for Efficient Visual Tracking16 Oct 2023
- 2023Lightweight Full-Convolutional Siamese Tracker9 Oct 2023
- 2023LiteTrack: Layer Pruning with Asynchronous Feature Extraction for Lightweight and Efficient Visual Tracking17 Sep 2023
- 2023Unsupervised Green Object Tracker (GOT) without Offline Pre-training16 Sep 2023
- 2023Mobile Vision Transformer-based Visual Object Tracking11 Sep 2023
- 2023Separable Self and Mixed Attention Transformers for Efficient Object Tracking7 Sep 2023
- 2023Exploring Lightweight Hierarchical Vision Transformers for Efficient Visual Tracking14 Aug 2023
- 2023PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Tracking27 Jul 2023
- 2023MixFormerV2: Efficient Fully Transformer Tracking25 May 2023
- 2023Adaptive Siamese Tracking with a Compact Latent Network2 Feb 2023
- 2022On Designing Light-Weight Object Trackers through Network Pruning: Use CNNs or Transformers?24 Nov 2022
- 2022SRRT: Exploring Search Region Regulation for Visual Object Tracking10 Jul 2022
- 2023PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Trackingcited by 276
- 2023MixFormerV2: Efficient Fully Transformer Trackingcited by 57
- 2023Exploring Lightweight Hierarchical Vision Transformers for Efficient Visual Trackingcited by 53
- 2023Separable Self and Mixed Attention Transformers for Efficient Object Trackingcited by 31
- 2023ZoomTrack: Target-aware Non-uniform Resizing for Efficient Visual Trackingcited by 25
- 2023LiteTrack: Layer Pruning with Asynchronous Feature Extraction for Lightweight and Efficient Visual Trackingcited by 16
- 2025Two-stream Beats One-stream: Asymmetric Siamese Network for Efficient Visual Trackingcited by 15
- 2024Transformer RGBT Tracking with Spatio-Temporal Multimodal Tokenscited by 11
- 2024Correlation-Embedded Transformer Tracking: A Single-Branch Frameworkcited by 9
- 2025CompTrack: Information Bottleneck-Guided Low-Rank Dynamic Token Compression for Point Cloud Trackingcited by 9
- 2023Lightweight Full-Convolutional Siamese Trackercited by 8
- 2024Exploring Dynamic Transformer for Efficient Object Trackingcited by 7
12 most cited of 34 All 34 (JSON)
- 2026MaST: Motion-aware Sparse Pipeline for Lightweight Object Tracking25 Aug 2026
- 2026Search Multilayer Perceptron-Based Fusion for Efficient and Accurate Siamese Tracking2 Mar 2026
- 2026UETrack: A Unified and Efficient Framework for Single Object Tracking2 Mar 2026
- 2025CompTrack: Information Bottleneck-Guided Low-Rank Dynamic Token Compression for Point Cloud Tracking19 Nov 2025
- 2025Track-On2: Enhancing Online Point Tracking with Memory23 Sep 2025
- 2025Multi-State Tracker: Enhancing Efficient Object Tracking via Multi-State Specialization and Interaction15 Aug 2025
- 2025Learning Frequency and Memory-Aware Prompts for Multi-Modal Object Tracking30 Jun 2025
- 2025Exploiting Lightweight Hierarchical ViT and Dynamic Framework for Efficient Visual Tracking25 Jun 2025
- 2025Towards Low-Latency Event Stream-based Visual Object Tracking: A Slow-Fast Approach19 May 2025
- 2025Two-stream Beats One-stream: Asymmetric Siamese Network for Efficient Visual Tracking1 Mar 2025
- 2025CFTrack: Enhancing Lightweight Visual Tracking through Contrastive Learning and Feature Matching27 Feb 2025
- 2025LightFC-X: Lightweight Convolutional Tracker for RGB-X Tracking25 Feb 2025
12 newest of 34 All 34 (JSON)