FreqTrack: Frequency Learning based Vision Transformer for RGB-Event Object Tracking
Not on the map. Why?
Abstract (arXiv)
Existing single-modal RGB trackers often face performance bottlenecks in complex dynamic scenes, while the introduction of event sensors offers new potential for enhancing tracking capabilities. However, most current RGB-event fusion methods, primarily designed in the spatial domain using convolutional, Transformer, or Mamba architectures, fail to fully exploit the unique temporal response and high-frequency characteristics of event data. To address this, we1 propose FreqTrack, a frequency-aware RGBE tracking framework that establishes complementary inter-modal correlations through frequency-domain transformations for more robust feature fusion. We design a Spectral Enhancement Transformer (SET) layer that incorporates multi-head dynamic Fourier filtering to adaptively enhance and select frequency-domain features. Additionally, we develop a Wavelet Edge Refinement (WER) module, which leverages learnable wavelet transforms to explicitly extract multi-scale edge structures from event data, effectively improving modeling capability in high-speed and low-light scenarios. Extensive experiments on the COESOT and FE108 datasets demonstrate that FreqTrack achieves highly competitive performance, particularly attaining leading precision of 76.6% on the COESOT benchmark, validating the effectiveness of frequency-domain modeling for RGBE tracking.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 40 references that are in the map. First posted on arXiv 16 Apr 2026.
Builds on
27 of 40 references.
References · 27
- 2015Fast R-CNNcited by 2,930
- 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,361
- 2021Transformer Trackingcited by 412
- 2021Learning Spatio-Temporal Transformer for Visual Trackingcited by 348
- 2019Learning Discriminative Model Prediction for Trackingcited by 344
- 2022Joint Feature Learning and Relation Modeling for Tracking: A One-Stream Frameworkcited by 328
- 2022How Do Vision Transformers Work?cited by 305
- 2018ATOM: Accurate Tracking by Overlap Maximizationcited by 285
- 2020Probabilistic Regression for Visual Trackingcited by 231
- 2021Transformer Meets Tracker: Exploiting Temporal Context for Robust Visual Trackingcited by 220
- 2019SiamFC++: Towards Robust and Accurate Visual Tracking with Target Estimation Guidelinescited by 177
- 2022AiATrack: Attention in Attention for Transformer Visual Trackingcited by 137
15 more
- 2021Learning Target Candidate Association to Keep Track of What Not to Trackcited by 131
- 2024ODTrack: Online Dense Temporal Token Learning for Visual Trackingcited by 129
- 2021VisEvent: Reliable Object Tracking via Collaboration of Frame and Event Flowscited by 128
- 2020Know Your Surroundings: Exploiting Scene Information for Object Trackingcited by 119
- 2022Inception Transformercited by 99
- 2021Object Tracking by Jointly Exploiting Frame and Event Domaincited by 83
- 2023Event Stream-based Visual Object Tracking: A High-Resolution Benchmark Dataset and A Novel Baselinecited by 73
- 2023MixFormerV2: Efficient Fully Transformer Trackingcited by 56
- 2022Revisiting Color-Event based Tracking: A Unified Network, Dataset, and Metriccited by 51
- 2020Frequency Domain Image Translation: More Photo-realistic, Better Identity-preservingcited by 46
- 2023Frame-Event Alignment and Fusion Network for High Frame Rate Trackingcited by 43
- 2023Cross-modal Orthogonal High-rank Augmentation for RGB-Event Transformer-trackerscited by 43
- 2023Exploiting the Signal-Leak Bias in Diffusion Modelscited by 36
- 2023FFT-based Dynamic Token Mixer for Visioncited by 22
- 2024When Semantic Segmentation Meets Frequency Aliasingcited by 10
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Event-Adaptive State Transition and Gated Fusion for RGB-Event Object Tracking
- 2026Dynamic Pondering Sparsity-aware Mixture-of-Experts Transformer for Event Stream based Visual Object Tracking
- 2025Breaking Shallow Limits: Task-Driven Pixel Fusion for Gap-free RGBT Tracking
- 2025Mamba-FETrack V2: Revisiting State Space Model for Frame-Event based Visual Object Tracking
- 2024Mamba-FETrack: Frame-Event Tracking via State Space Model
- 2025Towards General Multimodal Visual Tracking
- 2026RAGTrack: Language-aware RGBT Tracking with Retrieval-Augmented Generation
- 2025CADTrack: Learning Contextual Aggregation with Deformable Alignment for Robust RGBT Tracking