mlsanityData to 7 Oct 2026

FreqTrack: Frequency Learning based Vision Transformer for RGB-Event Object Tracking

arXiv 2604.14526 ↗First posted 16 Apr 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Existing single-modal RGB trackers often face performance bottlenecks in complex dynamic scenes, while the introduction of event sensors offers new potential for enhancing tracking capabilities. However, most current RGB-event fusion methods, primarily designed in the spatial domain using convolutional, Transformer, or Mamba architectures, fail to fully exploit the unique temporal response and high-frequency characteristics of event data. To address this, we1 propose FreqTrack, a frequency-aware RGBE tracking framework that establishes complementary inter-modal correlations through frequency-domain transformations for more robust feature fusion. We design a Spectral Enhancement Transformer (SET) layer that incorporates multi-head dynamic Fourier filtering to adaptively enhance and select frequency-domain features. Additionally, we develop a Wavelet Edge Refinement (WER) module, which leverages learnable wavelet transforms to explicitly extract multi-scale edge structures from event data, effectively improving modeling capability in high-speed and low-light scenarios. Extensive experiments on the COESOT and FE108 datasets demonstrate that FreqTrack achieves highly competitive performance, particularly attaining leading precision of 76.6% on the COESOT benchmark, validating the effectiveness of frequency-domain modeling for RGBE tracking.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 40 references that are in the map. First posted on arXiv 16 Apr 2026.

Builds on

27 of 40 references.

References · 27

  1. 2015Fast R-CNNcited by 2,930
  2. 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,361
  3. 2021Transformer Trackingcited by 412
  4. 2021Learning Spatio-Temporal Transformer for Visual Trackingcited by 348
  5. 2019Learning Discriminative Model Prediction for Trackingcited by 344
  6. 2022Joint Feature Learning and Relation Modeling for Tracking: A One-Stream Frameworkcited by 328
  7. 2022How Do Vision Transformers Work?cited by 305
  8. 2018ATOM: Accurate Tracking by Overlap Maximizationcited by 285
  9. 2020Probabilistic Regression for Visual Trackingcited by 231
  10. 2021Transformer Meets Tracker: Exploiting Temporal Context for Robust Visual Trackingcited by 220
  11. 2019SiamFC++: Towards Robust and Accurate Visual Tracking with Target Estimation Guidelinescited by 177
  12. 2022AiATrack: Attention in Attention for Transformer Visual Trackingcited by 137
15 more
  1. 2021Learning Target Candidate Association to Keep Track of What Not to Trackcited by 131
  2. 2024ODTrack: Online Dense Temporal Token Learning for Visual Trackingcited by 129
  3. 2021VisEvent: Reliable Object Tracking via Collaboration of Frame and Event Flowscited by 128
  4. 2020Know Your Surroundings: Exploiting Scene Information for Object Trackingcited by 119
  5. 2022Inception Transformercited by 99
  6. 2021Object Tracking by Jointly Exploiting Frame and Event Domaincited by 83
  7. 2023Event Stream-based Visual Object Tracking: A High-Resolution Benchmark Dataset and A Novel Baselinecited by 73
  8. 2023MixFormerV2: Efficient Fully Transformer Trackingcited by 56
  9. 2022Revisiting Color-Event based Tracking: A Unified Network, Dataset, and Metriccited by 51
  10. 2020Frequency Domain Image Translation: More Photo-realistic, Better Identity-preservingcited by 46
  11. 2023Frame-Event Alignment and Fusion Network for High Frame Rate Trackingcited by 43
  12. 2023Cross-modal Orthogonal High-rank Augmentation for RGB-Event Transformer-trackerscited by 43
  13. 2023Exploiting the Signal-Leak Bias in Diffusion Modelscited by 36
  14. 2023FFT-based Dynamic Token Mixer for Visioncited by 22
  15. 2024When Semantic Segmentation Meets Frequency Aliasingcited by 10

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Event-Adaptive State Transition and Gated Fusion for RGB-Event Object Tracking
  2. 2026Dynamic Pondering Sparsity-aware Mixture-of-Experts Transformer for Event Stream based Visual Object Tracking
  3. 2025Breaking Shallow Limits: Task-Driven Pixel Fusion for Gap-free RGBT Tracking
  4. 2025Mamba-FETrack V2: Revisiting State Space Model for Frame-Event based Visual Object Tracking
  5. 2024Mamba-FETrack: Frame-Event Tracking via State Space Model
  6. 2025Towards General Multimodal Visual Tracking
  7. 2026RAGTrack: Language-aware RGBT Tracking with Retrieval-Augmented Generation
  8. 2025CADTrack: Learning Contextual Aggregation with Deformable Alignment for Robust RGBT Tracking