mlsanityData to 14 Oct 2026

Cross-Modal Object Tracking via Modality-Aware Fusion Network and A Large-Scale Dataset

arXiv 2312.14446 ↗First posted 22 Dec 2023cs.CVcited by 8

Not on the map. Why?

Abstract (arXiv)

Visual tracking often faces challenges such as invalid targets and decreased performance in low-light conditions when relying solely on RGB image sequences. While incorporating additional modalities like depth and infrared data has proven effective, existing multi-modal imaging platforms are complex and lack real-world applicability. In contrast, near-infrared (NIR) imaging, commonly used in surveillance cameras, can switch between RGB and NIR based on light intensity. However, tracking objects across these heterogeneous modalities poses significant challenges, particularly due to the absence of modality switch signals during tracking. To address these challenges, we propose an adaptive cross-modal object tracking algorithm called Modality-Aware Fusion Network (MAFNet). MAFNet efficiently integrates information from both RGB and NIR modalities using an adaptive weighting mechanism, effectively bridging the appearance gap and enabling a modality-aware target representation. It consists of two key components: an adaptive weighting module and a modality-specific representation module......

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 43 of its 73 references that are in the map. First posted on arXiv 22 Dec 2023.

Builds on

43 of 73 references.

References · 43

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,512
  5. 2016Fully-Convolutional Siamese Networks for Object Trackingcited by 568
  6. 2018GOT-10k: A Large High-Diversity Benchmark for Generic Object Tracking in the Wildcited by 475
  7. 2018SiamRPN++: Evolution of Siamese Visual Tracking with Very Deep Networkscited by 446
  8. 2021Transformer Trackingcited by 412
  9. 2021Learning Spatio-Temporal Transformer for Visual Trackingcited by 350
  10. 2019Learning Discriminative Model Prediction for Trackingcited by 344
  11. 2018TrackingNet: A Large-Scale Dataset and Benchmark for Object Tracking in the Wildcited by 343
  12. 2022Joint Feature Learning and Relation Modeling for Tracking: A One-Stream Frameworkcited by 330
31 more
  1. 2018ATOM: Accurate Tracking by Overlap Maximizationcited by 285
  2. 2022MixFormer: End-to-End Tracking with Iterative Mixed Attentioncited by 281
  3. 2018Fast Online Object Tracking and Segmentation: A Unifying Approachcited by 272
  4. 2021Transformer Meets Tracker: Exploiting Temporal Context for Robust Visual Trackingcited by 220
  5. 2020Ocean: Object-aware Anchor-free Trackingcited by 212
  6. 2015Learning Multi-Domain Convolutional Neural Networks for Visual Trackingcited by 209
  7. 2020Siamese Box Adaptive Network for Visual Trackingcited by 189
  8. 2018Distractor-aware Siamese Networks for Visual Object Trackingcited by 187
  9. 2018Acquisition of Localization Confidence for Accurate Object Detectioncited by 176
  10. 2019Deeper and Wider Siamese Networks for Real-Time Visual Trackingcited by 156
  11. 2022AiATrack: Attention in Attention for Transformer Visual Trackingcited by 137
  12. 2021VisEvent: Reliable Object Tracking via Collaboration of Frame and Event Flowscited by 129
  13. 2014Return of the Devil in the Details: Delving Deep into Convolutional Netscited by 122
  14. 2022Transforming Model Prediction for Trackingcited by 117
  15. 2021LasHeR: A Large-scale High-diversity Benchmark for RGBT Trackingcited by 96
  16. 2023Generalized Relation Modeling for Transformer Trackingcited by 93
  17. 2022Visible-Thermal UAV Tracking: A Large-Scale Benchmark and New Baselinecited by 91
  18. 2023Robust Object Modeling for Visual Trackingcited by 80
  19. 2021DepthTrack : Unveiling the Power of RGBD Trackingcited by 67
  20. 2018VITAL: VIsual Tracking via Adversarial Learningcited by 65
  21. 2023MixFormerV2: Efficient Fully Transformer Trackingcited by 57
  22. 2020Challenge-Aware RGBT Trackingcited by 53
  23. 2022RGBD1K: A Large-scale Dataset and Benchmark for RGB-D Object Trackingcited by 42
  24. 2019GradNet: Gradient-Guided Network for Visual Object Trackingcited by 41
  25. 2018Real-Time MDNetcited by 39
  26. 2020Duality-Gated Mutual Condition Network for RGBT Trackingcited by 35
  27. 2023Generative-based Fusion Mechanism for Multi-Modal Trackingcited by 33
  28. 2021Active Learning for Deep Visual Trackingcited by 19
  29. 2022Tiny Object Tracking: A Large-scale Dataset and A Baselinecited by 11
  30. 2020Visual Tracking by TridentAlign and Context Embeddingcited by 9
  31. 2021Cross-Modal Object Tracking: Modality-Aware Representations and A Unified Benchmarkcited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 4.

8 papers.

  1. 2025VLM-E2E: Enhancing End-to-End Autonomous Driving with Multimodal Driver Attention Fusioncited by 20
  2. 2025Omni Survey for Multimodality Analysis in Visual Object Trackingcited by 2
  3. 2025OmniScene: Attention-Augmented Multimodal 4D Scene Understanding for Autonomous Drivingcited by 2
  4. 2025SwiTrack: Tri-State Switch for Cross-Modal Object Trackingcited by 1
  5. 2026UAV traffic scene understanding: A regulation embedded multi-modal network and a unified benchmarkcited by 1
  6. 2026Unified Multimodal Visual Tracking with Dual Mixture-of-Expertscited by 1
  7. 2026Cross-Modal UAV Object Tracking: State-Aware Representation Learning and A Unified Benchmarkcited by 0
  8. 2026Template-Search Domain Adaptation via Multi-Stage Feature Alignment for Cross-Modal Object Trackingcited by 0