mlsanityData to 7 Oct 2026

LasHeR: A Large-scale High-diversity Benchmark for RGBT Tracking

arXiv 2104.13202 ↗First posted 27 Apr 2021cs.CVcited by 94

Not on the map. Why?

Abstract (arXiv)

RGBT tracking receives a surge of interest in the computer vision community, but this research field lacks a large-scale and high-diversity benchmark dataset, which is essential for both the training of deep RGBT trackers and the comprehensive evaluation of RGBT tracking methods. To this end, we present a Large-scale High-diversity benchmark for RGBT tracking (LasHeR) in this work. LasHeR consists of 1224 visible and thermal infrared video pairs with more than 730K frame pairs in total. Each frame pair is spatially aligned and manually annotated with a bounding box, making the dataset well and densely annotated. LasHeR is highly diverse capturing from a broad range of object categories, camera viewpoints, scene complexities and environmental factors across seasons, weathers, day and night. We conduct a comprehensive performance evaluation of 12 RGBT tracking algorithms on the LasHeR dataset and present detailed analysis to clarify the research room in RGBT tracking. In addition, we release the unaligned version of LasHeR to attract the research interest for alignment-free RGBT tracking, which is a more practical task in real-world applications. The datasets and evaluation protocols are available at: https://github.com/BUGPLEASEOUT/LasHeR.

Key facts. Cited by 94 papers in the map (data through 7 Oct 2026). Builds on 22 of its 67 references that are in the map. First posted on arXiv 27 Apr 2021.

Builds on

22 of 67 references.

References · 22

  1. 2018LaSOT: A High-quality Benchmark for Large-scale Single Object Trackingcited by 424
  2. 2021Transformer Trackingcited by 412
  3. 2019Learning Discriminative Model Prediction for Trackingcited by 344
  4. 2018TrackingNet: A Large-Scale Dataset and Benchmark for Object Tracking in the Wildcited by 342
  5. 2018ATOM: Accurate Tracking by Overlap Maximizationcited by 285
  6. 2020Probabilistic Regression for Visual Trackingcited by 231
  7. 2015Learning Multi-Domain Convolutional Neural Networks for Visual Trackingcited by 209
  8. 2019SiamFC++: Towards Robust and Accurate Visual Tracking with Target Estimation Guidelinescited by 177
  9. 2018RGB-T Object Tracking:Benchmark and Baselinecited by 121
  10. 2018Weakly-Supervised Convolutional Neural Networks for Multimodal Image Registrationcited by 90
  11. 2020Unsupervised Multi-Modal Image Registration via Geometry Preserving Image-to-Image Translationcited by 66
  12. 2019Multi-Modal Fusion for End-to-End RGB-T Trackingcited by 63
10 more
  1. 2019Content-Aware Unsupervised Deep Homography Estimationcited by 62
  2. 2020Deep Homography Estimation for Dynamic Scenescited by 60
  3. 2020Challenge-Aware RGBT Trackingcited by 53
  4. 2019Dual-Stream Pyramid Registration Networkcited by 52
  5. 2020Jointly Modeling Motion and Appearance Cues for Robust RGB-T Trackingcited by 47
  6. 2019Dense Feature Aggregation and Pruning for RGBT Trackingcited by 40
  7. 2019Multi-Adapter RGBT Trackingcited by 38
  8. 2020RGBT Tracking via Multi-Adapter Network with Hierarchical Divergence Losscited by 32
  9. 2018Synthetic data generation for end-to-end thermal infrared trackingcited by 26
  10. 2020M5L: Multi-Modal Multi-Margin Metric Learning for RGBT Trackingcited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 5; 2023: 16; 2024: 24; 2025: 27; 2026: 22.

94 papers.

Sort:

By area:

  1. 2023Visual Prompt Multi-Modal Trackingcited by 141
  2. 2022Visible-Thermal UAV Tracking: A Large-Scale Benchmark and New Baselinecited by 90
  3. 2023LRRNet: A Novel Representation Learning Guided Fusion Network for Infrared and Visible Imagescited by 87
  4. 2023Single-Model and Any-Modality for Video Object Trackingcited by 64
  5. 2024OneTracker: Unifying Visual Object Tracking with Foundation Models and Efficient Tuningcited by 64
  6. 2022Prompting for Multi-Modal Trackingcited by 58
  7. 2023Bi-directional Adapter for Multi-modal Trackingcited by 46
  8. 2024SDSTrack: Self-Distillation Symmetric Adapter Learning for Multi-Modal Visual Object Trackingcited by 43
  9. 2023Generative-based Fusion Mechanism for Multi-Modal Trackingcited by 33
  10. 2024Temporal Adaptive RGBT Tracking with Modality Promptcited by 30
  11. 2025Towards Universal Modal Tracking with Online Dense Temporal Token Learningcited by 30
  12. 2024Visible-Thermal Tiny Object Detection: A Benchmark Dataset and Baselinescited by 27
38 more
  1. 2022Exploring Fusion Strategies for Accurate RGBT Visual Object Trackingcited by 26
  2. 2023Unified Sequence-to-Sequence Learning for Single- and Multi-Modal Visual Object Trackingcited by 20
  3. 2024XTrack: Multimodal Training Boosts RGB-X Video Object Trackerscited by 20
  4. 2023Modality-missing RGBT Tracking: Invertible Prompt Learning and High-quality Benchmarkscited by 17
  5. 2024RGBT Tracking via All-layer Multimodal Interactions with Progressive Fusion Mambacited by 17
  6. 2025What You Have is What You Track: Adaptive and Robust Multimodal Trackingcited by 15
  7. 2024Cross-modulated Attention Transformer for RGBT Trackingcited by 14
  8. 2024MambaVT: Spatio-Temporal Contextual Modeling for robust RGB-T Trackingcited by 14
  9. 2024Visible-Thermal Multiple Object Tracking: Large-scale Video Dataset and Progressive Fusion Approachcited by 13
  10. 2022RGBD Object Tracking: An In-depth Reviewcited by 11
  11. 2024Transformer RGBT Tracking with Spatio-Temporal Multimodal Tokenscited by 11
  12. 2024Breaking Modality Gap in RGBT Tracking: Coupled Knowledge Distillationcited by 11
  13. 2025Adaptive Perception for Unified Visual Multi-modal Object Trackingcited by 11
  14. 2025CADTrack: Learning Contextual Aggregation with Deformable Alignment for Robust RGBT Trackingcited by 11
  15. 2025CSTrack: Enhancing RGB-X Tracking via Compact Spatiotemporal Featurescited by 10
  16. 2023RGB-T Tracking via Multi-Modal Mutual Prompt Learningcited by 8
  17. 2023Cross-Modal Object Tracking via Modality-Aware Fusion Network and A Large-Scale Datasetcited by 8
  18. 2025M-SpecGene: Generalized Foundation Model for RGBT Multispectral Visioncited by 8
  19. 2023RGB-T Tracking Based on Mixed Attentioncited by 7
  20. 2023What Happened 3 Seconds Ago? Inferring the Past with Thermal Imagingcited by 7
  21. 2023Prototype-based Cross-Modal Object Trackingcited by 7
  22. 2024AFter: Attention-based Fusion Router for RGBT Trackingcited by 7
  23. 2022A Survey for Deep RGBT Trackingcited by 6
  24. 2024RGB-Sonar Tracking Benchmark and Spatial Cross-Attention Transformer Trackercited by 6
  25. 2023RGBT Tracking via Progressive Fusion Transformer with Dynamically Guided Learningcited by 5
  26. 2023PAD: Self-Supervised Pre-Training with Patchwise-Scale Adapter for Infrared Imagescited by 5
  27. 2026Video Understanding: From Geometry and Semantics to Unified Modelscited by 5
  28. 2024Transformer-based RGB-T Tracking with Channel and Spatial Feature Fusioncited by 4
  29. 2024HDRT: A Large-Scale Dataset for Infrared-Guided HDR Imagingcited by 4
  30. 2024BihoT: A Large-Scale Dataset and Benchmark for Hyperspectral Camouflaged Object Trackingcited by 4
  31. 2024Enhancing Thermal MOT: A Novel Box Association Method Leveraging Thermal Identity and Motion Similaritycited by 4
  32. 2025UNIP: Rethinking Pre-trained Attention Patterns for Infrared Semantic Segmentationcited by 3
  33. 2023X Modality Assisting RGBT Object Trackingcited by 2
  34. 2024From Two-Stream to One-Stream: Efficient RGB-T Tracking via Mutual Prompt Learning and Knowledge Distillationcited by 2
  35. 2024Cross Fusion RGB-T Tracking with Bi-directional Adaptercited by 2
  36. 2025Breaking Shallow Limits: Task-Driven Pixel Fusion for Gap-free RGBT Trackingcited by 2
  37. 2025Modality-Guided Dynamic Graph Fusion and Temporal Diffusion for Self-Supervised RGB-T Trackingcited by 2
  38. 2025Diff-MM: Exploring Pre-trained Text-to-Image Generation Model for Unified Multi-modal Object Trackingcited by 2

50 most cited of 94 All 94 (JSON)