MVTD: A Benchmark Dataset for Maritime Visual Object Tracking
Not on the map. Why?
Abstract (arXiv)
Visual Object Tracking (VOT) is a fundamental task with widespread applications in autonomous navigation, surveillance, and maritime robotics. Despite significant advances in generic object tracking, maritime environments continue to present unique challenges, including specular water reflections, low-contrast targets, dynamically changing backgrounds, and frequent occlusions. These complexities significantly degrade the performance of state-of-the-art tracking algorithms, highlighting the need for domain-specific datasets. To address this gap, we introduce the Maritime Visual Tracking Dataset (MVTD), a comprehensive and publicly available benchmark specifically designed for maritime VOT. MVTD comprises 182 high-resolution video sequences, totaling approximately 150,000 frames, and includes four representative object classes: boat, ship, sailboat, and unmanned surface vehicle (USV). The dataset captures a diverse range of operational conditions and maritime scenarios, reflecting the real-world complexities of maritime environments. We evaluated 14 recent SOTA tracking algorithms on the MVTD benchmark and observed substantial performance degradation compared to their performance on general-purpose datasets. However, when fine-tuned on MVTD, these models demonstrate significant performance gains, underscoring the effectiveness of domain adaptation and the importance of transfer learning in specialized tracking contexts. The MVTD dataset fills a critical gap in the visual tracking community by providing a realistic and challenging benchmark for maritime scenarios. Dataset and Source Code can be accessed here "https://github.com/AhsanBaidar/MVTD".
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 46 of its 80 references that are in the map. First posted on arXiv 3 Jun 2025.
Builds on
46 of 80 references.
References · 46
- 2016Fully-Convolutional Siamese Networks for Object Trackingcited by 568
- 2018GOT-10k: A Large High-Diversity Benchmark for Generic Object Tracking in the Wildcited by 475
- 2018LaSOT: A High-quality Benchmark for Large-scale Single Object Trackingcited by 429
- 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 429
- 2021Transformer Trackingcited by 412
- 2021Learning Spatio-Temporal Transformer for Visual Trackingcited by 350
- 2019Learning Discriminative Model Prediction for Trackingcited by 344
- 2018TrackingNet: A Large-Scale Dataset and Benchmark for Object Tracking in the Wildcited by 343
- 2022Joint Feature Learning and Relation Modeling for Tracking: A One-Stream Frameworkcited by 330
- 2018ATOM: Accurate Tracking by Overlap Maximizationcited by 285
- 2018Fast Online Object Tracking and Segmentation: A Unifying Approachcited by 272
- 2020Probabilistic Regression for Visual Trackingcited by 231
34 more
- 2021Transformer Meets Tracker: Exploiting Temporal Context for Robust Visual Trackingcited by 220
- 2020Ocean: Object-aware Anchor-free Trackingcited by 212
- 2015Learning Multi-Domain Convolutional Neural Networks for Visual Trackingcited by 209
- 2020Siamese Box Adaptive Network for Visual Trackingcited by 189
- 2017Need for Speed: A Benchmark for Higher Frame Rate Object Trackingcited by 137
- 2022AiATrack: Attention in Attention for Transformer Visual Trackingcited by 137
- 2020LaSOT: A High-quality Large-scale Single Object Tracking Benchmarkcited by 132
- 2024ODTrack: Online Dense Temporal Token Learning for Visual Trackingcited by 129
- 2021Towards More Flexible and Accurate Object Tracking with Natural Language: Algorithms and Benchmarkcited by 126
- 2022Backbone is All Your Need: A Simplified Architecture for Visual Object Trackingcited by 119
- 2022Transforming Model Prediction for Trackingcited by 117
- 2023Generalized Relation Modeling for Transformer Trackingcited by 93
- 2024Autoregressive Queries for Adaptive Tracking with Spatio-TemporalTransformerscited by 76
- 2023HIPTrack: Visual Tracking with Historical Promptscited by 71
- 2021Learn to Match: Automatic Matching Network Design for Visual Trackingcited by 67
- 2021SeaDronesSee: A Maritime Benchmark for Detecting Humans in Open Watercited by 61
- 2016Siamese Instance Search for Trackingcited by 60
- 2023ARTrackV2: Prompting Autoregressive Tracker Where to Look and How to Describecited by 59
- 2021Efficient Visual Tracking with Exemplar Transformerscited by 48
- 2016Video Processing from Electro-optical Sensors for Object Detection and Tracking in Maritime Environment: A Surveycited by 47
- 2021Visual Object Tracking with Discriminative Filters and Siamese Networks: A Survey and Outlookcited by 46
- 2024Exploring Enhanced Contextual Information for Video-Level Object Trackingcited by 37
- 2019Distilled Siamese Networks for Visual Trackingcited by 34
- 2019CDTB: A Color and Depth Visual Object Tracking Dataset and Benchmarkcited by 32
- 2022A Guide to Image and Video based Small Object Detection using Deep Learning : Case Study of Maritime Surveillancecited by 14
- 2022Towards Sequence-Level Training for Visual Trackingcited by 13
- 2023Vision-Based Autonomous Navigation for Unmanned Surface Vessel in Extreme Marine Conditionscited by 9
- 2024Correlation-Embedded Transformer Tracking: A Single-Branch Frameworkcited by 9
- 2019Real-Time Correlation Tracking via Joint Model Compression and Transfercited by 8
- 2023MuLA-GAN: Multi-Level Attention GAN for Enhanced Underwater Visibilitycited by 7
- 2021Unsupervised Cross-Modal Distillation for Thermal Infrared Trackingcited by 6
- 2024Distilling Channels for Efficient Deep Trackingcited by 5
- 2024Benchmarking Vision-Based Object Tracking for USVs in Complex Maritime Environmentscited by 4
- 2025Maritime Mission Planning for Unmanned Surface Vessel using Large Language Modelcited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.