Tracking Transforming Objects: A Benchmark
Not on the map. Why?
Abstract (arXiv)
Tracking transforming objects holds significant importance in various fields due to the dynamic nature of many real-world scenarios. By enabling systems accurately represent transforming objects over time, tracking transforming objects facilitates advancements in areas such as autonomous systems, human-computer interaction, and security applications. Moreover, understanding the behavior of transforming objects provides valuable insights into complex interactions or processes, contributing to the development of intelligent systems capable of robust and adaptive perception in dynamic environments. However, current research in the field mainly focuses on tracking generic objects. In this study, we bridge this gap by collecting a novel dedicated Dataset for Tracking Transforming Objects, called DTTO, which contains 100 sequences, amounting to approximately 9.3K frames. We provide carefully hand-annotated bounding boxes for each frame within these sequences, making DTTO the pioneering benchmark dedicated to tracking transforming objects. We thoroughly evaluate 20 state-of-the-art trackers on the benchmark, aiming to comprehend the performance of existing methods and provide a comparison for future research on DTTO. With the release of DTTO, our goal is to facilitate further research and applications related to tracking transforming objects.
Key facts. Cited by 4 papers in the map (data through 13 Oct 2026). Builds on 35 of its 55 references that are in the map. First posted on arXiv 28 Apr 2024.
Builds on
35 of 55 references.
References · 35
- 2017Attention Is All You Needcited by 60,106
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,043
- 2016Fully-Convolutional Siamese Networks for Object Trackingcited by 568
- 2018GOT-10k: A Large High-Diversity Benchmark for Generic Object Tracking in the Wildcited by 473
- 2018LaSOT: A High-quality Benchmark for Large-scale Single Object Trackingcited by 426
- 2021Transformer Trackingcited by 412
- 2021Learning Spatio-Temporal Transformer for Visual Trackingcited by 349
- 2018TrackingNet: A Large-Scale Dataset and Benchmark for Object Tracking in the Wildcited by 342
- 2022Joint Feature Learning and Relation Modeling for Tracking: A One-Stream Frameworkcited by 329
- 2022MixFormer: End-to-End Tracking with Iterative Mixed Attentioncited by 279
- 2020Probabilistic Regression for Visual Trackingcited by 231
- 2020Ocean: Object-aware Anchor-free Trackingcited by 212
23 more
- 2019Deeper and Wider Siamese Networks for Real-Time Visual Trackingcited by 156
- 2019SiamCAR: Siamese Fully Convolutional Classification and Regression for Visual Trackingcited by 148
- 2017Need for Speed: A Benchmark for Higher Frame Rate Object Trackingcited by 137
- 2020LaSOT: A High-quality Large-scale Single Object Tracking Benchmarkcited by 130
- 2022Transforming Model Prediction for Trackingcited by 117
- 2015A Novel Performance Evaluation Methodology for Single-Target Trackerscited by 113
- 2023Generalized Relation Modeling for Transformer Trackingcited by 93
- 2021STMTrack: Template-free Visual Tracking with Space-time Memory Networkscited by 91
- 2023Robust Object Modeling for Visual Trackingcited by 80
- 2024Autoregressive Queries for Adaptive Tracking with Spatio-TemporalTransformerscited by 76
- 2021Learn to Match: Automatic Matching Network Design for Visual Trackingcited by 67
- 2018Siamese Cascaded Region Proposal Networks for Real-Time Visual Trackingcited by 65
- 2023Exploring Lightweight Hierarchical Vision Transformers for Efficient Visual Trackingcited by 53
- 2024Explicit Visual Prompts for Visual Object Trackingcited by 50
- 2022Breaking the "Object" in Video Object Segmentationcited by 49
- 2022Robust Visual Tracking by Segmentationcited by 38
- 2023ZoomTrack: Target-aware Non-uniform Resizing for Efficient Visual Trackingcited by 25
- 2023DropMAE: Learning Representations via Masked Autoencoders with Spatial-Attention Dropout for Temporal Matching Taskscited by 22
- 2023DCPT: Darkness Clue-Prompted Tracking in Nighttime UAVscited by 16
- 2021Learning Residue-Aware Correlation Filters and Refining Scale Estimates with the GrabCut for Real-Time UAV Trackingcited by 9
- 2023Towards Discriminative Representations with Contrastive Instances for Real-Time UAV Trackingcited by 9
- 2023Lightweight Full-Convolutional Siamese Trackercited by 8
- 2023Learning Disentangled Representation with Mutual Information Maximization for Real-Time UAV Trackingcited by 5
Built on by
Citing papers per year: 2024: 2; 2025: 1; 2026: 1.
4 papers.
- 2025Tracking and Understanding Object Transformationscited by 3
- 2024Tracking Reflected Objects: A Benchmarkcited by 1
- 2024Towards Reflected Object Detection: A Benchmarkcited by 1
- 2026Efficient Tracking and Understanding Object Transformationscited by 0
- 2026Efficient Tracking and Understanding Object Transformations22 Jul 2026
- 2025Tracking and Understanding Object Transformations6 Nov 2025
- 2024Towards Reflected Object Detection: A Benchmark8 Jul 2024
- 2024Tracking Reflected Objects: A Benchmark7 Jul 2024