ETTrack: Enhanced Temporal Motion Predictor for Multi-Object Tracking
Not on the map. Why?
Abstract (arXiv)
Many Multi-Object Tracking (MOT) approaches exploit motion information to associate all the detected objects across frames. However, many methods that rely on filtering-based algorithms, such as the Kalman Filter, often work well in linear motion scenarios but struggle to accurately predict the locations of objects undergoing complex and non-linear movements. To tackle these scenarios, we propose a motion-based MOT approach with an enhanced temporal motion predictor, ETTrack. Specifically, the motion predictor integrates a transformer model and a Temporal Convolutional Network (TCN) to capture short-term and long-term motion patterns, and it predicts the future motion of individual objects based on the historical motion information. Additionally, we propose a novel Momentum Correction Loss function that provides additional information regarding the motion direction of objects during training. This allows the motion predictor rapidly adapt to motion variations and more accurately predict future motion. Our experimental results demonstrate that ETTrack achieves a competitive performance compared with state-of-the-art trackers on DanceTrack and SportsMOT, scoring 56.4% and 74.4% in HOTA metrics, respectively.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 44 of its 58 references that are in the map. First posted on arXiv 24 May 2024.
Builds on
44 of 58 references.
References · 44
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
- 2016Wide Residual Networkscited by 3,070
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,863
- 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,476
- 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,071
- 2021CvT: Introducing Convolutions to Vision Transformerscited by 947
- 2017Simple Online and Realtime Tracking with a Deep Association Metriccited by 910
32 more
- 2016Simple Online and Realtime Trackingcited by 868
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 823
- 2016Performance Measures and a Data Set for Multi-Target, Multi-Camera Trackingcited by 692
- 2020HOTA: A Higher Order Metric for Evaluating Multi-Object Trackingcited by 552
- 2016MOT16: A Benchmark for Multi-Object Trackingcited by 532
- 2021TrackFormer: Multi-Object Tracking with Transformerscited by 518
- 2020FairMOT: On the Fairness of Detection and Re-Identification in Multiple Object Trackingcited by 490
- 2020Tracking Objects as Pointscited by 483
- 2021MOTR: End-to-End Multiple-Object Tracking with Transformercited by 381
- 2020TransTrack: Multiple Object Tracking with Transformercited by 371
- 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 346
- 2022BoT-SORT: Robust Associations Multi-Pedestrian Trackingcited by 320
- 2019Towards Real-Time Multi-Object Trackingcited by 311
- 2020Fast and Furious: Real Time End-to-End 3D Detection, Tracking and Motion Forecasting with a Single Convolutional Netcited by 228
- 2021DanceTrack: Multi-Object Tracking in Uniform Appearance and Diverse Motioncited by 217
- 2022StrongSORT: Make DeepSORT Great Againcited by 213
- 2021Track to Detect and Segment: An Online Multi-Object Trackercited by 156
- 2021GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Camerascited by 153
- 2022MOTRv2: Bootstrapping End-to-End Multi-Object Tracking by Pretrained Object Detectorscited by 148
- 2023SportsMOT: A Large Multi-Object Tracking Dataset in Multiple Sports Scenescited by 131
- 2022Global Tracking Transformerscited by 110
- 2021TransMOT: Spatial-Temporal Graph Transformer for Multiple Object Trackingcited by 93
- 2023MeMOTR: Long-Term Memory-Augmented Transformer for Multi-Object Trackingcited by 88
- 2022QDTrack: Quasi-Dense Similarity Learning for Appearance-Only Multiple Object Trackingcited by 61
- 2016Online Multi-Target Tracking Using Recurrent Neural Networkscited by 59
- 2021DEFT: Detection Embeddings for Trackingcited by 56
- 2015Near-Online Multi-target Tracking with Aggregated Local Flow Descriptorcited by 46
- 2021TransCenter: Transformers with Dense Representations for Multiple-Object Trackingcited by 42
- 2021DeepCervix: A Deep Learning-based Framework for the Classification of Cervical Cells Using Hybrid Deep Feature Fusion Techniquescited by 23
- 2023MotionTrack: Learning Motion Predictor for Multiple Object Trackingcited by 20
- 2023A Survey of Deep Learning in Sports Applications: Perception, Comprehension, and Decisioncited by 11
- 2021Joint Learning Architecture for Multiple Object Tracking and Trajectory Forecastingcited by 4
Built on by
Citing papers per year: 2024: 2; 2025: 5; 2026: 2.
9 papers.
- 2024TrackSSM: A General Motion Predictor by State-Space Modelcited by 6
- 2025CAMELTrack: Context-Aware Multi-cue ExpLoitation for Online Multi-Object Trackingcited by 4
- 2025Deep Learning-Based Multi-Object Tracking: A Comprehensive Survey from Foundations to State-of-the-Artcited by 4
- 2025NOOUGAT: Towards Unified Online and Offline Multi-Object Trackingcited by 3
- 2026Hypergraph-State Collaborative Reasoning for Multi-Object Trackingcited by 2
- 2025GRASPTrack: Geometry-Reasoned Association via Segmentation and Projection for Multi-Object Trackingcited by 1
- 2026Occlusion-Aware SORT: Observing Occlusion for Robust Multi-Object Trackingcited by 1
- 2024Tracking by Detection and Query: An Efficient End-to-End Framework for Multi-Object Trackingcited by 0
- 2025Learning Association via Track-Detection Matching for Multi-Object Trackingcited by 0
- 2026Hypergraph-State Collaborative Reasoning for Multi-Object Tracking14 Apr 2026
- 2026Occlusion-Aware SORT: Observing Occlusion for Robust Multi-Object Tracking6 Mar 2026
- 2025Learning Association via Track-Detection Matching for Multi-Object Tracking26 Dec 2025
- 2025NOOUGAT: Towards Unified Online and Offline Multi-Object Tracking2 Sep 2025
- 2025GRASPTrack: Geometry-Reasoned Association via Segmentation and Projection for Multi-Object Tracking11 Aug 2025
- 2025Deep Learning-Based Multi-Object Tracking: A Comprehensive Survey from Foundations to State-of-the-Art16 Jun 2025
- 2025CAMELTrack: Context-Aware Multi-cue ExpLoitation for Online Multi-Object Tracking2 May 2025
- 2024Tracking by Detection and Query: An Efficient End-to-End Framework for Multi-Object Tracking9 Nov 2024
- 2024TrackSSM: A General Motion Predictor by State-Space Model31 Aug 2024