mlsanityData to 14 Oct 2026

ETTrack: Enhanced Temporal Motion Predictor for Multi-Object Tracking

arXiv 2405.15755 ↗First posted 24 May 2024cs.CVcited by 9

Not on the map. Why?

Abstract (arXiv)

Many Multi-Object Tracking (MOT) approaches exploit motion information to associate all the detected objects across frames. However, many methods that rely on filtering-based algorithms, such as the Kalman Filter, often work well in linear motion scenarios but struggle to accurately predict the locations of objects undergoing complex and non-linear movements. To tackle these scenarios, we propose a motion-based MOT approach with an enhanced temporal motion predictor, ETTrack. Specifically, the motion predictor integrates a transformer model and a Temporal Convolutional Network (TCN) to capture short-term and long-term motion patterns, and it predicts the future motion of individual objects based on the historical motion information. Additionally, we propose a novel Momentum Correction Loss function that provides additional information regarding the motion direction of objects during training. This allows the motion predictor rapidly adapt to motion variations and more accurately predict future motion. Our experimental results demonstrate that ETTrack achieves a competitive performance compared with state-of-the-art trackers on DanceTrack and SportsMOT, scoring 56.4% and 74.4% in HOTA metrics, respectively.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 44 of its 58 references that are in the map. First posted on arXiv 24 May 2024.

Builds on

44 of 58 references.

References · 44

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  4. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
  5. 2016Wide Residual Networkscited by 3,070
  6. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
  7. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
  8. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,863
  9. 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,476
  10. 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,071
  11. 2021CvT: Introducing Convolutions to Vision Transformerscited by 947
  12. 2017Simple Online and Realtime Tracking with a Deep Association Metriccited by 910
32 more
  1. 2016Simple Online and Realtime Trackingcited by 868
  2. 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 823
  3. 2016Performance Measures and a Data Set for Multi-Target, Multi-Camera Trackingcited by 692
  4. 2020HOTA: A Higher Order Metric for Evaluating Multi-Object Trackingcited by 552
  5. 2016MOT16: A Benchmark for Multi-Object Trackingcited by 532
  6. 2021TrackFormer: Multi-Object Tracking with Transformerscited by 518
  7. 2020FairMOT: On the Fairness of Detection and Re-Identification in Multiple Object Trackingcited by 490
  8. 2020Tracking Objects as Pointscited by 483
  9. 2021MOTR: End-to-End Multiple-Object Tracking with Transformercited by 381
  10. 2020TransTrack: Multiple Object Tracking with Transformercited by 371
  11. 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 346
  12. 2022BoT-SORT: Robust Associations Multi-Pedestrian Trackingcited by 320
  13. 2019Towards Real-Time Multi-Object Trackingcited by 311
  14. 2020Fast and Furious: Real Time End-to-End 3D Detection, Tracking and Motion Forecasting with a Single Convolutional Netcited by 228
  15. 2021DanceTrack: Multi-Object Tracking in Uniform Appearance and Diverse Motioncited by 217
  16. 2022StrongSORT: Make DeepSORT Great Againcited by 213
  17. 2021Track to Detect and Segment: An Online Multi-Object Trackercited by 156
  18. 2021GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Camerascited by 153
  19. 2022MOTRv2: Bootstrapping End-to-End Multi-Object Tracking by Pretrained Object Detectorscited by 148
  20. 2023SportsMOT: A Large Multi-Object Tracking Dataset in Multiple Sports Scenescited by 131
  21. 2022Global Tracking Transformerscited by 110
  22. 2021TransMOT: Spatial-Temporal Graph Transformer for Multiple Object Trackingcited by 93
  23. 2023MeMOTR: Long-Term Memory-Augmented Transformer for Multi-Object Trackingcited by 88
  24. 2022QDTrack: Quasi-Dense Similarity Learning for Appearance-Only Multiple Object Trackingcited by 61
  25. 2016Online Multi-Target Tracking Using Recurrent Neural Networkscited by 59
  26. 2021DEFT: Detection Embeddings for Trackingcited by 56
  27. 2015Near-Online Multi-target Tracking with Aggregated Local Flow Descriptorcited by 46
  28. 2021TransCenter: Transformers with Dense Representations for Multiple-Object Trackingcited by 42
  29. 2021DeepCervix: A Deep Learning-based Framework for the Classification of Cervical Cells Using Hybrid Deep Feature Fusion Techniquescited by 23
  30. 2023MotionTrack: Learning Motion Predictor for Multiple Object Trackingcited by 20
  31. 2023A Survey of Deep Learning in Sports Applications: Perception, Comprehension, and Decisioncited by 11
  32. 2021Joint Learning Architecture for Multiple Object Tracking and Trajectory Forecastingcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 2; 2025: 5; 2026: 2.

9 papers.