mlsanityData to 7 Oct 2026

MotionTrack: Learning Motion Predictor for Multiple Object Tracking

arXiv 2306.02585 ↗First posted 5 Jun 2023cs.CVcited by 20

Not on the map. Why?

Abstract (arXiv)

Significant progress has been achieved in multi-object tracking (MOT) through the evolution of detection and re-identification (ReID) techniques. Despite these advancements, accurately tracking objects in scenarios with homogeneous appearance and heterogeneous motion remains a challenge. This challenge arises from two main factors: the insufficient discriminability of ReID features and the predominant utilization of linear motion models in MOT. In this context, we introduce a novel motion-based tracker, MotionTrack, centered around a learnable motion predictor that relies solely on object trajectory information. This predictor comprehensively integrates two levels of granularity in motion features to enhance the modeling of temporal dynamics and facilitate precise future motion prediction for individual objects. Specifically, the proposed approach adopts a self-attention mechanism to capture token-level information and a Dynamic MLP layer to model channel-level features. MotionTrack is a simple, online tracking approach. Our experimental results demonstrate that MotionTrack yields state-of-the-art performance on datasets such as Dancetrack and SportsMOT, characterized by highly complex object motion.

Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 60 of its 81 references that are in the map. First posted on arXiv 5 Jun 2023.

Builds on

60 of 81 references.

References · 60

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  5. 2020End-to-End Object Detection with Transformerscited by 7,384
  6. 2016Layer Normalizationcited by 5,579
  7. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  8. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
  9. 2015Fast R-CNNcited by 2,930
  10. 2018YOLOv3: An Incremental Improvementcited by 2,652
  11. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
  12. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
38 more
  1. 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,447
  2. 2019Objects as Pointscited by 1,172
  3. 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,064
  4. 2017Simple Online and Realtime Tracking with a Deep Association Metriccited by 908
  5. 2016Simple Online and Realtime Trackingcited by 862
  6. 2017A Survey on Multi-Task Learningcited by 838
  7. 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 812
  8. 2017In Defense of the Triplet Loss for Person Re-Identificationcited by 784
  9. 2016Performance Measures and a Data Set for Multi-Target, Multi-Camera Trackingcited by 685
  10. 2020HOTA: A Higher Order Metric for Evaluating Multi-Object Trackingcited by 546
  11. 2016MOT16: A Benchmark for Multi-Object Trackingcited by 531
  12. 2021TrackFormer: Multi-Object Tracking with Transformerscited by 515
  13. 2020FairMOT: On the Fairness of Detection and Re-Identification in Multiple Object Trackingcited by 489
  14. 2020Tracking Objects as Pointscited by 483
  15. 2019Tracking without bells and whistlescited by 382
  16. 2021MOTR: End-to-End Multiple-Object Tracking with Transformercited by 379
  17. 2020TransTrack: Multiple Object Tracking with Transformercited by 370
  18. 2020MOT20: A benchmark for multi object tracking in crowded scenescited by 355
  19. 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 345
  20. 2020StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generationcited by 331
  21. 2021AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecastingcited by 327
  22. 2019Towards Real-Time Multi-Object Trackingcited by 311
  23. 2020Understanding the Role of Individual Units in a Deep Neural Networkcited by 254
  24. 2023TSMixer: An All-MLP Architecture for Time Series Forecastingcited by 232
  25. 2020Fast and Furious: Real Time End-to-End 3D Detection, Tracking and Motion Forecasting with a Single Convolutional Netcited by 228
  26. 2020Quasi-Dense Similarity Learning for Multiple Object Trackingcited by 220
  27. 2021DanceTrack: Multi-Object Tracking in Uniform Appearance and Diverse Motioncited by 213
  28. 2019Learning a Neural Solver for Multiple Object Trackingcited by 198
  29. 2021Track to Detect and Segment: An Online Multi-Object Trackercited by 156
  30. 2021GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Camerascited by 151
  31. 2023SportsMOT: A Large Multi-Object Tracking Dataset in Multiple Sports Scenescited by 130
  32. 2021Learning to Track with Object Permanencecited by 117
  33. 2022Global Tracking Transformerscited by 110
  34. 2020Rethinking the competition between detection and ReID in Multi-Object Trackingcited by 101
  35. 2015UA-DETRAC: A New Benchmark and Protocol for Multi-Object Detection and Trackingcited by 98
  36. 2018Real-time Multiple People Tracking with Deeply Learned Candidate Selection and Person Re-Identificationcited by 96
  37. 2021MultiSports: A Multi-Person Video Dataset of Spatio-Temporally Localized Sports Actionscited by 82
  38. 2017Tracking The Untrackable: Learning To Track Multiple Cues with Long-Term Dependenciescited by 76

50 most cited of 60 All 60 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 9; 2025: 7; 2026: 4.

20 papers.

Sort:

  1. 2024SAMURAI: Adapting Segment Anything Model for Zero-Shot Visual Tracking with Motion-Aware Memorycited by 91
  2. 2024DiffMOT: A Real-time Diffusion-based Multiple Object Tracker with Non-linear Predictioncited by 59
  3. 2024MambaTrack: A Simple Baseline for Multiple Object Tracking with State Space Modelcited by 18
  4. 2024ETTrack: Enhanced Temporal Motion Predictor for Multi-Object Trackingcited by 9
  5. 2024Beyond Kalman Filters: Deep Learning-Based Filters for Improved Object Trackingcited by 8
  6. 2024MambaMOT: State-Space Model as Motion Predictor for Multi-Object Trackingcited by 8
  7. 2024TrackSSM: A General Motion Predictor by State-Space Modelcited by 6
  8. 2024Temporal-Enhanced Multimodal Transformer for Referring Multi-Object Tracking and Segmentationcited by 6
  9. 2024Engineering an Efficient Object Tracker for Non-Linear Motioncited by 4
  10. 2025Deep Learning-Based Multi-Object Tracking: A Comprehensive Survey from Foundations to State-of-the-Artcited by 4
  11. 2025Motion-Aware Vision-Reference Alignment for Referring Multi-Object Trackingcited by 3
  12. 2025SportMamba: Adaptive Non-Linear Multi-Object Tracking with State Space Models for Team Sportscited by 2
8 more
  1. 2025Task-based Loss Functions in Computer Vision: A Comprehensive Reviewcited by 1
  2. 2025Depth-Aware Scoring and Hierarchical Alignment for Multiple Object Trackingcited by 1
  3. 2026Occlusion-Aware SORT: Observing Occlusion for Robust Multi-Object Trackingcited by 1
  4. 2026Drift-Resilient Temporal Priors for Visual Trackingcited by 1
  5. 2025Fast Self-Supervised depth and mask aware Association for Multi-Object Trackingcited by 0
  6. 2025Learning Association via Track-Detection Matching for Multi-Object Trackingcited by 0
  7. 2026Time-series Meets Complex Motion Modeling: Robust and Computational-effective Motion Predictor for Multi-object Trackingcited by 0
  8. 2026Motion-Aware Reinforcement Learning For Object Localizationcited by 0