MotionTrack: Learning Motion Predictor for Multiple Object Tracking
Not on the map. Why?
Abstract (arXiv)
Significant progress has been achieved in multi-object tracking (MOT) through the evolution of detection and re-identification (ReID) techniques. Despite these advancements, accurately tracking objects in scenarios with homogeneous appearance and heterogeneous motion remains a challenge. This challenge arises from two main factors: the insufficient discriminability of ReID features and the predominant utilization of linear motion models in MOT. In this context, we introduce a novel motion-based tracker, MotionTrack, centered around a learnable motion predictor that relies solely on object trajectory information. This predictor comprehensively integrates two levels of granularity in motion features to enhance the modeling of temporal dynamics and facilitate precise future motion prediction for individual objects. Specifically, the proposed approach adopts a self-attention mechanism to capture token-level information and a Dynamic MLP layer to model channel-level features. MotionTrack is a simple, online tracking approach. Our experimental results demonstrate that MotionTrack yields state-of-the-art performance on datasets such as Dancetrack and SportsMOT, characterized by highly complex object motion.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 60 of its 81 references that are in the map. First posted on arXiv 5 Jun 2023.
Builds on
60 of 81 references.
References · 60
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2016Layer Normalizationcited by 5,579
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
- 2015Fast R-CNNcited by 2,930
- 2018YOLOv3: An Incremental Improvementcited by 2,652
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
38 more
- 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,447
- 2019Objects as Pointscited by 1,172
- 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,064
- 2017Simple Online and Realtime Tracking with a Deep Association Metriccited by 908
- 2016Simple Online and Realtime Trackingcited by 862
- 2017A Survey on Multi-Task Learningcited by 838
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 812
- 2017In Defense of the Triplet Loss for Person Re-Identificationcited by 784
- 2016Performance Measures and a Data Set for Multi-Target, Multi-Camera Trackingcited by 685
- 2020HOTA: A Higher Order Metric for Evaluating Multi-Object Trackingcited by 546
- 2016MOT16: A Benchmark for Multi-Object Trackingcited by 531
- 2021TrackFormer: Multi-Object Tracking with Transformerscited by 515
- 2020FairMOT: On the Fairness of Detection and Re-Identification in Multiple Object Trackingcited by 489
- 2020Tracking Objects as Pointscited by 483
- 2019Tracking without bells and whistlescited by 382
- 2021MOTR: End-to-End Multiple-Object Tracking with Transformercited by 379
- 2020TransTrack: Multiple Object Tracking with Transformercited by 370
- 2020MOT20: A benchmark for multi object tracking in crowded scenescited by 355
- 2022Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Trackingcited by 345
- 2020StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generationcited by 331
- 2021AgentFormer: Agent-Aware Transformers for Socio-Temporal Multi-Agent Forecastingcited by 327
- 2019Towards Real-Time Multi-Object Trackingcited by 311
- 2020Understanding the Role of Individual Units in a Deep Neural Networkcited by 254
- 2023TSMixer: An All-MLP Architecture for Time Series Forecastingcited by 232
- 2020Fast and Furious: Real Time End-to-End 3D Detection, Tracking and Motion Forecasting with a Single Convolutional Netcited by 228
- 2020Quasi-Dense Similarity Learning for Multiple Object Trackingcited by 220
- 2021DanceTrack: Multi-Object Tracking in Uniform Appearance and Diverse Motioncited by 213
- 2019Learning a Neural Solver for Multiple Object Trackingcited by 198
- 2021Track to Detect and Segment: An Online Multi-Object Trackercited by 156
- 2021GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Camerascited by 151
- 2023SportsMOT: A Large Multi-Object Tracking Dataset in Multiple Sports Scenescited by 130
- 2021Learning to Track with Object Permanencecited by 117
- 2022Global Tracking Transformerscited by 110
- 2020Rethinking the competition between detection and ReID in Multi-Object Trackingcited by 101
- 2015UA-DETRAC: A New Benchmark and Protocol for Multi-Object Detection and Trackingcited by 98
- 2018Real-time Multiple People Tracking with Deeply Learned Candidate Selection and Person Re-Identificationcited by 96
- 2021MultiSports: A Multi-Person Video Dataset of Spatio-Temporally Localized Sports Actionscited by 82
- 2017Tracking The Untrackable: Learning To Track Multiple Cues with Long-Term Dependenciescited by 76
50 most cited of 60 All 60 (JSON)
Built on by
Citing papers per year: 2024: 9; 2025: 7; 2026: 4.
20 papers.
Sort:
- 2024SAMURAI: Adapting Segment Anything Model for Zero-Shot Visual Tracking with Motion-Aware Memorycited by 91
- 2024DiffMOT: A Real-time Diffusion-based Multiple Object Tracker with Non-linear Predictioncited by 59
- 2024MambaTrack: A Simple Baseline for Multiple Object Tracking with State Space Modelcited by 18
- 2024ETTrack: Enhanced Temporal Motion Predictor for Multi-Object Trackingcited by 9
- 2024Beyond Kalman Filters: Deep Learning-Based Filters for Improved Object Trackingcited by 8
- 2024MambaMOT: State-Space Model as Motion Predictor for Multi-Object Trackingcited by 8
- 2024TrackSSM: A General Motion Predictor by State-Space Modelcited by 6
- 2024Temporal-Enhanced Multimodal Transformer for Referring Multi-Object Tracking and Segmentationcited by 6
- 2024Engineering an Efficient Object Tracker for Non-Linear Motioncited by 4
- 2025Deep Learning-Based Multi-Object Tracking: A Comprehensive Survey from Foundations to State-of-the-Artcited by 4
- 2025Motion-Aware Vision-Reference Alignment for Referring Multi-Object Trackingcited by 3
- 2025SportMamba: Adaptive Non-Linear Multi-Object Tracking with State Space Models for Team Sportscited by 2
8 more
- 2025Task-based Loss Functions in Computer Vision: A Comprehensive Reviewcited by 1
- 2025Depth-Aware Scoring and Hierarchical Alignment for Multiple Object Trackingcited by 1
- 2026Occlusion-Aware SORT: Observing Occlusion for Robust Multi-Object Trackingcited by 1
- 2026Drift-Resilient Temporal Priors for Visual Trackingcited by 1
- 2025Fast Self-Supervised depth and mask aware Association for Multi-Object Trackingcited by 0
- 2025Learning Association via Track-Detection Matching for Multi-Object Trackingcited by 0
- 2026Time-series Meets Complex Motion Modeling: Robust and Computational-effective Motion Predictor for Multi-object Trackingcited by 0
- 2026Motion-Aware Reinforcement Learning For Object Localizationcited by 0
- 2026Motion-Aware Reinforcement Learning For Object Localization19 Jun 2026
- 2026Time-series Meets Complex Motion Modeling: Robust and Computational-effective Motion Predictor for Multi-object Tracking1 May 2026
- 2026Drift-Resilient Temporal Priors for Visual Tracking3 Apr 2026
- 2026Occlusion-Aware SORT: Observing Occlusion for Robust Multi-Object Tracking6 Mar 2026
- 2025Learning Association via Track-Detection Matching for Multi-Object Tracking26 Dec 2025
- 2025Motion-Aware Vision-Reference Alignment for Referring Multi-Object Tracking21 Nov 2025
- 2025Fast Self-Supervised depth and mask aware Association for Multi-Object Tracking10 Oct 2025
- 2025Deep Learning-Based Multi-Object Tracking: A Comprehensive Survey from Foundations to State-of-the-Art16 Jun 2025
- 2025SportMamba: Adaptive Non-Linear Multi-Object Tracking with State Space Models for Team Sports3 Jun 2025
- 2025Depth-Aware Scoring and Hierarchical Alignment for Multiple Object Tracking1 Jun 2025
- 2025Task-based Loss Functions in Computer Vision: A Comprehensive Review5 Apr 2025
- 2024SAMURAI: Adapting Segment Anything Model for Zero-Shot Visual Tracking with Motion-Aware Memory18 Nov 2024
8 more
- 2024Temporal-Enhanced Multimodal Transformer for Referring Multi-Object Tracking and Segmentation17 Oct 2024
- 2024TrackSSM: A General Motion Predictor by State-Space Model31 Aug 2024
- 2024MambaTrack: A Simple Baseline for Multiple Object Tracking with State Space Model17 Aug 2024
- 2024Engineering an Efficient Object Tracker for Non-Linear Motion30 Jun 2024
- 2024ETTrack: Enhanced Temporal Motion Predictor for Multi-Object Tracking24 May 2024
- 2024MambaMOT: State-Space Model as Motion Predictor for Multi-Object Tracking16 Mar 2024
- 2024DiffMOT: A Real-time Diffusion-based Multiple Object Tracker with Non-linear Prediction4 Mar 2024
- 2024Beyond Kalman Filters: Deep Learning-Based Filters for Improved Object Tracking15 Feb 2024
- 2024SAMURAI: Adapting Segment Anything Model for Zero-Shot Visual Tracking with Motion-Aware Memorycited by 91
- 2024DiffMOT: A Real-time Diffusion-based Multiple Object Tracker with Non-linear Predictioncited by 59
- 2024MambaTrack: A Simple Baseline for Multiple Object Tracking with State Space Modelcited by 18
- 2024ETTrack: Enhanced Temporal Motion Predictor for Multi-Object Trackingcited by 9
- 2024Beyond Kalman Filters: Deep Learning-Based Filters for Improved Object Trackingcited by 8
- 2024MambaMOT: State-Space Model as Motion Predictor for Multi-Object Trackingcited by 8
- 2024TrackSSM: A General Motion Predictor by State-Space Modelcited by 6
- 2024Temporal-Enhanced Multimodal Transformer for Referring Multi-Object Tracking and Segmentationcited by 6
- 2024Engineering an Efficient Object Tracker for Non-Linear Motioncited by 4
- 2025Deep Learning-Based Multi-Object Tracking: A Comprehensive Survey from Foundations to State-of-the-Artcited by 4
- 2025Motion-Aware Vision-Reference Alignment for Referring Multi-Object Trackingcited by 3
- 2025SportMamba: Adaptive Non-Linear Multi-Object Tracking with State Space Models for Team Sportscited by 2
12 most cited of 20 All 20 (JSON)
- 2026Motion-Aware Reinforcement Learning For Object Localization19 Jun 2026
- 2026Time-series Meets Complex Motion Modeling: Robust and Computational-effective Motion Predictor for Multi-object Tracking1 May 2026
- 2026Drift-Resilient Temporal Priors for Visual Tracking3 Apr 2026
- 2026Occlusion-Aware SORT: Observing Occlusion for Robust Multi-Object Tracking6 Mar 2026
- 2025Learning Association via Track-Detection Matching for Multi-Object Tracking26 Dec 2025
- 2025Motion-Aware Vision-Reference Alignment for Referring Multi-Object Tracking21 Nov 2025
- 2025Fast Self-Supervised depth and mask aware Association for Multi-Object Tracking10 Oct 2025
- 2025Deep Learning-Based Multi-Object Tracking: A Comprehensive Survey from Foundations to State-of-the-Art16 Jun 2025
- 2025SportMamba: Adaptive Non-Linear Multi-Object Tracking with State Space Models for Team Sports3 Jun 2025
- 2025Depth-Aware Scoring and Hierarchical Alignment for Multiple Object Tracking1 Jun 2025
- 2025Task-based Loss Functions in Computer Vision: A Comprehensive Review5 Apr 2025
- 2024SAMURAI: Adapting Segment Anything Model for Zero-Shot Visual Tracking with Motion-Aware Memory18 Nov 2024
12 newest of 20 All 20 (JSON)