Depth Perspective-aware Multiple Object Tracking
Not on the map. Why?
Abstract (arXiv)
This paper aims to tackle Multiple Object Tracking (MOT), an important problem in computer vision but remains challenging due to many practical issues, especially occlusions. Indeed, we propose a new real-time Depth Perspective-aware Multiple Object Tracking (DP-MOT) approach to tackle the occlusion problem in MOT. A simple yet efficient Subject-Ordered Depth Estimation (SODE) is first proposed to automatically order the depth positions of detected subjects in a 2D scene in an unsupervised manner. Using the output from SODE, a new Active pseudo-3D Kalman filter, a simple but effective extension of Kalman filter with dynamic control variables, is then proposed to dynamically update the movement of objects. In addition, a new high-order association approach is presented in the data association step to incorporate first-order and second-order relationships between the detected objects. The proposed approach consistently achieves state-of-the-art performance compared to recent MOT methods on standard MOT benchmarks.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 36 of its 60 references that are in the map. First posted on arXiv 10 Jul 2022.
Builds on
36 of 60 references.
References · 36
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2018YOLOv3: An Incremental Improvementcited by 2,652
- 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
- 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
- 2016MOT16: A Benchmark for Multi-Object Trackingcited by 531
- 2020Tracking Objects as Pointscited by 483
- 2016Deeper Depth Prediction with Fully Convolutional Residual Networkscited by 402
- 2019Tracking without bells and whistlescited by 382
- 2019Towards Real-Time Multi-Object Trackingcited by 311
- 2019Learning a Neural Solver for Multiple Object Trackingcited by 198
- 2016Joint Detection and Identification Feature Learning for Person Searchcited by 190
24 more
- 2016Person Re-identification in the Wildcited by 157
- 2017Learning Depth from Monocular Videos using Direct Methodscited by 154
- 2015MOTChallenge 2015: Towards a Benchmark for Multi-Target Trackingcited by 133
- 2020Chained-Tracker: Chaining Paired Attentive Regression Results for End-to-End Joint Multiple-Object Detection and Trackingcited by 115
- 2020GNN3DMOT: Graph Neural Network for 3D Multi-Object Tracking with Multi-Feature Learningcited by 113
- 2018Deep Affinity Network for Multiple Object Trackingcited by 82
- 2021Monocular Quasi-Dense 3D Object Trackingcited by 80
- 2018Joint Monocular 3D Vehicle Detection and Trackingcited by 77
- 2019Online Multi-Object Tracking with Dual Matching Attention Networkscited by 77
- 2019Spatial-Temporal Relation Networks for Multi-Object Trackingcited by 74
- 2019How To Train Your Deep Multi-Object Trackercited by 71
- 2016Fast Optical Flow using Dense Inverse Searchcited by 70
- 2019FAMNet: Joint Learning of Feature, Affinity and Multi-dimensional Assignment for Online Multiple Object Trackingcited by 65
- 2021DEFT: Detection Embeddings for Trackingcited by 56
- 2020Lifted Disjoint Paths with Application in Multiple Object Trackingcited by 55
- 20193D Multi-Object Tracking: A Baseline and New Evaluation Metricscited by 47
- 2021Learning a Proposal Classifier for Multiple Object Trackingcited by 42
- 2020A Unified Object Motion and Affinity Model for Online Multi-Object Trackingcited by 33
- 2018Mono-Camera 3D Multi-Object Tracking Using Deep Learning Detections and PMBM Filteringcited by 32
- 2021DyGLIP: A Dynamic Graph Model with Link Prediction for Accurate Multi-Camera Multiple Object Trackingcited by 31
- 2020Simultaneous Detection and Tracking with Motion Modelling for Multiple Object Trackingcited by 25
- 2022Multi-Camera Multiple 3D Object Tracking on the Move for Autonomous Vehiclescited by 19
- 2019Online Multi-Object Tracking with Instance-Aware Tracker and Dynamic Model Refreshmentcited by 18
- 2018Trajectory Factory: Tracklet Cleaving and Re-connection by Deep Siamese Bi-GRU for Multiple Object Trackingcited by 7
Built on by
Citing papers per year: 2023: 4; 2024: 0; 2025: 3; 2026: 1.
8 papers.
- 2023SparseTrack: Multi-Object Tracking by Performing Scene Decomposition based on Pseudo-Depthcited by 48
- 2023Type-to-Track: Retrieve Any Object via Prompt-based Trackingcited by 24
- 2023SPARTAN: Self-supervised Spatiotemporal Transformers Approach to Group Activity Recognitioncited by 14
- 20233D Multiple Object Tracking on Autonomous Driving: A Literature Reviewcited by 4
- 2025Depth-Aware Scoring and Hierarchical Alignment for Multiple Object Trackingcited by 1
- 2025DepTR-MOT: Unveiling the Potential of Depth-Informed Trajectory Refinement for Multi-Object Trackingcited by 1
- 2026Occlusion-Aware SORT: Observing Occlusion for Robust Multi-Object Trackingcited by 1
- 2025Fast Self-Supervised depth and mask aware Association for Multi-Object Trackingcited by 0
- 2026Occlusion-Aware SORT: Observing Occlusion for Robust Multi-Object Tracking6 Mar 2026
- 2025Fast Self-Supervised depth and mask aware Association for Multi-Object Tracking10 Oct 2025
- 2025DepTR-MOT: Unveiling the Potential of Depth-Informed Trajectory Refinement for Multi-Object Tracking22 Sep 2025
- 2025Depth-Aware Scoring and Hierarchical Alignment for Multiple Object Tracking1 Jun 2025
- 20233D Multiple Object Tracking on Autonomous Driving: A Literature Review27 Sep 2023
- 2023SparseTrack: Multi-Object Tracking by Performing Scene Decomposition based on Pseudo-Depth8 Jun 2023
- 2023Type-to-Track: Retrieve Any Object via Prompt-based Tracking22 May 2023
- 2023SPARTAN: Self-supervised Spatiotemporal Transformers Approach to Group Activity Recognition6 Mar 2023