Probabilistic 3D Multi-Object Tracking for Autonomous Driving
Not on the map. Why?
Abstract (arXiv)
3D multi-object tracking is a key module in autonomous driving applications that provides a reliable dynamic representation of the world to the planning module. In this paper, we present our on-line tracking method, which made the first place in the NuScenes Tracking Challenge, held at the AI Driving Olympics Workshop at NeurIPS 2019. Our method estimates the object states by adopting a Kalman Filter. We initialize the state covariance as well as the process and observation noise covariance with statistics from the training set. We also use the stochastic information from the Kalman Filter in the data association step by measuring the Mahalanobis distance between the predicted object states and current object detections. Our experimental results on the NuScenes validation and test set show that our method outperforms the AB3DMOT baseline method by a large margin in the Average Multi-Object Tracking Accuracy (AMOTA) metric.
Key facts. Cited by 64 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Jan 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 15; 2022: 23; 2023: 16; 2024: 8; 2025: 1; 2026: 1.
64 papers.
Sort:
By area:
- 2021Panoptic nuScenes: A Large-Scale Benchmark for LiDAR Panoptic Segmentation and Trackingcited by 165
- 2021SimpleTrack: Understanding and Rethinking 3D Multi-object Trackingcited by 102
- 2021EagerMOT: 3D Multi-Object Tracking via Sensor Fusioncited by 83
- 2021Box-Aware Feature Enhancement for Single Object Tracking on Point Cloudscited by 66
- 2021Exploring Simple 3D Multi-Object Tracking for Autonomous Drivingcited by 56
- 2022Beyond 3D Siamese Tracking: A Motion-Centric Paradigm for 3D Single Object Tracking in Point Cloudscited by 55
- 20213D Siamese Voxel-to-BEV Tracker for Sparse Point Cloudscited by 54
- 20223D Siamese Transformer Network for Single Object Tracking on Point Cloudscited by 44
- 2021Immortal Tracker: Tracklet Never Diescited by 42
- 2021Learnable Online Graph Representations for 3D Multi-Object Trackingcited by 38
- 2022STCrowd: A Multimodal Dataset for Pedestrian Perception in Crowded Scenescited by 35
- 20224D-StOP: Panoptic Segmentation of 4D LiDAR using Spatio-temporal Object Proposal Generation and Aggregationcited by 35
38 more
- 2022DeepFusionMOT: A 3D Multi-Object Tracking Framework Based on Camera-LiDAR Fusion with Deep Associationcited by 33
- 2024ADA-Track++: End-to-End Multi-Camera 3D Multi-Object Tracking with Alternating Detection and Associationcited by 33
- 2021Score refinement for confidence-based 3D multi-object trackingcited by 32
- 2022PolarMOT: How Far Can Geometric Relations Take Us in 3D Multi-Object Tracking?cited by 29
- 2022CXTrack: Improving 3D Point Cloud Tracking with Contextual Informationcited by 28
- 20223D Multi-Object Tracking Using Graph Neural Networks with Cross-Edge Modality Attentioncited by 27
- 2023MBPTrack: Improving 3D Point Cloud Tracking with Memory Networks and Box Priorscited by 24
- 2021Exploiting Playbacks in Unsupervised Domain Adaptation for 3D Object Detectioncited by 21
- 2022ShaSTA: Modeling Shape and Spatio-Temporal Affinities for 3D Multi-Object Trackingcited by 21
- 20233DMOTFormer: Graph Transformer for Online 3D Multi-Object Trackingcited by 21
- 2022Multi-Camera Multiple 3D Object Tracking on the Move for Autonomous Vehiclescited by 19
- 2022GNN-PMB: A Simple but Effective Online 3D Multi-Object Tracker without Bells and Whistlescited by 15
- 2023Probabilistic 3D Multi-Object Cooperative Tracking for Autonomous Driving via Differentiable Multi-Sensor Kalman Filtercited by 15
- 2022Transformers for Multi-Object Tracking on Point Cloudscited by 14
- 2023An Effective Motion-Centric Paradigm for 3D Single Object Tracking in Point Cloudscited by 14
- 2023TrajectoryFormer: 3D Object Tracking Transformer with Predictive Trajectory Hypothesescited by 14
- 2023TrackFlow: Multi-Object Tracking with Normalizing Flowscited by 13
- 2022Neural Enhanced Belief Propagation for Multiobject Trackingcited by 11
- 2022SpOT: Spatiotemporal Modeling for 3D Object Trackingcited by 10
- 2022Minkowski Tracker: A Sparse Spatio-Temporal R-CNN for Joint Object Detection and Trackingcited by 9
- 2023LEGO: Learning and Graph-Optimized Modular Tracker for Online Multi-Object Tracking with Point Cloudscited by 9
- 2023You Only Need Two Detectors to Achieve Multi-Modal 3D Multi-Object Trackingcited by 8
- 2022Multi-Camera Multi-Object Tracking on the Move via Single-Stage Global Association Approachcited by 7
- 2022Multi-view Tracking, Re-ID, and Social Network Analysis of a Flock of Visually Similar Birds in an Outdoor Aviarycited by 7
- 2021Multi-Object Tracking using Poisson Multi-Bernoulli Mixture Filtering for Autonomous Vehiclescited by 6
- 2022InterTrack: Interaction Transformer for 3D Multi-Object Trackingcited by 6
- 2021Joint 3D Object Detection and Tracking Using Spatio-Temporal Representation of Camera Image and LiDAR Point Cloudscited by 5
- 2022Sequential Point Clouds: A Surveycited by 5
- 2023Selective Communication for Cooperative Perception in End-to-End Autonomous Drivingcited by 5
- 2022T2FPV: Dataset and Method for Correcting First-Person View Errors in Pedestrian Trajectory Predictioncited by 4
- 20233D Multiple Object Tracking on Autonomous Driving: A Literature Reviewcited by 4
- 2024JDT3D: Addressing the Gaps in LiDAR-Based Tracking-by-Attentioncited by 4
- 20243D Single-object Tracking in Point Clouds with High Temporal Variationcited by 4
- 2021A two-stage data association approach for 3D Multi-object Trackingcited by 3
- 20233D Multi-Object Tracking Based on Uncertainty-Guided Data Associationcited by 3
- 2024GSLAMOT: A Tracklet and Query Graph-based Simultaneous Locating, Mapping, and Multiple Object Tracking Systemcited by 3
- 2022DetFlowTrack: 3D Multi-object Tracking based on Simultaneous Optimization of Object Detection and Scene Flow Estimationcited by 2
- 2023BEVTrack: A Simple and Strong Baseline for 3D Single Object Tracking in Bird's-Eye Viewcited by 2
50 most cited of 64 All 64 (JSON)
- 2026Radar-Informed 3D Multi-Object Tracking under Adverse Conditions15 Apr 2026
- 2025Radar Tracker: Moving Instance Tracking in Sparse and Noisy Radar Point Clouds4 Jul 2025
- 20243D Multi-Object Tracking Employing MS-GLMB Filter for Autonomous Driving19 Oct 2024
- 2024GSLAMOT: A Tracklet and Query Graph-based Simultaneous Locating, Mapping, and Multiple Object Tracking System17 Aug 2024
- 20243D Single-object Tracking in Point Clouds with High Temporal Variation4 Aug 2024
- 2024JDT3D: Addressing the Gaps in LiDAR-Based Tracking-by-Attention6 Jul 2024
- 2024Multi-Object Tracking based on Imaging Radar 3D Object Detection3 Jun 2024
- 2024ADA-Track++: End-to-End Multi-Camera 3D Multi-Object Tracking with Alternating Detection and Association14 May 2024
- 2024STT: Stateful Tracking with Transformers for Autonomous Driving30 Apr 2024
- 20243D Semantic MapNet: Building Maps for Multi-Object Re-Identification in 3D19 Mar 2024
- 2023ShaSTA-Fuse: Camera-LiDAR Sensor Fusion to Model Shape and Spatio-Temporal Affinities for 3D Multi-Object Tracking4 Oct 2023
- 20233D Multiple Object Tracking on Autonomous Driving: A Literature Review27 Sep 2023
38 more
- 2023Probabilistic 3D Multi-Object Cooperative Tracking for Autonomous Driving via Differentiable Multi-Sensor Kalman Filter26 Sep 2023
- 2023BEVTrack: A Simple and Strong Baseline for 3D Single Object Tracking in Bird's-Eye View5 Sep 2023
- 2023Group Regression for Query Based Object Detection and Tracking28 Aug 2023
- 2023TrackFlow: Multi-Object Tracking with Normalizing Flows22 Aug 2023
- 2023LEGO: Learning and Graph-Optimized Modular Tracker for Online Multi-Object Tracking with Point Clouds19 Aug 2023
- 2023BOTT: Box Only Transformer Tracker for 3D Object Tracking17 Aug 2023
- 20233DMOTFormer: Graph Transformer for Online 3D Multi-Object Tracking12 Aug 2023
- 2023A survey on deep learning approaches for data integration in autonomous driving system17 Jun 2023
- 2023TrajectoryFormer: 3D Object Tracking Transformer with Predictive Trajectory Hypotheses9 Jun 2023
- 2023Selective Communication for Cooperative Perception in End-to-End Autonomous Driving26 May 2023
- 2023You Only Need Two Detectors to Achieve Multi-Modal 3D Multi-Object Tracking18 Apr 2023
- 2023An Effective Motion-Centric Paradigm for 3D Single Object Tracking in Point Clouds21 Mar 2023
- 2023MBPTrack: Improving 3D Point Cloud Tracking with Memory Networks and Box Priors9 Mar 2023
- 20233D Multi-Object Tracking Based on Uncertainty-Guided Data Association3 Mar 2023
- 2022Neural Enhanced Belief Propagation for Multiobject Tracking16 Dec 2022
- 2022Multi-view Tracking, Re-ID, and Social Network Analysis of a Flock of Visually Similar Birds in an Outdoor Aviary1 Dec 2022
- 2022Multi-Camera Multi-Object Tracking on the Move via Single-Stage Global Association Approach17 Nov 2022
- 2022CXTrack: Improving 3D Point Cloud Tracking with Contextual Information12 Nov 2022
- 2022ShaSTA: Modeling Shape and Spatio-Temporal Affinities for 3D Multi-Object Tracking8 Nov 2022
- 2022Can Transformer Attention Spread Give Insights Into Uncertainty of Detected and Tracked Objects?26 Oct 2022
- 20224D-StOP: Panoptic Segmentation of 4D LiDAR using Spatio-temporal Object Proposal Generation and Aggregation29 Sep 2022
- 2022T2FPV: Dataset and Method for Correcting First-Person View Errors in Pedestrian Trajectory Prediction22 Sep 2022
- 2022Minkowski Tracker: A Sparse Spatio-Temporal R-CNN for Joint Object Detection and Tracking22 Aug 2022
- 2022InterTrack: Interaction Transformer for 3D Multi-Object Tracking17 Aug 2022
- 2022PolarMOT: How Far Can Geometric Relations Take Us in 3D Multi-Object Tracking?3 Aug 2022
- 20223D Siamese Transformer Network for Single Object Tracking on Point Clouds25 Jul 2022
- 2022SpOT: Spatiotemporal Modeling for 3D Object Tracking12 Jul 2022
- 2022GNN-PMB: A Simple but Effective Online 3D Multi-Object Tracker without Bells and Whistles21 Jun 2022
- 2022Transformers for Multi-Object Tracking on Point Clouds31 May 2022
- 2022Sequential Point Clouds: A Survey20 Apr 2022
- 2022Multi-Camera Multiple 3D Object Tracking on the Move for Autonomous Vehicles19 Apr 2022
- 2022STCrowd: A Multimodal Dataset for Pedestrian Perception in Crowded Scenes3 Apr 2022
- 2022Online panoptic 3D reconstruction as a Linear Assignment Problem1 Apr 2022
- 20223D Multi-Object Tracking Using Graph Neural Networks with Cross-Edge Modality Attention21 Mar 2022
- 2022DetFlowTrack: 3D Multi-object Tracking based on Simultaneous Optimization of Object Detection and Scene Flow Estimation4 Mar 2022
- 2022Beyond 3D Siamese Tracking: A Motion-Centric Paradigm for 3D Single Object Tracking in Point Clouds3 Mar 2022
- 2022DeepFusionMOT: A 3D Multi-Object Tracking Framework Based on Camera-LiDAR Fusion with Deep Association24 Feb 2022
- 2021Joint 3D Object Detection and Tracking Using Spatio-Temporal Representation of Camera Image and LiDAR Point Clouds14 Dec 2021
50 newest of 64 All 64 (JSON)
- 2021Panoptic nuScenes: A Large-Scale Benchmark for LiDAR Panoptic Segmentation and Trackingcited by 165
- 2021SimpleTrack: Understanding and Rethinking 3D Multi-object Trackingcited by 102
- 2021EagerMOT: 3D Multi-Object Tracking via Sensor Fusioncited by 83
- 2021Box-Aware Feature Enhancement for Single Object Tracking on Point Cloudscited by 66
- 2021Exploring Simple 3D Multi-Object Tracking for Autonomous Drivingcited by 56
- 2022Beyond 3D Siamese Tracking: A Motion-Centric Paradigm for 3D Single Object Tracking in Point Cloudscited by 55
- 20213D Siamese Voxel-to-BEV Tracker for Sparse Point Cloudscited by 54
- 20223D Siamese Transformer Network for Single Object Tracking on Point Cloudscited by 44
- 2021Immortal Tracker: Tracklet Never Diescited by 42
- 2021Learnable Online Graph Representations for 3D Multi-Object Trackingcited by 38
- 2022STCrowd: A Multimodal Dataset for Pedestrian Perception in Crowded Scenescited by 35
- 20224D-StOP: Panoptic Segmentation of 4D LiDAR using Spatio-temporal Object Proposal Generation and Aggregationcited by 35
12 most cited of 62 All 62 (JSON)
- 2026Radar-Informed 3D Multi-Object Tracking under Adverse Conditions15 Apr 2026
- 2025Radar Tracker: Moving Instance Tracking in Sparse and Noisy Radar Point Clouds4 Jul 2025
- 20243D Multi-Object Tracking Employing MS-GLMB Filter for Autonomous Driving19 Oct 2024
- 2024GSLAMOT: A Tracklet and Query Graph-based Simultaneous Locating, Mapping, and Multiple Object Tracking System17 Aug 2024
- 20243D Single-object Tracking in Point Clouds with High Temporal Variation4 Aug 2024
- 2024JDT3D: Addressing the Gaps in LiDAR-Based Tracking-by-Attention6 Jul 2024
- 2024Multi-Object Tracking based on Imaging Radar 3D Object Detection3 Jun 2024
- 2024ADA-Track++: End-to-End Multi-Camera 3D Multi-Object Tracking with Alternating Detection and Association14 May 2024
- 2024STT: Stateful Tracking with Transformers for Autonomous Driving30 Apr 2024
- 20243D Semantic MapNet: Building Maps for Multi-Object Re-Identification in 3D19 Mar 2024
- 2023ShaSTA-Fuse: Camera-LiDAR Sensor Fusion to Model Shape and Spatio-Temporal Affinities for 3D Multi-Object Tracking4 Oct 2023
- 20233D Multiple Object Tracking on Autonomous Driving: A Literature Review27 Sep 2023
12 newest of 62 All 62 (JSON)