AB3DMOT: A Baseline for 3D Multi-Object Tracking and New Evaluation Metrics
Not on the map. Why?
Abstract (arXiv)
3D multi-object tracking (MOT) is essential to applications such as autonomous driving. Recent work focuses on developing accurate systems giving less attention to computational cost and system complexity. In contrast, this work proposes a simple real-time 3D MOT system with strong performance. Our system first obtains 3D detections from a LiDAR point cloud. Then, a straightforward combination of a 3D Kalman filter and the Hungarian algorithm is used for state estimation and data association. Additionally, 3D MOT datasets such as KITTI evaluate MOT methods in 2D space and standardized 3D MOT evaluation tools are missing for a fair comparison of 3D MOT methods. We propose a new 3D MOT evaluation tool along with three new metrics to comprehensively evaluate 3D MOT methods. We show that, our proposed method achieves strong 3D MOT performance on KITTI and runs at a rate of 207.4 FPS on the KITTI dataset, achieving the fastest speed among modern 3D MOT systems. Our code is publicly available at http://www.xinshuoweng.com/projects/AB3DMOT.
Key facts. Cited by 63 papers in the map (data through 14 Oct 2026). First posted on arXiv 18 Aug 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 8; 2023: 10; 2024: 10; 2025: 16; 2026: 15.
63 papers.
Sort:
By area:
- 2023V2X-Seq: A Large-Scale Sequential Dataset for Vehicle-Infrastructure Cooperative Perception and Forecastingcited by 114
- 2024End-to-End Autonomous Driving through V2X Cooperationcited by 42
- 20224D-StOP: Panoptic Segmentation of 4D LiDAR using Spatio-temporal Object Proposal Generation and Aggregationcited by 35
- 2024ICP-Flow: LiDAR Scene Flow Estimation with ICPcited by 35
- 2022TripletTrack: 3D Object Tracking using Triplet Embeddings and LSTMcited by 26
- 2022Multi-Camera Multiple 3D Object Tracking on the Move for Autonomous Vehiclescited by 20
- 2023ByteTrackV2: 2D and 3D Multi-Object Tracking by Associating Every Detection Boxcited by 20
- 2023MotionTrack: End-to-End Transformer-based Multi-Object Tracing with LiDAR-Camera Fusioncited by 19
- 2024HoloVIC: Large-scale Dataset and Benchmark for Multi-Sensor Holographic Intersection and Vehicle-Infrastructure Cooperativecited by 14
- 2023Human-M3: A Multi-view Multi-modal Dataset for 3D Human Pose Estimation in Outdoor Scenescited by 11
- 2022SpOT: Spatiotemporal Modeling for 3D Object Trackingcited by 10
- 2022Minkowski Tracker: A Sparse Spatio-Temporal R-CNN for Joint Object Detection and Trackingcited by 9
38 more
- 2024RoboSense: Large-scale Dataset and Benchmark for Egocentric Robot Perception and Navigation in Crowded and Unstructured Environmentscited by 8
- 20233D Video Object Detection with Learnable Object-Centric Global Optimizationcited by 7
- 2021Track, Check, Repeat: An EM Approach to Unsupervised Trackingcited by 6
- 2023Practical Collaborative Perception: A Framework for Asynchronous and Multi-Agent 3D Object Detectioncited by 6
- 2025PD-SORT: Occlusion-Robust Multi-Object Tracking Using Pseudo-Depth Cuescited by 6
- 2025PDB: Not All Drivers Are the Same -- A Personalized Dataset for Understanding Driving Behaviorcited by 6
- 2025DriveE2E: Closed-Loop Benchmark for End-to-End Autonomous Driving through Real-to-Simulationcited by 5
- 2023Vision meets mmWave Radar: 3D Object Perception Benchmark for Autonomous Drivingcited by 4
- 2021A two-stage data association approach for 3D Multi-object Trackingcited by 3
- 2021Urban Traffic Surveillance (UTS): A fully probabilistic 3D tracking approach based on 2D detectionscited by 3
- 2021Lidar with Velocity: Correcting Moving Objects Point Cloud Distortion from Oscillating Scanning Lidars by Fusion with Cameracited by 3
- 2022SRCN3D: Sparse R-CNN 3D for Compact Convolutional Multi-View 3D Object Detection and Trackingcited by 3
- 2024StreamMOTP: Streaming and Unified Framework for Joint 3D Multi-Object Tracking and Trajectory Predictioncited by 3
- 2024GSLAMOT: A Tracklet and Query Graph-based Simultaneous Locating, Mapping, and Multiple Object Tracking Systemcited by 3
- 2025Enhancing 3D Semantic Scene Completion with a Refinement Modulecited by 3
- 2023TrajMatch: Towards Automatic Spatio-temporal Calibration for Roadside LiDARs through Trajectory Matchingcited by 2
- 2023Tracking Objects with 3D Representation from Videoscited by 2
- 2024Fast and Modular Autonomy Software for Autonomous Racing Vehiclescited by 2
- 2024RockTrack: A 3D Robust Multi-Camera-Ken Multi-Object Tracking Frameworkcited by 2
- 2024CrossTracker: Robust Multi-modal 3D Multi-Object Tracking via Cross Correctioncited by 2
- 2025DepTR-MOT: Unveiling the Potential of Depth-Informed Trajectory Refinement for Multi-Object Trackingcited by 2
- 2026SCATR: Mitigating New Instance Suppression in LiDAR-based Tracking-by-Attention via Second Chance Assignment and Track Query Dropoutcited by 2
- 2026V2U4Real: A Real-world Large-scale Dataset for Vehicle-to-UAV Cooperative Perceptioncited by 2
- 2022A Certifiable Security Patch for Object Tracking in Self-Driving Systems via Historical Deviation Modelingcited by 1
- 2023BOTT: Box Only Transformer Tracker for 3D Object Trackingcited by 1
- 2025PFSD: A Multi-Modal Pedestrian-Focus Scene Dataset for Rich Tasks in Semi-Structured Environmentscited by 1
- 2025Contour Errors: Ego-Centric Matching for 3D Multi-Object Tracking Performance Evaluationcited by 1
- 2025DINO-CoDT: Multi-class Collaborative Detection and Tracking with Vision Foundation Modelscited by 1
- 2025GRASPTrack: Geometry-Reasoned Association via Segmentation and Projection for Multi-Object Trackingcited by 1
- 2026UniLiPs: Unified LiDAR Pseudo-Labeling with Geometry-Grounded Dynamic Scene Decompositioncited by 1
- 2026HiMAP: History-aware Map-occupancy Prediction with Fallbackcited by 1
- 2026GT-Space: Enhancing Heterogeneous Collaborative Perception with Ground Truth Feature Spacecited by 1
- 2026Radar-Informed 3D Multi-Object Tracking under Adverse Conditionscited by 1
- 2026Framework and Multi-modal Dataset for Roadwork Zone Detection and Geo-localizationcited by 1
- 2022Objects as Spatio-Temporal 2.5D pointscited by 0
- 2024Visual SLAMMOT Considering Multiple Motion Modelscited by 0
- 2025An Efficient LiDAR-Camera Fusion Network for Multi-Class 3D Dynamic Object Detection and Trajectory Predictioncited by 0
- 2025BasketLiDAR: The First LiDAR-Camera Multimodal Dataset for Professional Basketball MOTcited by 0
50 most cited of 63 All 63 (JSON)
- 2026Tracking the Unseen: An Occlusion-Robust Framework for Target Tracking Under Full and Long-Term Occlusion15 Sep 2026
- 2026Towards Collaborative Joint Perception and Prediction: Framework, Baseline Evaluation, and Deployment Perspectives10 Aug 2026
- 2026PRISA: Proactive Infrastructure LiDAR Framework for Intersection Safety Assessment17 Jul 2026
- 2026CLIFE: Camera-LiDAR Fusion Framework for Edge-Deployable Roadside VRU Perception17 Jul 2026
- 2026Framework and Multi-modal Dataset for Roadwork Zone Detection and Geo-localization5 Jul 2026
- 2026Scaling Datasets for Multi-Sensor, Multi-Agent, and Multi-Domain Learning in Autonomous Systems3 Jun 2026
- 2026GateMOT: Q-Gated Attention for Dense Object Tracking29 Apr 2026
- 2026DENALI: A Dataset Enabling Non-Line-of-Sight Spatial Reasoning with Low-Cost LiDARs17 Apr 2026
- 2026Radar-Informed 3D Multi-Object Tracking under Adverse Conditions15 Apr 2026
- 2026V2U4Real: A Real-world Large-scale Dataset for Vehicle-to-UAV Cooperative Perception26 Mar 2026
- 2026GT-Space: Enhancing Heterogeneous Collaborative Perception with Ground Truth Feature Space13 Mar 2026
- 2026NOVA: Next-step Open-Vocabulary Autoregression for 3D Multi-Object Tracking in Autonomous Driving6 Mar 2026
38 more
- 2026SCATR: Mitigating New Instance Suppression in LiDAR-based Tracking-by-Attention via Second Chance Assignment and Track Query Dropout2 Mar 2026
- 2026HiMAP: History-aware Map-occupancy Prediction with Fallback19 Feb 2026
- 2026UniLiPs: Unified LiDAR Pseudo-Labeling with Geometry-Grounded Dynamic Scene Decomposition8 Jan 2026
- 2025End-to-End 3-D Spatiotemporal Perception with Multimodal Fusion and V2X Collaboration26 Dec 2025
- 2025SPOT!: Map-Guided LLM Agent for Unsupervised Multi-CCTV Dynamic Object Tracking24 Dec 2025
- 2025Training-Free Global Geometric Association for 4D LiDAR Panoptic Segmentation22 Dec 2025
- 2025Enhancing 3D Semantic Scene Completion with a Refinement Module20 Dec 2025
- 2025DriveE2E: Closed-Loop Benchmark for End-to-End Autonomous Driving through Real-to-Simulation28 Sep 2025
- 2025One Filters All: A Generalist Filter for State Estimation24 Sep 2025
- 2025DepTR-MOT: Unveiling the Potential of Depth-Informed Trajectory Refinement for Multi-Object Tracking22 Sep 2025
- 20253D Human Pose and Shape Estimation from LiDAR Point Clouds: A Review15 Sep 2025
- 2025BasketLiDAR: The First LiDAR-Camera Multimodal Dataset for Professional Basketball MOT21 Aug 2025
- 2025GRASPTrack: Geometry-Reasoned Association via Segmentation and Projection for Multi-Object Tracking11 Aug 2025
- 2025DINO-CoDT: Multi-class Collaborative Detection and Tracking with Vision Foundation Models9 Jun 2025
- 2025Contour Errors: Ego-Centric Matching for 3D Multi-Object Tracking Performance Evaluation4 Jun 2025
- 2025An Efficient LiDAR-Camera Fusion Network for Multi-Class 3D Dynamic Object Detection and Trajectory Prediction18 Apr 2025
- 2025PDB: Not All Drivers Are the Same -- A Personalized Dataset for Understanding Driving Behavior9 Mar 2025
- 2025PFSD: A Multi-Modal Pedestrian-Focus Scene Dataset for Rich Tasks in Semi-Structured Environments21 Feb 2025
- 2025PD-SORT: Occlusion-Robust Multi-Object Tracking Using Pseudo-Depth Cues20 Jan 2025
- 2024Visual SLAMMOT Considering Multiple Motion Models28 Nov 2024
- 2024CrossTracker: Robust Multi-modal 3D Multi-Object Tracking via Cross Correction28 Nov 2024
- 2024RockTrack: A 3D Robust Multi-Camera-Ken Multi-Object Tracking Framework18 Sep 2024
- 2024RoboSense: Large-scale Dataset and Benchmark for Egocentric Robot Perception and Navigation in Crowded and Unstructured Environments28 Aug 2024
- 2024Fast and Modular Autonomy Software for Autonomous Racing Vehicles27 Aug 2024
- 2024GSLAMOT: A Tracklet and Query Graph-based Simultaneous Locating, Mapping, and Multiple Object Tracking System17 Aug 2024
- 2024StreamMOTP: Streaming and Unified Framework for Joint 3D Multi-Object Tracking and Trajectory Prediction28 Jun 2024
- 2024End-to-End Autonomous Driving through V2X Cooperation31 Mar 2024
- 2024HoloVIC: Large-scale Dataset and Benchmark for Multi-Sensor Holographic Intersection and Vehicle-Infrastructure Cooperative5 Mar 2024
- 2024ICP-Flow: LiDAR Scene Flow Estimation with ICP27 Feb 2024
- 2023Vision meets mmWave Radar: 3D Object Perception Benchmark for Autonomous Driving17 Nov 2023
- 2023BOTT: Box Only Transformer Tracker for 3D Object Tracking17 Aug 2023
- 2023Human-M3: A Multi-view Multi-modal Dataset for 3D Human Pose Estimation in Outdoor Scenes1 Aug 2023
- 2023Practical Collaborative Perception: A Framework for Asynchronous and Multi-Agent 3D Object Detection4 Jul 2023
- 2023MotionTrack: End-to-End Transformer-based Multi-Object Tracing with LiDAR-Camera Fusion29 Jun 2023
- 2023Tracking Objects with 3D Representation from Videos8 Jun 2023
- 2023V2X-Seq: A Large-Scale Sequential Dataset for Vehicle-Infrastructure Cooperative Perception and Forecasting10 May 2023
- 20233D Video Object Detection with Learnable Object-Centric Global Optimization27 Mar 2023
- 2023ByteTrackV2: 2D and 3D Multi-Object Tracking by Associating Every Detection Box27 Mar 2023
50 newest of 63 All 63 (JSON)
- 2023V2X-Seq: A Large-Scale Sequential Dataset for Vehicle-Infrastructure Cooperative Perception and Forecastingcited by 114
- 20224D-StOP: Panoptic Segmentation of 4D LiDAR using Spatio-temporal Object Proposal Generation and Aggregationcited by 35
- 2024ICP-Flow: LiDAR Scene Flow Estimation with ICPcited by 35
- 2022TripletTrack: 3D Object Tracking using Triplet Embeddings and LSTMcited by 26
- 2022Multi-Camera Multiple 3D Object Tracking on the Move for Autonomous Vehiclescited by 20
- 2023ByteTrackV2: 2D and 3D Multi-Object Tracking by Associating Every Detection Boxcited by 20
- 2023MotionTrack: End-to-End Transformer-based Multi-Object Tracing with LiDAR-Camera Fusioncited by 19
- 2024HoloVIC: Large-scale Dataset and Benchmark for Multi-Sensor Holographic Intersection and Vehicle-Infrastructure Cooperativecited by 14
- 2023Human-M3: A Multi-view Multi-modal Dataset for 3D Human Pose Estimation in Outdoor Scenescited by 11
- 2022SpOT: Spatiotemporal Modeling for 3D Object Trackingcited by 10
- 2022Minkowski Tracker: A Sparse Spatio-Temporal R-CNN for Joint Object Detection and Trackingcited by 9
- 2024RoboSense: Large-scale Dataset and Benchmark for Egocentric Robot Perception and Navigation in Crowded and Unstructured Environmentscited by 8
12 most cited of 60 All 60 (JSON)
- 2026Tracking the Unseen: An Occlusion-Robust Framework for Target Tracking Under Full and Long-Term Occlusion15 Sep 2026
- 2026Towards Collaborative Joint Perception and Prediction: Framework, Baseline Evaluation, and Deployment Perspectives10 Aug 2026
- 2026PRISA: Proactive Infrastructure LiDAR Framework for Intersection Safety Assessment17 Jul 2026
- 2026CLIFE: Camera-LiDAR Fusion Framework for Edge-Deployable Roadside VRU Perception17 Jul 2026
- 2026Framework and Multi-modal Dataset for Roadwork Zone Detection and Geo-localization5 Jul 2026
- 2026Scaling Datasets for Multi-Sensor, Multi-Agent, and Multi-Domain Learning in Autonomous Systems3 Jun 2026
- 2026GateMOT: Q-Gated Attention for Dense Object Tracking29 Apr 2026
- 2026DENALI: A Dataset Enabling Non-Line-of-Sight Spatial Reasoning with Low-Cost LiDARs17 Apr 2026
- 2026Radar-Informed 3D Multi-Object Tracking under Adverse Conditions15 Apr 2026
- 2026V2U4Real: A Real-world Large-scale Dataset for Vehicle-to-UAV Cooperative Perception26 Mar 2026
- 2026GT-Space: Enhancing Heterogeneous Collaborative Perception with Ground Truth Feature Space13 Mar 2026
- 2026SCATR: Mitigating New Instance Suppression in LiDAR-based Tracking-by-Attention via Second Chance Assignment and Track Query Dropout2 Mar 2026
12 newest of 60 All 60 (JSON)