PolarMOT: How Far Can Geometric Relations Take Us in 3D Multi-Object Tracking?
Not on the map. Why?
Abstract (arXiv)
Most (3D) multi-object tracking methods rely on appearance-based cues for data association. By contrast, we investigate how far we can get by only encoding geometric relationships between objects in 3D space as cues for data-driven data association. We encode 3D detections as nodes in a graph, where spatial and temporal pairwise relations among objects are encoded via localized polar coordinates on graph edges. This representation makes our geometric relations invariant to global transformations and smooth trajectory changes, especially under non-holonomic motion. This allows our graph neural network to learn to effectively encode temporal and spatial interactions and fully leverage contextual and motion cues to obtain final scene interpretation by posing data association as edge classification. We establish a new state-of-the-art on nuScenes dataset and, more importantly, show that our method, PolarMOT, generalizes remarkably well across different locations (Boston, Singapore, Karlsruhe) and datasets (nuScenes and KITTI).
Key facts. Cited by 29 papers in the map (data through 14 Oct 2026). Builds on 36 of its 67 references that are in the map. First posted on arXiv 3 Aug 2022.
Builds on
36 of 67 references.
References · 36
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2017Neural Message Passing for Quantum Chemistrycited by 3,487
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,715
- 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
- 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,205
- 2020Center-based 3D Object Detection and Trackingcited by 1,144
- 2018PointRCNN: 3D Object Proposal Generation and Detection from Point Cloudcited by 941
- 2016Simple Online and Realtime Trackingcited by 868
24 more
- 2019On the Variance of the Adaptive Learning Rate and Beyondcited by 772
- 2017Frustum PointNets for 3D Object Detection from RGB-D Datacited by 640
- 2020HOTA: A Higher Order Metric for Evaluating Multi-Object Trackingcited by 552
- 2020Tracking Objects as Pointscited by 483
- 2019Tracking without bells and whistlescited by 382
- 2020Point-GNN: Graph Neural Network for 3D Object Detection in a Point Cloudcited by 335
- 2019MOTS: Multi-Object Tracking and Segmentationcited by 223
- 2019Learning a Neural Solver for Multiple Object Trackingcited by 198
- 2020Video Panoptic Segmentationcited by 142
- 2021Learning to Track with Object Permanencecited by 119
- 2020GNN3DMOT: Graph Neural Network for 3D Multi-Object Tracking with Multi-Feature Learningcited by 113
- 2021EagerMOT: 3D Multi-Object Tracking via Sensor Fusioncited by 83
- 2016Learning by tracking: Siamese CNN for robust target associationcited by 79
- 2019How To Train Your Deep Multi-Object Trackercited by 71
- 20214D Panoptic LiDAR Segmentationcited by 65
- 2020Probabilistic 3D Multi-Object Tracking for Autonomous Drivingcited by 64
- 2019Track to Reconstruct and Reconstruct to Trackcited by 49
- 2015Near-Online Multi-target Tracking with Aggregated Local Flow Descriptorcited by 46
- 2017Deep Network Flow for Multi-Object Trackingcited by 45
- 2018Beyond Pixels: Leveraging Geometry and Shape Cues for Online Multi-Object Trackingcited by 40
- 2021Learnable Online Graph Representations for 3D Multi-Object Trackingcited by 38
- 2018Combined Image- and World-Space Tracking in Traffic Scenescited by 29
- 2018End-to-end Learning of Multi-sensor 3D Tracking by Detectioncited by 25
- 2017Track, then Decide: Category-Agnostic Vision-based Multi-Object Trackingcited by 19
Built on by
Citing papers per year: 2023: 11; 2024: 9; 2025: 7; 2026: 2.
29 papers.
Sort:
By area:
- 2023ReST: A Reconfigurable Spatial-Temporal Graph Model for Multi-Camera Multi-Object Trackingcited by 24
- 20233DMOTFormer: Graph Transformer for Online 3D Multi-Object Trackingcited by 21
- 2023RaTrack: Moving Object Detection and Tracking with 4D Radar Point Cloudcited by 21
- 2023ByteTrackV2: 2D and 3D Multi-Object Tracking by Associating Every Detection Boxcited by 20
- 2023TrajectoryFormer: 3D Object Tracking Transformer with Predictive Trajectory Hypothesescited by 14
- 2023LEGO: Learning and Graph-Optimized Modular Tracker for Online Multi-Object Tracking with Point Cloudscited by 9
- 2024PNAS-MOT: Multi-Modal Object Tracking with Pareto Neural Architecture Searchcited by 9
- 2024RobMOT: Robust 3D Multi-Object Tracking by Observational Noise and State Estimation Drift Mitigation on LiDAR PointCloudcited by 9
- 2023You Only Need Two Detectors to Achieve Multi-Modal 3D Multi-Object Trackingcited by 8
- 2025Zero-Shot 4D Lidar Panoptic Segmentationcited by 6
- 20233D Multiple Object Tracking on Autonomous Driving: A Literature Reviewcited by 4
- 20233D Multi-Object Tracking Based on Uncertainty-Guided Data Associationcited by 3
17 more
- 2025HybridTrack: A Hybrid Approach for Robust Multi-Object Trackingcited by 3
- 2023DecoderTracker: Decoder-Only Method for Multiple-Object Trackingcited by 2
- 2024InScope: A New Real-world 3D Infrastructure-side Collaborative Perception Dataset for Open Traffic Scenarioscited by 2
- 2024CrossTracker: Robust Multi-modal 3D Multi-Object Tracking via Cross Correctioncited by 2
- 2025One Graph to Track Them All: Dynamic GNNs for Single- and Multi-View Trackingcited by 2
- 2023BOTT: Box Only Transformer Tracker for 3D Object Trackingcited by 1
- 2024DeepKalPose: An Enhanced Deep-Learning Kalman Filter for Temporally Consistent Monocular Vehicle Pose Estimationcited by 1
- 2024STT: Stateful Tracking with Transformers for Autonomous Drivingcited by 1
- 2024MonoDETRNext: Next-Generation Accurate and Efficient Monocular 3D Object Detectorcited by 1
- 2024Spb3DTracker: A Robust LiDAR-Based Person Tracker for Noisy Environmentcited by 1
- 2025OptiPMB: Enhancing 3D Multi-Object Tracking with Optimized Poisson Multi-Bernoulli Filteringcited by 1
- 2025Towards Accurate State Estimation: Motion Dynamics Kalman Filter for 3D Multi-Object Trackingcited by 1
- 2025ATLASFusion: Aggregation Tracking with Location-Aware Sparse Fusion for Robust Spatio-Temporal Multi-View Pedestrian Trackingcited by 1
- 2026Polycepta: Object-Centric Appearance Estimation for Multi-Object Trackingcited by 1
- 2024RegTrack: Simplicity Beneath Complexity in Robust Multi-Modal 3D Multi-Object Trackingcited by 0
- 2025S3MOT: Monocular 3D Object Tracking with Selective State Space Modelcited by 0
- 2026Beyond Leaderboard Scores: A Deployment-Focused Protocol for Interpretable Tracking Evaluation in Pedestrian-Centric Environmentscited by 0
- 2026Beyond Leaderboard Scores: A Deployment-Focused Protocol for Interpretable Tracking Evaluation in Pedestrian-Centric Environments1 Oct 2026
- 2026Polycepta: Object-Centric Appearance Estimation for Multi-Object Tracking22 Jun 2026
- 2025ATLASFusion: Aggregation Tracking with Location-Aware Sparse Fusion for Robust Spatio-Temporal Multi-View Pedestrian Tracking10 Sep 2025
- 2025One Graph to Track Them All: Dynamic GNNs for Single- and Multi-View Tracking11 Jul 2025
- 2025Towards Accurate State Estimation: Motion Dynamics Kalman Filter for 3D Multi-Object Tracking12 May 2025
- 2025S3MOT: Monocular 3D Object Tracking with Selective State Space Model25 Apr 2025
- 2025Zero-Shot 4D Lidar Panoptic Segmentation1 Apr 2025
- 2025OptiPMB: Enhancing 3D Multi-Object Tracking with Optimized Poisson Multi-Bernoulli Filtering17 Mar 2025
- 2025HybridTrack: A Hybrid Approach for Robust Multi-Object Tracking2 Jan 2025
- 2024CrossTracker: Robust Multi-modal 3D Multi-Object Tracking via Cross Correction28 Nov 2024
- 2024RegTrack: Simplicity Beneath Complexity in Robust Multi-Modal 3D Multi-Object Tracking1 Sep 2024
- 2024Spb3DTracker: A Robust LiDAR-Based Person Tracker for Noisy Environment12 Aug 2024
17 more
- 2024InScope: A New Real-world 3D Infrastructure-side Collaborative Perception Dataset for Open Traffic Scenarios31 Jul 2024
- 2024MonoDETRNext: Next-Generation Accurate and Efficient Monocular 3D Object Detector24 May 2024
- 2024RobMOT: Robust 3D Multi-Object Tracking by Observational Noise and State Estimation Drift Mitigation on LiDAR PointCloud19 May 2024
- 2024STT: Stateful Tracking with Transformers for Autonomous Driving30 Apr 2024
- 2024DeepKalPose: An Enhanced Deep-Learning Kalman Filter for Temporally Consistent Monocular Vehicle Pose Estimation25 Apr 2024
- 2024PNAS-MOT: Multi-Modal Object Tracking with Pareto Neural Architecture Search23 Mar 2024
- 2023DecoderTracker: Decoder-Only Method for Multiple-Object Tracking26 Oct 2023
- 20233D Multiple Object Tracking on Autonomous Driving: A Literature Review27 Sep 2023
- 2023RaTrack: Moving Object Detection and Tracking with 4D Radar Point Cloud18 Sep 2023
- 2023ReST: A Reconfigurable Spatial-Temporal Graph Model for Multi-Camera Multi-Object Tracking25 Aug 2023
- 2023LEGO: Learning and Graph-Optimized Modular Tracker for Online Multi-Object Tracking with Point Clouds19 Aug 2023
- 2023BOTT: Box Only Transformer Tracker for 3D Object Tracking17 Aug 2023
- 20233DMOTFormer: Graph Transformer for Online 3D Multi-Object Tracking12 Aug 2023
- 2023TrajectoryFormer: 3D Object Tracking Transformer with Predictive Trajectory Hypotheses9 Jun 2023
- 2023You Only Need Two Detectors to Achieve Multi-Modal 3D Multi-Object Tracking18 Apr 2023
- 2023ByteTrackV2: 2D and 3D Multi-Object Tracking by Associating Every Detection Box27 Mar 2023
- 20233D Multi-Object Tracking Based on Uncertainty-Guided Data Association3 Mar 2023
- 2023ReST: A Reconfigurable Spatial-Temporal Graph Model for Multi-Camera Multi-Object Trackingcited by 24
- 20233DMOTFormer: Graph Transformer for Online 3D Multi-Object Trackingcited by 21
- 2023RaTrack: Moving Object Detection and Tracking with 4D Radar Point Cloudcited by 21
- 2023ByteTrackV2: 2D and 3D Multi-Object Tracking by Associating Every Detection Boxcited by 20
- 2023TrajectoryFormer: 3D Object Tracking Transformer with Predictive Trajectory Hypothesescited by 14
- 2023LEGO: Learning and Graph-Optimized Modular Tracker for Online Multi-Object Tracking with Point Cloudscited by 9
- 2024PNAS-MOT: Multi-Modal Object Tracking with Pareto Neural Architecture Searchcited by 9
- 2024RobMOT: Robust 3D Multi-Object Tracking by Observational Noise and State Estimation Drift Mitigation on LiDAR PointCloudcited by 9
- 2023You Only Need Two Detectors to Achieve Multi-Modal 3D Multi-Object Trackingcited by 8
- 2025Zero-Shot 4D Lidar Panoptic Segmentationcited by 6
- 20233D Multiple Object Tracking on Autonomous Driving: A Literature Reviewcited by 4
- 20233D Multi-Object Tracking Based on Uncertainty-Guided Data Associationcited by 3
12 most cited of 27 All 27 (JSON)
- 2026Beyond Leaderboard Scores: A Deployment-Focused Protocol for Interpretable Tracking Evaluation in Pedestrian-Centric Environments1 Oct 2026
- 2026Polycepta: Object-Centric Appearance Estimation for Multi-Object Tracking22 Jun 2026
- 2025ATLASFusion: Aggregation Tracking with Location-Aware Sparse Fusion for Robust Spatio-Temporal Multi-View Pedestrian Tracking10 Sep 2025
- 2025One Graph to Track Them All: Dynamic GNNs for Single- and Multi-View Tracking11 Jul 2025
- 2025Towards Accurate State Estimation: Motion Dynamics Kalman Filter for 3D Multi-Object Tracking12 May 2025
- 2025Zero-Shot 4D Lidar Panoptic Segmentation1 Apr 2025
- 2025OptiPMB: Enhancing 3D Multi-Object Tracking with Optimized Poisson Multi-Bernoulli Filtering17 Mar 2025
- 2025HybridTrack: A Hybrid Approach for Robust Multi-Object Tracking2 Jan 2025
- 2024CrossTracker: Robust Multi-modal 3D Multi-Object Tracking via Cross Correction28 Nov 2024
- 2024Spb3DTracker: A Robust LiDAR-Based Person Tracker for Noisy Environment12 Aug 2024
- 2024InScope: A New Real-world 3D Infrastructure-side Collaborative Perception Dataset for Open Traffic Scenarios31 Jul 2024
- 2024MonoDETRNext: Next-Generation Accurate and Efficient Monocular 3D Object Detector24 May 2024
12 newest of 27 All 27 (JSON)