# Poly-MOT: A Polyhedral Framework For 3D Multi-Object Tracking

arXiv: https://arxiv.org/abs/2307.16675 · HTML: https://mlsanity.com/paper/2307.16675/

## Key facts

- Cited by 32 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 31 Jul 2023.

## Built on by (most cited first, 30 of 32)

- [TUMTraf V2X Cooperative Perception Dataset](https://mlsanity.com/paper/2403.01316/) (2024)
- [BEVNeXt: Reviving Dense BEV Frameworks for 3D Object Detection](https://mlsanity.com/paper/2312.01696/) (2023)
- [ADA-Track++: End-to-End Multi-Camera 3D Multi-Object Tracking with Alternating Detection and Association](https://mlsanity.com/paper/2405.08909/) (2024)
- [MCTrack: A Unified 3D Multi-Object Tracking Framework for Autonomous Driving](https://mlsanity.com/paper/2409.16149/) (2024)
- [Fast-Poly: A Fast Polyhedral Framework For 3D Multi-Object Tracking](https://mlsanity.com/paper/2403.13443/) (2024)
- [Tracking Meets Large Multimodal Models for Driving Scenario Understanding](https://mlsanity.com/paper/2503.14498/) (2025)
- [Deep Learning-Based Robust Multi-Object Tracking via Fusion of mmWave Radar and Camera Sensors](https://mlsanity.com/paper/2407.08049/) (2024)
- [3D Multiple Object Tracking on Autonomous Driving: A Literature Review](https://mlsanity.com/paper/2309.15411/) (2023)
- [JDT3D: Addressing the Gaps in LiDAR-Based Tracking-by-Attention](https://mlsanity.com/paper/2407.04926/) (2024)
- [StreamMOTP: Streaming and Unified Framework for Joint 3D Multi-Object Tracking and Trajectory Prediction](https://mlsanity.com/paper/2406.19844/) (2024)
- [A New Architecture for Neural Enhanced Multiobject Tracking](https://mlsanity.com/paper/2410.06294/) (2024)
- [Bayesian Multiobject Tracking With Neural-Enhanced Motion and Measurement Models](https://mlsanity.com/paper/2506.18124/) (2025)
- [S2-Track: A Simple yet Strong Approach for End-to-End 3D Multi-Object Tracking](https://mlsanity.com/paper/2406.02147/) (2024)
- [RockTrack: A 3D Robust Multi-Camera-Ken Multi-Object Tracking Framework](https://mlsanity.com/paper/2409.11749/) (2024)
- [Open3DTrack: Towards Open-Vocabulary 3D Multi-Object Tracking](https://mlsanity.com/paper/2410.01678/) (2024)
- [IMM-MOT: A Novel 3D Multi-object Tracking Framework with Interacting Multiple Model Filter](https://mlsanity.com/paper/2502.09672/) (2025)
- [Towards Vision Zero: The TUM Traffic Accid3nD Dataset](https://mlsanity.com/paper/2503.12095/) (2025)
- [From Static to Dynamic: a Survey of Topology-Aware Perception in Autonomous Driving](https://mlsanity.com/paper/2509.23641/) (2025)
- [Offline-Poly: A Polyhedral Framework For Offline 3D Multi-Object Tracking](https://mlsanity.com/paper/2602.13772/) (2026)
- [Convolutional Unscented Kalman Filter for Multi-Object Tracking with Outliers](https://mlsanity.com/paper/2406.01380/) (2024)
- [Easy-Poly: An Easy Polyhedral Framework For 3D Multi-Object Tracking](https://mlsanity.com/paper/2502.17822/) (2025)
- [OptiPMB: Enhancing 3D Multi-Object Tracking with Optimized Poisson Multi-Bernoulli Filtering](https://mlsanity.com/paper/2503.12968/) (2025)
- [Fusion-Poly: A Polyhedral Framework Based on Spatial-Temporal Fusion for 3D Multi-Object Tracking](https://mlsanity.com/paper/2603.08199/) (2026)
- [Radar-Informed 3D Multi-Object Tracking under Adverse Conditions](https://mlsanity.com/paper/2604.13571/) (2026)
- [RESOLVE: A Multi-Resolution and Multi-Modal Dataset for Roadside Cooperative Perception](https://mlsanity.com/paper/2606.31895/) (2026)
- [TeFF: Tracking-enhanced Forgetting-free Few-shot 3D LiDAR Semantic Segmentation](https://mlsanity.com/paper/2408.15657/) (2024)
- [RegTrack: Simplicity Beneath Complexity in Robust Multi-Modal 3D Multi-Object Tracking](https://mlsanity.com/paper/2409.00618/) (2024)
- [FutrTrack: A Camera-LiDAR Fusion Transformer for 3D Multiple Object Tracking](https://mlsanity.com/paper/2510.19981/) (2025)
- [Information Coordination as a Bridge: A Neuro-Symbolic Architecture for Reliable Autonomous Driving Scene Understanding](https://mlsanity.com/paper/2605.04475/) (2026)
- [Taming Perception Jitter: Uncertainty-Aware LiDAR Object Detection for Reliable Motion Classification](https://mlsanity.com/paper/2606.09350/) (2026)

## Abstract (arXiv)

3D Multi-object tracking (MOT) empowers mobile robots to accomplish well-informed motion planning and navigation tasks by providing motion trajectories of surrounding objects. However, existing 3D MOT methods typically employ a single similarity metric and physical model to perform data association and state estimation for all objects. With large-scale modern datasets and real scenes, there are a variety of object categories that commonly exhibit distinctive geometric properties and motion patterns. In this way, such distinctions would enable various object categories to behave differently under the same standard, resulting in erroneous matches between trajectories and detections, and jeopardizing the reliability of downstream tasks (navigation, etc.). Towards this end, we propose Poly-MOT, an efficient 3D MOT method based on the Tracking-By-Detection framework that enables the tracker to choose the most appropriate tracking criteria for each object category. Specifically, Poly-MOT leverages different motion models for various object categories to characterize distinct types of motion accurately. We also introduce the constraint of the rigid structure of objects into a specific motion model to accurately describe the highly nonlinear motion of the object. Additionally, we introduce a two-stage data association strategy to ensure that objects can find the optimal similarity metric from three custom metrics for their categories and reduce missing matches. On the NuScenes dataset, our proposed method achieves state-of-the-art performance with 75.4% AMOTA. The code is available at https://github.com/lixiaoyu2000/Poly-MOT