Robust Single Object Tracking in LiDAR Point Clouds under Adverse Weather Conditions
Not on the map. Why?
Abstract (arXiv)
3D single object tracking (3DSOT) in LiDAR point clouds is a critical task for outdoor perception, enabling real-time perception of object location, orientation, and motion. Despite the impressive performance of current 3DSOT methods, evaluating them on clean datasets inadequately reflects their comprehensive performance, as the adverse weather conditions in real-world surroundings has not been considered. One of the main obstacles is the lack of adverse weather benchmarks for the evaluation of 3DSOT. To this end, this work proposes a challenging benchmark for LiDAR-based 3DSOT in adverse weather, which comprises two synthetic datasets (KITTI-A and nuScenes-A) and one real-world dataset (CADC-SOT) spanning three weather types: rain, fog, and snow. Based on this benchmark, five representative 3D trackers from different tracking frameworks conducted robustness evaluation, resulting in significant performance degradations. This prompts the question: What are the factors that cause current advanced methods to fail on such adverse weather samples? Consequently, we explore the impacts of adverse weather and answer the above question from three perspectives: 1) target distance; 2) template shape corruption; and 3) target shape corruption. Finally, based on domain randomization and contrastive learning, we designed a dual-branch tracking framework for adverse weather, named DRCT, achieving excellent performance in benchmarks.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 48 references that are in the map. First posted on arXiv 13 Jan 2025.
Builds on
38 of 48 references.
References · 38
- 2017Attention Is All You Needcited by 59,932
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,857
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,401
- 2019xMUDA: Cross-Modal Unsupervised Domain Adaptation for 3D Semantic Segmentationcited by 129
- 2023Robo3D: Towards Robust and Reliable 3D Perception against Corruptionscited by 128
- 2023Benchmarking Robustness of 3D Object Detection to Common Corruptions in Autonomous Drivingcited by 112
- 2021Invisible for both Camera and LiDAR: Security of Multi-Sensor Fusion based Perception in Autonomous Driving Under Physical-World Attackscited by 101
- 2021Fog Simulation on Real LiDAR Point Clouds for 3D Object Detection in Adverse Weathercited by 95
- 2020Canadian Adverse Driving Conditions Datasetcited by 86
- 2020P2B: Point-to-Box Network for 3D Object Tracking in Point Cloudscited by 84
26 more
- 2021Transfer Learning from Synthetic to Real LiDAR Point Cloud for Semantic Segmentationcited by 76
- 2019Leveraging Shape Completion for 3D Siamese Trackingcited by 74
- 2022LiDAR Snowfall Simulation for Robust 3D Object Detectioncited by 72
- 2021Box-Aware Feature Enhancement for Single Object Tracking on Point Cloudscited by 66
- 2021PTTR: Relational 3D Point Cloud Object Tracking with Transformercited by 65
- 2021PTT: Point-Track-Transformer Module for 3D Single Object Tracking in Point Cloudscited by 59
- 2022Beyond 3D Siamese Tracking: A Motion-Centric Paradigm for 3D Single Object Tracking in Point Cloudscited by 55
- 20213D Siamese Voxel-to-BEV Tracker for Sparse Point Cloudscited by 54
- 20213D Object Tracking with Transformercited by 49
- 2022Ithaca365: Dataset and Driving Perception under Repeated and Challenging Weather Conditionscited by 47
- 20233D Semantic Segmentation in the Wild: Learning Generalized Models for Adverse-Condition Point Cloudscited by 46
- 20223D Siamese Transformer Network for Single Object Tracking on Point Cloudscited by 44
- 2021ConDA: Unsupervised Domain Adaptation for LiDAR Segmentation via Regularized Domain Concatenationcited by 41
- 2022Revisiting Open World Object Detectioncited by 30
- 2022On the Real-World Adversarial Robustness of Real-Time Semantic Segmentation Models for Autonomous Drivingcited by 30
- 2022CXTrack: Improving 3D Point Cloud Tracking with Contextual Informationcited by 28
- 2023MBPTrack: Improving 3D Point Cloud Tracking with Memory Networks and Box Priorscited by 24
- 2024UniMix: Towards Domain Adaptive and Generalizable LiDAR Semantic Segmentation in Adverse Weathercited by 24
- 2022GLT-T: Global-Local Transformer Voting for 3D Single Object Tracking in Point Cloudscited by 23
- 2023Benchmarking the Robustness of LiDAR Semantic Segmentation Modelscited by 18
- 2023OSP2B: One-Stage Point-to-Box Network for 3D Siamese Trackingcited by 16
- 2024Rethinking Data Augmentation for Robust LiDAR Semantic Segmentation in Adverse Weathercited by 14
- 2021Consensus Synergizes with Memory: A Simple Approach for Anomaly Segmentation in Urban Scenescited by 5
- 2022Towards Class-agnostic Tracking Using Feature Decorrelation in Point Cloudscited by 5
- 2022Dynamics-aware Adversarial Attack of Adaptive Neural Networkscited by 5
- 2022OST: Efficient One-stream Network for 3D Single Object Tracking in Point Cloudscited by 5
Built on by
Not cited yet.