Pattern-Aware Data Augmentation for LiDAR 3D Object Detection
Not on the map. Why?
Abstract (arXiv)
Autonomous driving datasets are often skewed and in particular, lack training data for objects at farther distances from the ego vehicle. The imbalance of data causes a performance degradation as the distance of the detected objects increases. In this paper, we propose pattern-aware ground truth sampling, a data augmentation technique that downsamples an object's point cloud based on the LiDAR's characteristics. Specifically, we mimic the natural diverging point pattern variation that occurs for objects at depth to simulate samples at farther distances. Thus, the network has more diverse training examples and can generalize to detecting farther objects more effectively. We evaluate against existing data augmentation techniques that use point removal or perturbation methods and find that our method outperforms all of them. Additionally, we propose using equal element AP bins to evaluate the performance of 3D object detectors across distance. We improve the performance of PV-RCNN on the car class by more than 0.7 percent on the KITTI validation split at distances greater than 25 m.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 17 of its 20 references that are in the map. First posted on arXiv 30 Nov 2021.
Builds on
17 of 20 references.
References · 17
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,715
- 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
- 2018PointRCNN: 3D Object Proposal Generation and Detection from Point Cloudcited by 941
- 2019PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detectioncited by 891
- 2019PIXOR: Real-time 3D Object Detection from Point Cloudscited by 358
- 2019Pseudo-LiDAR++: Accurate Depth for 3D Object Detection in Autonomous Drivingcited by 188
- 2020LiDARsim: Realistic LiDAR Simulation by Leveraging the Real Worldcited by 137
- 2020PointMixup: Augmentation for Point Cloudscited by 104
- 2020PointAugment: an Auto-Augmentation Framework for Point Cloud Classificationcited by 65
- 2020AFDet: Anchor Free One Stage 3D Object Detectioncited by 63
5 more
- 2018Augmented LiDAR Simulator for Autonomous Drivingcited by 41
- 2020Improving 3D Object Detection through Progressive Population Based Augmentationcited by 41
- 2020Part-Aware Data Augmentation for 3D Object Detection in Point Cloudcited by 34
- 2020SVGA-Net: Sparse Voxel-Graph Attention Network for 3D Object Detection from Point Cloudscited by 27
- 2020Quantifying Data Augmentation for LiDAR based 3D Object Detectioncited by 18
Built on by
Citing papers per year: 2022: 4; 2023: 7; 2024: 4.
15 papers.
Sort:
By area:
- 2022Learning to Generate Realistic LiDAR Point Cloudscited by 93
- 2024Towards Realistic Scene Generation with LiDAR Diffusion Modelscited by 69
- 2023Advancements in Point Cloud Data Augmentation for Deep Learning: A Surveycited by 24
- 2023Instant Domain Augmentation for LiDAR Semantic Segmentationcited by 16
- 2022LidarAugment: Searching for Scalable 3D LiDAR Data Augmentationscited by 8
- 2023Real-Aug: Realistic Scene Synthesis for LiDAR Augmentation in 3D Object Detectioncited by 7
- 2022What Can be Seen is What You Get: Structure Aware Point Cloud Augmentationcited by 6
- 2022Context-Aware Data Augmentation for LIDAR 3D Object Detectioncited by 5
- 2024Robust Long-Range Perception Against Sensor Misalignment in Autonomous Vehiclescited by 5
- 2023DR.CPO: Diversified and Realistic 3D Augmentation via Iterative Construction, Random Placement, and HPR Occlusioncited by 2
- 2023Semantic Segmentation on 3D Point Clouds with High Density Variationscited by 1
- 2023VoxelKP: A Voxel-based Network Architecture for Human Keypoint Estimation in LiDAR Datacited by 1
3 more
- 2023SurfaceAug: Closing the Gap in Multimodal Ground Truth Samplingcited by 0
- 2024SGCCNet: Single-Stage 3D Object Detector With Saliency-Guided Data Augmentation and Confidence Correction Mechanismcited by 0
- 2024HSDA: High-frequency Shuffle Data Augmentation for Bird's-Eye-View Map Segmentationcited by 0
- 2024HSDA: High-frequency Shuffle Data Augmentation for Bird's-Eye-View Map Segmentation9 Dec 2024
- 2024Robust Long-Range Perception Against Sensor Misalignment in Autonomous Vehicles20 Aug 2024
- 2024SGCCNet: Single-Stage 3D Object Detector With Saliency-Guided Data Augmentation and Confidence Correction Mechanism1 Jul 2024
- 2024Towards Realistic Scene Generation with LiDAR Diffusion Models31 Mar 2024
- 2023VoxelKP: A Voxel-based Network Architecture for Human Keypoint Estimation in LiDAR Data11 Dec 2023
- 2023SurfaceAug: Closing the Gap in Multimodal Ground Truth Sampling6 Dec 2023
- 2023Advancements in Point Cloud Data Augmentation for Deep Learning: A Survey23 Aug 2023
- 2023Semantic Segmentation on 3D Point Clouds with High Density Variations4 Jul 2023
- 2023Real-Aug: Realistic Scene Synthesis for LiDAR Augmentation in 3D Object Detection22 May 2023
- 2023Instant Domain Augmentation for LiDAR Semantic Segmentation25 Mar 2023
- 2023DR.CPO: Diversified and Realistic 3D Augmentation via Iterative Construction, Random Placement, and HPR Occlusion20 Mar 2023
- 2022Context-Aware Data Augmentation for LIDAR 3D Object Detection20 Nov 2022
3 more
- 2022Learning to Generate Realistic LiDAR Point Cloudscited by 93
- 2024Towards Realistic Scene Generation with LiDAR Diffusion Modelscited by 69
- 2024Towards Realistic Scene Generation with LiDAR Diffusion Models31 Mar 2024
- 2022Learning to Generate Realistic LiDAR Point Clouds8 Sep 2022
- 2023Advancements in Point Cloud Data Augmentation for Deep Learning: A Surveycited by 24
- 2023Instant Domain Augmentation for LiDAR Semantic Segmentationcited by 16
- 2022LidarAugment: Searching for Scalable 3D LiDAR Data Augmentationscited by 8
- 2023Real-Aug: Realistic Scene Synthesis for LiDAR Augmentation in 3D Object Detectioncited by 7
- 2022What Can be Seen is What You Get: Structure Aware Point Cloud Augmentationcited by 6
- 2022Context-Aware Data Augmentation for LIDAR 3D Object Detectioncited by 5
- 2024Robust Long-Range Perception Against Sensor Misalignment in Autonomous Vehiclescited by 5
- 2023DR.CPO: Diversified and Realistic 3D Augmentation via Iterative Construction, Random Placement, and HPR Occlusioncited by 2
- 2023Semantic Segmentation on 3D Point Clouds with High Density Variationscited by 1
- 2023VoxelKP: A Voxel-based Network Architecture for Human Keypoint Estimation in LiDAR Datacited by 1
- 2023SurfaceAug: Closing the Gap in Multimodal Ground Truth Samplingcited by 0
- 2024SGCCNet: Single-Stage 3D Object Detector With Saliency-Guided Data Augmentation and Confidence Correction Mechanismcited by 0
12 most cited of 13 All 13 (JSON)
- 2024HSDA: High-frequency Shuffle Data Augmentation for Bird's-Eye-View Map Segmentation9 Dec 2024
- 2024Robust Long-Range Perception Against Sensor Misalignment in Autonomous Vehicles20 Aug 2024
- 2024SGCCNet: Single-Stage 3D Object Detector With Saliency-Guided Data Augmentation and Confidence Correction Mechanism1 Jul 2024
- 2023VoxelKP: A Voxel-based Network Architecture for Human Keypoint Estimation in LiDAR Data11 Dec 2023
- 2023SurfaceAug: Closing the Gap in Multimodal Ground Truth Sampling6 Dec 2023
- 2023Advancements in Point Cloud Data Augmentation for Deep Learning: A Survey23 Aug 2023
- 2023Semantic Segmentation on 3D Point Clouds with High Density Variations4 Jul 2023
- 2023Real-Aug: Realistic Scene Synthesis for LiDAR Augmentation in 3D Object Detection22 May 2023
- 2023Instant Domain Augmentation for LiDAR Semantic Segmentation25 Mar 2023
- 2023DR.CPO: Diversified and Realistic 3D Augmentation via Iterative Construction, Random Placement, and HPR Occlusion20 Mar 2023
- 2022Context-Aware Data Augmentation for LIDAR 3D Object Detection20 Nov 2022
- 2022LidarAugment: Searching for Scalable 3D LiDAR Data Augmentations24 Oct 2022
12 newest of 13 All 13 (JSON)