LiDAR Sensor modeling and Data augmentation with GANs for Autonomous driving
Not on the map. Why?
Abstract (arXiv)
In the autonomous driving domain, data collection and annotation from real vehicles are expensive and sometimes unsafe. Simulators are often used for data augmentation, which requires realistic sensor models that are hard to formulate and model in closed forms. Instead, sensors models can be learned from real data. The main challenge is the absence of paired data set, which makes traditional supervised learning techniques not suitable. In this work, we formulate the problem as image translation from unpaired data and employ CycleGANs to solve the sensor modeling problem for LiDAR, to produce realistic LiDAR from simulated LiDAR (sim2real). Further, we generate high-resolution, realistic LiDAR from lower resolution one (real2real). The LiDAR 3D point cloud is processed in Bird-eye View and Polar 2D representations. The experimental results show a high potential of the proposed approach.
Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 6; 2023: 4; 2024: 5; 2025: 3.
22 papers.
Sort:
By area:
- 2022Learning to Generate Realistic LiDAR Point Cloudscited by 91
- 2023UltraLiDAR: Learning Compact Representations for LiDAR Completion and Generationcited by 76
- 2025A Survey of World Models for Autonomous Drivingcited by 60
- 2021A Survey on Deep Domain Adaptation for LiDAR Perceptioncited by 46
- 2024RangeLDM: Fast Realistic LiDAR Point Cloud Generationcited by 45
- 2024At the Dawn of Generative AI Era: A Tutorial-cum-Survey on New Frontiers in 6G Wireless Intelligencecited by 25
- 2023Advancements in Point Cloud Data Augmentation for Deep Learning: A Surveycited by 24
- 2024Forging Vision Foundation Models for Autonomous Driving: Challenges, Methodologies, and Opportunitiescited by 24
- 2024HoloDrive: Holistic 2D-3D Multi-Modal Street Scene Generation for Autonomous Drivingcited by 21
- 2022Learning to Simulate Realistic LiDARscited by 16
- 2021Cycle and Semantic Consistent Adversarial Domain Adaptation for Reducing Simulation-to-Real Domain Shift in LiDAR Bird's Eye Viewcited by 10
- 2022A Realism Metric for Generated LiDAR Point Cloudscited by 5
10 more
- 2021A Step Towards Efficient Evaluation of Complex Perception Tasks in Simulationcited by 4
- 2022Real3D-Aug: Point Cloud Augmentation by Placing Real Objects with Occlusion Handling for 3D Detection and Segmentationcited by 4
- 2024Text3DAug -- Prompted Instance Augmentation for LiDAR Perceptioncited by 4
- 2021Quantifying point cloud realism through adversarially learned latent representationscited by 2
- 2025RadarGen: Automotive Radar Point Cloud Generation from Camerascited by 2
- 2023Attacking Motion Planners Using Adversarial Perception Errorscited by 1
- 2023GAN-Based LiDAR Intensity Simulationcited by 1
- 2025Range-Edit: Semantic Mask Guided Outdoor LiDAR Scene Editingcited by 1
- 2022Domain Adaptation in LiDAR Semantic Segmentation via Alternating Skip Connections and Hybrid Learningcited by 0
- 2022Simulation-to-Reality domain adaptation for offline 3D object annotation on pointclouds with correlation alignmentcited by 0
- 2025RadarGen: Automotive Radar Point Cloud Generation from Cameras19 Dec 2025
- 2025Range-Edit: Semantic Mask Guided Outdoor LiDAR Scene Editing21 Nov 2025
- 2025A Survey of World Models for Autonomous Driving20 Jan 2025
- 2024HoloDrive: Holistic 2D-3D Multi-Modal Street Scene Generation for Autonomous Driving2 Dec 2024
- 2024Text3DAug -- Prompted Instance Augmentation for LiDAR Perception26 Aug 2024
- 2024RangeLDM: Fast Realistic LiDAR Point Cloud Generation15 Mar 2024
- 2024At the Dawn of Generative AI Era: A Tutorial-cum-Survey on New Frontiers in 6G Wireless Intelligence2 Feb 2024
- 2024Forging Vision Foundation Models for Autonomous Driving: Challenges, Methodologies, and Opportunities16 Jan 2024
- 2023GAN-Based LiDAR Intensity Simulation26 Nov 2023
- 2023Attacking Motion Planners Using Adversarial Perception Errors21 Nov 2023
- 2023UltraLiDAR: Learning Compact Representations for LiDAR Completion and Generation2 Nov 2023
- 2023Advancements in Point Cloud Data Augmentation for Deep Learning: A Survey23 Aug 2023
10 more
- 2022Learning to Simulate Realistic LiDARs22 Sep 2022
- 2022Learning to Generate Realistic LiDAR Point Clouds8 Sep 2022
- 2022A Realism Metric for Generated LiDAR Point Clouds31 Aug 2022
- 2022Real3D-Aug: Point Cloud Augmentation by Placing Real Objects with Occlusion Handling for 3D Detection and Segmentation15 Jun 2022
- 2022Simulation-to-Reality domain adaptation for offline 3D object annotation on pointclouds with correlation alignment6 Feb 2022
- 2022Domain Adaptation in LiDAR Semantic Segmentation via Alternating Skip Connections and Hybrid Learning14 Jan 2022
- 2021A Step Towards Efficient Evaluation of Complex Perception Tasks in Simulation28 Sep 2021
- 2021Quantifying point cloud realism through adversarially learned latent representations24 Sep 2021
- 2021A Survey on Deep Domain Adaptation for LiDAR Perception4 Jun 2021
- 2021Cycle and Semantic Consistent Adversarial Domain Adaptation for Reducing Simulation-to-Real Domain Shift in LiDAR Bird's Eye View22 Apr 2021
- 2022Learning to Generate Realistic LiDAR Point Cloudscited by 91
- 2025A Survey of World Models for Autonomous Drivingcited by 60
- 2024RangeLDM: Fast Realistic LiDAR Point Cloud Generationcited by 45
- 2025A Survey of World Models for Autonomous Driving20 Jan 2025
- 2024RangeLDM: Fast Realistic LiDAR Point Cloud Generation15 Mar 2024
- 2022Learning to Generate Realistic LiDAR Point Clouds8 Sep 2022
- 2023UltraLiDAR: Learning Compact Representations for LiDAR Completion and Generationcited by 76
- 2021A Survey on Deep Domain Adaptation for LiDAR Perceptioncited by 46
- 2024At the Dawn of Generative AI Era: A Tutorial-cum-Survey on New Frontiers in 6G Wireless Intelligencecited by 25
- 2023Advancements in Point Cloud Data Augmentation for Deep Learning: A Surveycited by 24
- 2022Learning to Simulate Realistic LiDARscited by 16
- 2021Cycle and Semantic Consistent Adversarial Domain Adaptation for Reducing Simulation-to-Real Domain Shift in LiDAR Bird's Eye Viewcited by 10
- 2022A Realism Metric for Generated LiDAR Point Cloudscited by 5
- 2021A Step Towards Efficient Evaluation of Complex Perception Tasks in Simulationcited by 4
- 2022Real3D-Aug: Point Cloud Augmentation by Placing Real Objects with Occlusion Handling for 3D Detection and Segmentationcited by 4
- 2024Text3DAug -- Prompted Instance Augmentation for LiDAR Perceptioncited by 4
- 2021Quantifying point cloud realism through adversarially learned latent representationscited by 2
- 2023Attacking Motion Planners Using Adversarial Perception Errorscited by 1
12 most cited of 16 All 16 (JSON)
- 2025Range-Edit: Semantic Mask Guided Outdoor LiDAR Scene Editing21 Nov 2025
- 2024Text3DAug -- Prompted Instance Augmentation for LiDAR Perception26 Aug 2024
- 2024At the Dawn of Generative AI Era: A Tutorial-cum-Survey on New Frontiers in 6G Wireless Intelligence2 Feb 2024
- 2023GAN-Based LiDAR Intensity Simulation26 Nov 2023
- 2023Attacking Motion Planners Using Adversarial Perception Errors21 Nov 2023
- 2023UltraLiDAR: Learning Compact Representations for LiDAR Completion and Generation2 Nov 2023
- 2023Advancements in Point Cloud Data Augmentation for Deep Learning: A Survey23 Aug 2023
- 2022Learning to Simulate Realistic LiDARs22 Sep 2022
- 2022A Realism Metric for Generated LiDAR Point Clouds31 Aug 2022
- 2022Real3D-Aug: Point Cloud Augmentation by Placing Real Objects with Occlusion Handling for 3D Detection and Segmentation15 Jun 2022
- 2022Simulation-to-Reality domain adaptation for offline 3D object annotation on pointclouds with correlation alignment6 Feb 2022
- 2022Domain Adaptation in LiDAR Semantic Segmentation via Alternating Skip Connections and Hybrid Learning14 Jan 2022
12 newest of 16 All 16 (JSON)