Deep Generative Modeling of LiDAR Data
Not on the map. Why?
Cited by 25 in World models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Building models capable of generating structured output is a key challenge for AI and robotics. While generative models have been explored on many types of data, little work has been done on synthesizing lidar scans, which play a key role in robot mapping and localization. In this work, we show that one can adapt deep generative models for this task by unravelling lidar scans into a 2D point map. Our approach can generate high quality samples, while simultaneously learning a meaningful latent representation of the data. We demonstrate significant improvements against state-of-the-art point cloud generation methods. Furthermore, we propose a novel data representation that augments the 2D signal with absolute positional information. We show that this helps robustness to noisy and imputed input; the learned model can recover the underlying lidar scan from seemingly uninformative data
Key facts. Cited by 70 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Dec 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 7; 2023: 10; 2024: 17; 2025: 17; 2026: 9.
70 papers.
Sort:
By area:
- 2022Learning to Generate Realistic LiDAR Point Cloudscited by 91
- 2023UltraLiDAR: Learning Compact Representations for LiDAR Completion and Generationcited by 76
- 2024Towards Realistic Scene Generation with LiDAR Diffusion Modelscited by 67
- 2025A Survey of World Models for Autonomous Drivingcited by 60
- 2023LiDAR Data Synthesis with Denoising Diffusion Probabilistic Modelscited by 53
- 2024LidarDM: Generative LiDAR Simulation in a Generated Worldcited by 53
- 2021A Survey on Deep Domain Adaptation for LiDAR Perceptioncited by 46
- 2024RangeLDM: Fast Realistic LiDAR Point Cloud Generationcited by 45
- 2023NeRF-LiDAR: Generating Realistic LiDAR Point Clouds with Neural Radiance Fieldscited by 44
- 2021Self-supervised Point Cloud Prediction Using 3D Spatio-temporal Convolutional Networkscited by 42
- 2024DynamicCity: Large-Scale 4D Occupancy Generation from Dynamic Scenescited by 37
- 2021Learning to Drop Points for LiDAR Scan Synthesiscited by 27
38 more
- 2024Text2LiDAR: Text-guided LiDAR Point Cloud Generation via Equirectangular Transformercited by 26
- 2024Forging Vision Foundation Models for Autonomous Driving: Challenges, Methodologies, and Opportunitiescited by 24
- 2021Contingencies from Observations: Tractable Contingency Planning with Learned Behavior Modelscited by 22
- 2023Dynamic LiDAR Re-simulation using Compositional Neural Fieldscited by 22
- 2024HoloDrive: Holistic 2D-3D Multi-Modal Street Scene Generation for Autonomous Drivingcited by 21
- 2022Generative Range Imaging for Learning Scene Priors of 3D LiDAR Datacited by 18
- 2022Learning to Simulate Realistic LiDARscited by 16
- 2022Analyzing Infrastructure LiDAR Placement with Realistic LiDAR Simulation Librarycited by 14
- 2024X-Drive: Cross-modality consistent multi-sensor data synthesis for driving scenarioscited by 13
- 2024OLiDM: Object-aware LiDAR Diffusion Models for Autonomous Drivingcited by 13
- 2025WeatherGen: A Unified Diverse Weather Generator for LiDAR Point Clouds via Spider Mamba Diffusioncited by 12
- 2024An Empirical Study of the Generalization Ability of Lidar 3D Object Detectors to Unseen Domainscited by 10
- 2024LiDAR-RT: Gaussian-based Ray Tracing for Dynamic LiDAR Re-simulationcited by 10
- 2022GeoPointGAN: Synthetic Spatial Data with Local Label Differential Privacycited by 9
- 2026UniDriveDreamer: A Single-Stage Multimodal World Model for Autonomous Drivingcited by 9
- 2023Lidar Upsampling with Sliced Wasserstein Distancecited by 8
- 2025R2LDM: An Efficient 4D Radar Super-Resolution Framework Leveraging Diffusion Modelcited by 7
- 2021Compressing Sensor Data for Remote Assistance of Autonomous Vehicles using Deep Generative Modelscited by 5
- 2022A Realism Metric for Generated LiDAR Point Cloudscited by 5
- 2024Taming Transformers for Realistic Lidar Point Cloud Generationcited by 5
- 2025U4D: Uncertainty-Aware 4D World Modeling from LiDAR Sequencescited by 5
- 2025OmniGen: Unified Multimodal Sensor Generation for Autonomous Drivingcited by 5
- 2021Pix2Point: Learning Outdoor 3D Using Sparse Point Clouds and Optimal Transportcited by 4
- 2022HALS: A Height-Aware Lidar Super-Resolution Framework for Autonomous Drivingcited by 4
- 2024Fast LiDAR Upsampling using Conditional Diffusion Modelscited by 4
- 2024LiDAR-EDIT: LiDAR Data Generation by Editing the Object Layouts in Real-World Scenescited by 4
- 2025A Self-Conditioned Representation Guided Diffusion Model for Realistic Text-to-LiDAR Scene Generationcited by 4
- 2021DSLR: Dynamic to Static LiDAR Scan Reconstruction Using Adversarially Trained Autoencodercited by 3
- 2021Multi-Echo LiDAR for 3D Object Detectioncited by 3
- 2025L2RDaS: Synthesizing 4D Radar Tensors for Model Generalization via Dataset Expansioncited by 3
- 2021Quantifying point cloud realism through adversarially learned latent representationscited by 2
- 2023GLiDR: Topologically Regularized Graph Generative Network for Sparse LiDAR Point Cloudscited by 2
- 2025SG-LDM: Semantic-Guided LiDAR Generation via Latent-Aligned Diffusioncited by 2
- 2025RadarGen: Automotive Radar Point Cloud Generation from Camerascited by 2
- 2026L3DR: 3D-aware LiDAR Diffusion and Rectificationcited by 2
- 2023MOVES: Movable and Moving LiDAR Scene Segmentation in Label-Free settings using Static Reconstructioncited by 1
- 2023Differentiable SLAM Helps Deep Learning-based LiDAR Perception Taskscited by 1
- 2023Paved2Paradise: Cost-Effective and Scalable LiDAR Simulation by Factoring the Real Worldcited by 1
50 most cited of 70 All 70 (JSON)
- 2026Scalable Rao-Blackwellized Online Planning for High-Dimensional POMDPs1 Sep 2026
- 2026T2LDM++: A Self-Conditioned Representation Guided Diffusion Model for Realistic Text-to-LiDAR Scene Generation29 Jun 2026
- 2026RS2AD-LiDAR: End-to-End Autonomous Driving LiDAR Data Generation from Roadside Sensor Observations22 May 2026
- 2026OmniLiDAR: A Unified Diffusion Framework for Multi-Domain 3D LiDAR Generation13 May 2026
- 2026DRUM: Diffusion-based Raydrop-aware Unpaired Mapping for Sim2Real LiDAR Segmentation27 Mar 2026
- 2026CoLC: Communication-Efficient Collaborative Perception with LiDAR Completion28 Feb 2026
- 2026Send Less, Perceive More: Masked Quantized Point Cloud Communication for Loss-Tolerant Collaborative Perception25 Feb 2026
- 2026L3DR: 3D-aware LiDAR Diffusion and Rectification22 Feb 2026
- 2026UniDriveDreamer: A Single-Stage Multimodal World Model for Autonomous Driving2 Feb 2026
- 2025LiDARDraft: Generating LiDAR Point Cloud from Versatile Inputs23 Dec 2025
- 2025RadarGen: Automotive Radar Point Cloud Generation from Cameras19 Dec 2025
- 2025OmniGen: Unified Multimodal Sensor Generation for Autonomous Driving16 Dec 2025
38 more
- 2025U4D: Uncertainty-Aware 4D World Modeling from LiDAR Sequences2 Dec 2025
- 2025LaGen: Towards Autoregressive LiDAR Scene Generation26 Nov 2025
- 2025A Self-Conditioned Representation Guided Diffusion Model for Realistic Text-to-LiDAR Scene Generation24 Nov 2025
- 2025Range-Edit: Semantic Mask Guided Outdoor LiDAR Scene Editing21 Nov 2025
- 2025LiSTAR: Ray-Centric World Models for 4D LiDAR Sequences in Autonomous Driving20 Nov 2025
- 2025LiDAR Point Cloud Image-based Generation Using Denoising Diffusion Probabilistic Models23 Sep 2025
- 2025SG-LDM: Semantic-Guided LiDAR Generation via Latent-Aligned Diffusion30 Jun 2025
- 2025WeatherGen: A Unified Diverse Weather Generator for LiDAR Point Clouds via Spider Mamba Diffusion18 Apr 2025
- 2025SLACK: Attacking LiDAR-based SLAM with Adversarial Point Injections3 Apr 2025
- 2025R2LDM: An Efficient 4D Radar Super-Resolution Framework Leveraging Diffusion Model21 Mar 2025
- 2025RS2AD: End-to-End Autonomous Driving Data Generation from Roadside Sensor Observations10 Mar 2025
- 2025ConcreTizer: Model Inversion Attack via Occupancy Classification and Dispersion Control for 3D Point Cloud Restoration10 Mar 2025
- 2025L2RDaS: Synthesizing 4D Radar Tensors for Model Generalization via Dataset Expansion5 Mar 2025
- 2025A Survey of World Models for Autonomous Driving20 Jan 2025
- 2024OLiDM: Object-aware LiDAR Diffusion Models for Autonomous Driving23 Dec 2024
- 2024LiDAR-RT: Gaussian-based Ray Tracing for Dynamic LiDAR Re-simulation19 Dec 2024
- 2024HoloDrive: Holistic 2D-3D Multi-Modal Street Scene Generation for Autonomous Driving2 Dec 2024
- 2024LiDAR-EDIT: LiDAR Data Generation by Editing the Object Layouts in Real-World Scenes30 Nov 2024
- 2024X-Drive: Cross-modality consistent multi-sensor data synthesis for driving scenarios2 Nov 2024
- 2024DynamicCity: Large-Scale 4D Occupancy Generation from Dynamic Scenes23 Oct 2024
- 2024Simultaneous Diffusion Sampling for Conditional LiDAR Generation15 Oct 2024
- 2024Text2LiDAR: Text-guided LiDAR Point Cloud Generation via Equirectangular Transformer29 Jul 2024
- 2024Fast LiDAR Upsampling using Conditional Diffusion Models8 May 2024
- 2024Toward Physics-Aware Deep Learning Architectures for LiDAR Intensity Simulation24 Apr 2024
- 2024Taming Transformers for Realistic Lidar Point Cloud Generation8 Apr 2024
- 2024LidarDM: Generative LiDAR Simulation in a Generated World3 Apr 2024
- 2024Towards Realistic Scene Generation with LiDAR Diffusion Models31 Mar 2024
- 2024RangeLDM: Fast Realistic LiDAR Point Cloud Generation15 Mar 2024
- 2024An Empirical Study of the Generalization Ability of Lidar 3D Object Detectors to Unseen Domains27 Feb 2024
- 2024Data-driven Camera and Lidar Simulation Models for Autonomous Driving: A Review from Generative Models to Volume Renderers29 Jan 2024
- 2024Forging Vision Foundation Models for Autonomous Driving: Challenges, Methodologies, and Opportunities16 Jan 2024
- 2023A Unified Generative Framework for Realistic Lidar Simulation in Autonomous Driving Systems25 Dec 2023
- 2023Dynamic LiDAR Re-simulation using Compositional Neural Fields8 Dec 2023
- 2023Paved2Paradise: Cost-Effective and Scalable LiDAR Simulation by Factoring the Real World2 Dec 2023
- 2023GLiDR: Topologically Regularized Graph Generative Network for Sparse LiDAR Point Clouds29 Nov 2023
- 2023UltraLiDAR: Learning Compact Representations for LiDAR Completion and Generation2 Nov 2023
- 2023LiDAR Data Synthesis with Denoising Diffusion Probabilistic Models17 Sep 2023
- 2023Differentiable SLAM Helps Deep Learning-based LiDAR Perception Tasks17 Sep 2023
50 newest of 70 All 70 (JSON)
- 2022Learning to Generate Realistic LiDAR Point Cloudscited by 91
- 2024Towards Realistic Scene Generation with LiDAR Diffusion Modelscited by 67
- 2025A Survey of World Models for Autonomous Drivingcited by 60
- 2023LiDAR Data Synthesis with Denoising Diffusion Probabilistic Modelscited by 53
- 2024RangeLDM: Fast Realistic LiDAR Point Cloud Generationcited by 45
- 2021Self-supervised Point Cloud Prediction Using 3D Spatio-temporal Convolutional Networkscited by 42
- 2024DynamicCity: Large-Scale 4D Occupancy Generation from Dynamic Scenescited by 37
- 2021Learning to Drop Points for LiDAR Scan Synthesiscited by 27
- 2024Text2LiDAR: Text-guided LiDAR Point Cloud Generation via Equirectangular Transformercited by 26
- 2022Generative Range Imaging for Learning Scene Priors of 3D LiDAR Datacited by 18
- 2024X-Drive: Cross-modality consistent multi-sensor data synthesis for driving scenarioscited by 13
- 2024OLiDM: Object-aware LiDAR Diffusion Models for Autonomous Drivingcited by 13
12 most cited of 25 All 25 (JSON)
- 2026T2LDM++: A Self-Conditioned Representation Guided Diffusion Model for Realistic Text-to-LiDAR Scene Generation29 Jun 2026
- 2026OmniLiDAR: A Unified Diffusion Framework for Multi-Domain 3D LiDAR Generation13 May 2026
- 2026L3DR: 3D-aware LiDAR Diffusion and Rectification22 Feb 2026
- 2026UniDriveDreamer: A Single-Stage Multimodal World Model for Autonomous Driving2 Feb 2026
- 2025LiDARDraft: Generating LiDAR Point Cloud from Versatile Inputs23 Dec 2025
- 2025U4D: Uncertainty-Aware 4D World Modeling from LiDAR Sequences2 Dec 2025
- 2025LaGen: Towards Autoregressive LiDAR Scene Generation26 Nov 2025
- 2025LiSTAR: Ray-Centric World Models for 4D LiDAR Sequences in Autonomous Driving20 Nov 2025
- 2025SG-LDM: Semantic-Guided LiDAR Generation via Latent-Aligned Diffusion30 Jun 2025
- 2025WeatherGen: A Unified Diverse Weather Generator for LiDAR Point Clouds via Spider Mamba Diffusion18 Apr 2025
- 2025A Survey of World Models for Autonomous Driving20 Jan 2025
- 2024OLiDM: Object-aware LiDAR Diffusion Models for Autonomous Driving23 Dec 2024
12 newest of 25 All 25 (JSON)
- 2025R2LDM: An Efficient 4D Radar Super-Resolution Framework Leveraging Diffusion Modelcited by 7
- 2024Fast LiDAR Upsampling using Conditional Diffusion Modelscited by 4
- 2025A Self-Conditioned Representation Guided Diffusion Model for Realistic Text-to-LiDAR Scene Generationcited by 4
- 2025RadarGen: Automotive Radar Point Cloud Generation from Camerascited by 2
- 2025LiDAR Point Cloud Image-based Generation Using Denoising Diffusion Probabilistic Modelscited by 0
- 2026DRUM: Diffusion-based Raydrop-aware Unpaired Mapping for Sim2Real LiDAR Segmentationcited by 0
- 2026DRUM: Diffusion-based Raydrop-aware Unpaired Mapping for Sim2Real LiDAR Segmentation27 Mar 2026
- 2025RadarGen: Automotive Radar Point Cloud Generation from Cameras19 Dec 2025
- 2025A Self-Conditioned Representation Guided Diffusion Model for Realistic Text-to-LiDAR Scene Generation24 Nov 2025
- 2025LiDAR Point Cloud Image-based Generation Using Denoising Diffusion Probabilistic Models23 Sep 2025
- 2025R2LDM: An Efficient 4D Radar Super-Resolution Framework Leveraging Diffusion Model21 Mar 2025
- 2024Fast LiDAR Upsampling using Conditional Diffusion Models8 May 2024
- 2024Forging Vision Foundation Models for Autonomous Driving: Challenges, Methodologies, and Opportunitiescited by 24
- 2024HoloDrive: Holistic 2D-3D Multi-Modal Street Scene Generation for Autonomous Drivingcited by 21
- 2025RS2AD: End-to-End Autonomous Driving Data Generation from Roadside Sensor Observationscited by 0
- 2026RS2AD-LiDAR: End-to-End Autonomous Driving LiDAR Data Generation from Roadside Sensor Observationscited by 0
- 2026RS2AD-LiDAR: End-to-End Autonomous Driving LiDAR Data Generation from Roadside Sensor Observations22 May 2026
- 2025RS2AD: End-to-End Autonomous Driving Data Generation from Roadside Sensor Observations10 Mar 2025
- 2024HoloDrive: Holistic 2D-3D Multi-Modal Street Scene Generation for Autonomous Driving2 Dec 2024
- 2024Forging Vision Foundation Models for Autonomous Driving: Challenges, Methodologies, and Opportunities16 Jan 2024
- 2023UltraLiDAR: Learning Compact Representations for LiDAR Completion and Generationcited by 76
- 2024LidarDM: Generative LiDAR Simulation in a Generated Worldcited by 53
- 2021A Survey on Deep Domain Adaptation for LiDAR Perceptioncited by 46
- 2023NeRF-LiDAR: Generating Realistic LiDAR Point Clouds with Neural Radiance Fieldscited by 44
- 2021Contingencies from Observations: Tractable Contingency Planning with Learned Behavior Modelscited by 22
- 2023Dynamic LiDAR Re-simulation using Compositional Neural Fieldscited by 22
- 2022Learning to Simulate Realistic LiDARscited by 16
- 2022Analyzing Infrastructure LiDAR Placement with Realistic LiDAR Simulation Librarycited by 14
- 2024An Empirical Study of the Generalization Ability of Lidar 3D Object Detectors to Unseen Domainscited by 10
- 2024LiDAR-RT: Gaussian-based Ray Tracing for Dynamic LiDAR Re-simulationcited by 10
- 2022GeoPointGAN: Synthetic Spatial Data with Local Label Differential Privacycited by 9
- 2023Lidar Upsampling with Sliced Wasserstein Distancecited by 8
12 most cited of 35 All 35 (JSON)
- 2026Scalable Rao-Blackwellized Online Planning for High-Dimensional POMDPs1 Sep 2026
- 2026CoLC: Communication-Efficient Collaborative Perception with LiDAR Completion28 Feb 2026
- 2026Send Less, Perceive More: Masked Quantized Point Cloud Communication for Loss-Tolerant Collaborative Perception25 Feb 2026
- 2025OmniGen: Unified Multimodal Sensor Generation for Autonomous Driving16 Dec 2025
- 2025Range-Edit: Semantic Mask Guided Outdoor LiDAR Scene Editing21 Nov 2025
- 2025SLACK: Attacking LiDAR-based SLAM with Adversarial Point Injections3 Apr 2025
- 2025ConcreTizer: Model Inversion Attack via Occupancy Classification and Dispersion Control for 3D Point Cloud Restoration10 Mar 2025
- 2025L2RDaS: Synthesizing 4D Radar Tensors for Model Generalization via Dataset Expansion5 Mar 2025
- 2024LiDAR-RT: Gaussian-based Ray Tracing for Dynamic LiDAR Re-simulation19 Dec 2024
- 2024Toward Physics-Aware Deep Learning Architectures for LiDAR Intensity Simulation24 Apr 2024
- 2024LidarDM: Generative LiDAR Simulation in a Generated World3 Apr 2024
- 2024An Empirical Study of the Generalization Ability of Lidar 3D Object Detectors to Unseen Domains27 Feb 2024
12 newest of 35 All 35 (JSON)