OmniLiDAR: A Unified Diffusion Framework for Multi-Domain 3D LiDAR Generation
On the map: World models → World modeling from LiDAR generation
Abstract (arXiv)
LiDAR scene generation is increasingly important for scalable simulation and synthetic data creation, especially under diverse sensing conditions that are costly to capture at scale. Typically, diffusion-based LiDAR generators are developed under single-domain settings, requiring separate models for different datasets or sensing conditions and hindering unified, controllable synthesis under heterogeneous distribution shifts. To this end, we present OmniLiDAR, a unified text-conditioned diffusion framework that generates LiDAR scans in a shared range-image representation across eight representative domains spanning three shift types: adverse weather, sensor-configuration changes (e.g., reduced beams), and cross-platform acquisition (vehicle, drone, and quadruped). To enable training a single model over heterogeneous domains without isolating optimization by domain, we introduce a Cross-Domain Training Strategy (CDTS) that mixes domains within each mini-batch and leverages conditioning to steer generation. We further propose Cross-Domain Feature Modeling (CDFM), which captures directional dependencies along azimuth and elevation axes to reflect the anisotropic scanning structure of range images, and Domain-Adaptive Feature Scaling (DAFS) as a lightweight modulation to account for structured domain-dependent feature shifts during denoising. In the absence of a public consolidated benchmark, we construct an 8-domain dataset by combining real-world scans with physically based weather simulation and systematic beam reduction while following official splits. Extensive experiments demonstrate strong generation fidelity and consistent gains in downstream use cases, including generative data augmentation for LiDAR semantic segmentation and 3D object detection, as well as robustness evaluation under corruptions, with consistent benefits in limited-label regimes.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in World modeling from LiDAR generation, one of 11 directions in World models. Builds on 95 of its 105 references that are in the map. First posted on arXiv 13 May 2026.
Builds on
95 of 105 references.
Closest ancestors · 15
Same direction, newest first
- 2025U4D: Uncertainty-Aware 4D World Modeling from LiDAR Sequences2 Dec
- 2025LiDARCrafter: Dynamic 4D World Modeling from LiDAR Sequences5 Aug
- 2025Veila: Panoramic LiDAR Generation from a Monocular RGB Image5 Aug
- 2025Perspective-Invariant 3D Object Detection23 Jul
- 2025SPIRAL: Semantic-Aware Progressive LiDAR Scene Generation and Understanding28 May
- 2025WeatherGen: A Unified Diverse Weather Generator for LiDAR Point Clouds via Spider Mamba Diffusion18 Apr
- 2024Fast LiDAR Data Generation with Rectified Flows3 Dec
- 2024Text2LiDAR: Text-guided LiDAR Point Cloud Generation via Equirectangular Transformer29 Jul
- 2024Towards Realistic Scene Generation with LiDAR Diffusion Models31 Mar
- 2024RangeLDM: Fast Realistic LiDAR Point Cloud Generation15 Mar
- 2023LiDAR Data Synthesis with Denoising Diffusion Probabilistic Models17 Sep
- 2023Rethinking Range View Representation for LiDAR Segmentation9 Mar
3 more
Other references · 80
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,208
38 more
- 2020Center-based 3D Object Detection and Trackingcited by 1,144
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
- 2019PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detectioncited by 891
- 2017Unsupervised Image-to-Image Translation Networkscited by 603
- 2019RandLA-Net: Efficient Semantic Segmentation of Large-Scale Point Cloudscited by 585
- 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 575
- 2020Searching Efficient 3D Architectures with Sparse Point-Voxel Convolutioncited by 423
- 2020Voxel R-CNN: Towards High Performance Voxel-based 3D Object Detectioncited by 410
- 2020Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR Segmentationcited by 389
- 2019Deep Multi-modal Object Detection and Semantic Segmentation for Autonomous Driving: Datasets, Methods, and Challengescited by 314
- 2020PolarNet: An Improved Grid Representation for Online LiDAR Point Clouds Semantic Segmentationcited by 275
- 2021Projected GANs Converge Fastercited by 208
- 2023CLIP2Scene: Towards Label-efficient 3D Scene Understanding by CLIPcited by 181
- 2021RPVNet: A Deep and Efficient Range-Point-Voxel Fusion Network for LiDAR Point Cloud Segmentationcited by 173
- 2020SqueezeSegV3: Spatially-Adaptive Convolution for Efficient Point-Cloud Segmentationcited by 170
- 2021Panoptic nuScenes: A Large-Scale Benchmark for LiDAR Panoptic Segmentation and Trackingcited by 166
- 2023Robo3D: Towards Robust and Reliable 3D Perception against Corruptionscited by 129
- 2023Segment Any Point Cloud Sequences by Distilling Vision Foundation Modelscited by 125
- 2020SemanticPOSS: A Point Cloud Dataset with Large Quantity of Dynamic Instancescited by 123
- 2021MSeg: A Composite Dataset for Multi-domain Semantic Segmentationcited by 122
- 2025Are VLMs Ready for Autonomous Driving? An Empirical Study from the Reliability, Data, and Metric Perspectivescited by 122
- 2020Deep Learning for LiDAR Point Clouds in Autonomous Driving: A Reviewcited by 116
- 2024One-Step Image Translation with Text-to-Image Modelscited by 116
- 2021Panoptic-PolarNet: Proposal-free LiDAR Point Cloud Panoptic Segmentationcited by 107
- 2021Fog Simulation on Real LiDAR Point Clouds for 3D Object Detection in Adverse Weathercited by 97
- 2022LaserMix for Semi-Supervised LiDAR Semantic Segmentationcited by 93
- 2020AMVNet: Assertion-based Multi-View Fusion Network for LiDAR Semantic Segmentationcited by 87
- 2023Towards Large-scale 3D Representation Learning with Multi-dataset Point Prompt Trainingcited by 86
- 2020LiDAR-based Panoptic Segmentation via Dynamic Shifting Networkcited by 84
- 2023LoGoNet: Towards Accurate 3D Object Detection with Local-to-Global Cross-Modal Fusioncited by 80
- 2023UltraLiDAR: Learning Compact Representations for LiDAR Completion and Generationcited by 78
- 2023RangeViT: Towards Vision Transformers for 3D Semantic Segmentation in Autonomous Drivingcited by 76
- 2022LiDAR Snowfall Simulation for Robust 3D Object Detectioncited by 73
- 2018Deep Generative Modeling of LiDAR Datacited by 71
- 2022Scribble-Supervised LiDAR Semantic Segmentationcited by 69
- 2024SeeGround: See and Ground for Zero-Shot Open-Vocabulary 3D Visual Groundingcited by 67
- 20253D and 4D World Modeling: A Surveycited by 67
- 2020Object Detection with a Unified Label Space from Multiple Datasetscited by 65
50 most cited of 80 All 80 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.
- 2026Not All Points Are Equal: Uncertainty-Aware 4D LiDAR Scene Synthesiscited by 1
- 2026VITAL: From Visual Motion to Precise Actioncited by 0
- 2026VITAL: From Visual Motion to Precise Action14 Oct 2026
- 2026Not All Points Are Equal: Uncertainty-Aware 4D LiDAR Scene Synthesis1 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2024Simultaneous Diffusion Sampling for Conditional LiDAR Generation
- 2025A Self-Conditioned Representation Guided Diffusion Model for Realistic Text-to-LiDAR Scene Generation
- 2025Learning to Generate 4D LiDAR Sequences
- 2024LOGen: Toward Lidar Object Generation by Point Diffusion
- 2026T2LDM++: A Self-Conditioned Representation Guided Diffusion Model for Realistic Text-to-LiDAR Scene Generation
- 2026Geometry Without Coordinates: LiDAR Diffusion as a 3D Feature Bridge
- 2026Into the LidarVerse: A Real-Time Unified LiDAR World Model Across Tasks and Sensors
- 2026LiFi: LiDAR Generation from Multi-View Images via Geometric and Semantic Collaborative Guidance