mlsanityData to 14 Oct 2026

OmniLiDAR: A Unified Diffusion Framework for Multi-Domain 3D LiDAR Generation

arXiv 2605.13815 ↗First posted 13 May 2026cs.CV cs.ROcited by 2

On the map: World models → World modeling from LiDAR generation

Abstract (arXiv)

LiDAR scene generation is increasingly important for scalable simulation and synthetic data creation, especially under diverse sensing conditions that are costly to capture at scale. Typically, diffusion-based LiDAR generators are developed under single-domain settings, requiring separate models for different datasets or sensing conditions and hindering unified, controllable synthesis under heterogeneous distribution shifts. To this end, we present OmniLiDAR, a unified text-conditioned diffusion framework that generates LiDAR scans in a shared range-image representation across eight representative domains spanning three shift types: adverse weather, sensor-configuration changes (e.g., reduced beams), and cross-platform acquisition (vehicle, drone, and quadruped). To enable training a single model over heterogeneous domains without isolating optimization by domain, we introduce a Cross-Domain Training Strategy (CDTS) that mixes domains within each mini-batch and leverages conditioning to steer generation. We further propose Cross-Domain Feature Modeling (CDFM), which captures directional dependencies along azimuth and elevation axes to reflect the anisotropic scanning structure of range images, and Domain-Adaptive Feature Scaling (DAFS) as a lightweight modulation to account for structured domain-dependent feature shifts during denoising. In the absence of a public consolidated benchmark, we construct an 8-domain dataset by combining real-world scans with physically based weather simulation and systematic beam reduction while following official splits. Extensive experiments demonstrate strong generation fidelity and consistent gains in downstream use cases, including generative data augmentation for LiDAR semantic segmentation and 3D object detection, as well as robustness evaluation under corruptions, with consistent benefits in limited-label regimes.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in World modeling from LiDAR generation, one of 11 directions in World models. Builds on 95 of its 105 references that are in the map. First posted on arXiv 13 May 2026.

Builds on

95 of 105 references.

Closest ancestors · 15

Same direction, newest first

  1. 2025U4D: Uncertainty-Aware 4D World Modeling from LiDAR Sequences2 Dec
  2. 2025LiDARCrafter: Dynamic 4D World Modeling from LiDAR Sequences5 Aug
  3. 2025Veila: Panoramic LiDAR Generation from a Monocular RGB Image5 Aug
  4. 2025Perspective-Invariant 3D Object Detection23 Jul
  5. 2025SPIRAL: Semantic-Aware Progressive LiDAR Scene Generation and Understanding28 May
  6. 2025WeatherGen: A Unified Diverse Weather Generator for LiDAR Point Clouds via Spider Mamba Diffusion18 Apr
  7. 2024Fast LiDAR Data Generation with Rectified Flows3 Dec
  8. 2024Text2LiDAR: Text-guided LiDAR Point Cloud Generation via Equirectangular Transformer29 Jul
  9. 2024Towards Realistic Scene Generation with LiDAR Diffusion Models31 Mar
  10. 2024RangeLDM: Fast Realistic LiDAR Point Cloud Generation15 Mar
  11. 2023LiDAR Data Synthesis with Denoising Diffusion Probabilistic Models17 Sep
  12. 2023Rethinking Range View Representation for LiDAR Segmentation9 Mar
3 more
  1. 2022Learning to Generate Realistic LiDAR Point Clouds8 Sep
  2. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space7 Jun
  3. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation2 Dec

Other references · 80

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2022Scalable Diffusion Models with Transformerscited by 6,054
  4. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  5. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  6. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  7. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
  8. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  9. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  10. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
  11. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
  12. 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,208
38 more
  1. 2020Center-based 3D Object Detection and Trackingcited by 1,144
  2. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
  3. 2019PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detectioncited by 891
  4. 2017Unsupervised Image-to-Image Translation Networkscited by 603
  5. 2019RandLA-Net: Efficient Semantic Segmentation of Large-Scale Point Cloudscited by 585
  6. 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 575
  7. 2020Searching Efficient 3D Architectures with Sparse Point-Voxel Convolutioncited by 423
  8. 2020Voxel R-CNN: Towards High Performance Voxel-based 3D Object Detectioncited by 410
  9. 2020Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR Segmentationcited by 389
  10. 2019Deep Multi-modal Object Detection and Semantic Segmentation for Autonomous Driving: Datasets, Methods, and Challengescited by 314
  11. 2020PolarNet: An Improved Grid Representation for Online LiDAR Point Clouds Semantic Segmentationcited by 275
  12. 2021Projected GANs Converge Fastercited by 208
  13. 2023CLIP2Scene: Towards Label-efficient 3D Scene Understanding by CLIPcited by 181
  14. 2021RPVNet: A Deep and Efficient Range-Point-Voxel Fusion Network for LiDAR Point Cloud Segmentationcited by 173
  15. 2020SqueezeSegV3: Spatially-Adaptive Convolution for Efficient Point-Cloud Segmentationcited by 170
  16. 2021Panoptic nuScenes: A Large-Scale Benchmark for LiDAR Panoptic Segmentation and Trackingcited by 166
  17. 2023Robo3D: Towards Robust and Reliable 3D Perception against Corruptionscited by 129
  18. 2023Segment Any Point Cloud Sequences by Distilling Vision Foundation Modelscited by 125
  19. 2020SemanticPOSS: A Point Cloud Dataset with Large Quantity of Dynamic Instancescited by 123
  20. 2021MSeg: A Composite Dataset for Multi-domain Semantic Segmentationcited by 122
  21. 2025Are VLMs Ready for Autonomous Driving? An Empirical Study from the Reliability, Data, and Metric Perspectivescited by 122
  22. 2020Deep Learning for LiDAR Point Clouds in Autonomous Driving: A Reviewcited by 116
  23. 2024One-Step Image Translation with Text-to-Image Modelscited by 116
  24. 2021Panoptic-PolarNet: Proposal-free LiDAR Point Cloud Panoptic Segmentationcited by 107
  25. 2021Fog Simulation on Real LiDAR Point Clouds for 3D Object Detection in Adverse Weathercited by 97
  26. 2022LaserMix for Semi-Supervised LiDAR Semantic Segmentationcited by 93
  27. 2020AMVNet: Assertion-based Multi-View Fusion Network for LiDAR Semantic Segmentationcited by 87
  28. 2023Towards Large-scale 3D Representation Learning with Multi-dataset Point Prompt Trainingcited by 86
  29. 2020LiDAR-based Panoptic Segmentation via Dynamic Shifting Networkcited by 84
  30. 2023LoGoNet: Towards Accurate 3D Object Detection with Local-to-Global Cross-Modal Fusioncited by 80
  31. 2023UltraLiDAR: Learning Compact Representations for LiDAR Completion and Generationcited by 78
  32. 2023RangeViT: Towards Vision Transformers for 3D Semantic Segmentation in Autonomous Drivingcited by 76
  33. 2022LiDAR Snowfall Simulation for Robust 3D Object Detectioncited by 73
  34. 2018Deep Generative Modeling of LiDAR Datacited by 71
  35. 2022Scribble-Supervised LiDAR Semantic Segmentationcited by 69
  36. 2024SeeGround: See and Ground for Zero-Shot Open-Vocabulary 3D Visual Groundingcited by 67
  37. 20253D and 4D World Modeling: A Surveycited by 67
  38. 2020Object Detection with a Unified Label Space from Multiple Datasetscited by 65

50 most cited of 80 All 80 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Simultaneous Diffusion Sampling for Conditional LiDAR Generation
  2. 2025A Self-Conditioned Representation Guided Diffusion Model for Realistic Text-to-LiDAR Scene Generation
  3. 2025Learning to Generate 4D LiDAR Sequences
  4. 2024LOGen: Toward Lidar Object Generation by Point Diffusion
  5. 2026T2LDM++: A Self-Conditioned Representation Guided Diffusion Model for Realistic Text-to-LiDAR Scene Generation
  6. 2026Geometry Without Coordinates: LiDAR Diffusion as a 3D Feature Bridge
  7. 2026Into the LidarVerse: A Real-Time Unified LiDAR World Model Across Tasks and Sensors
  8. 2026LiFi: LiDAR Generation from Multi-View Images via Geometric and Semantic Collaborative Guidance