La La LiDAR: Large-Scale Layout Generation from LiDAR Data
Not on the map. Why?
Abstract (arXiv)
Controllable generation of realistic LiDAR scenes is crucial for applications such as autonomous driving and robotics. While recent diffusion-based models achieve high-fidelity LiDAR generation, they lack explicit control over foreground objects and spatial relationships, limiting their usefulness for scenario simulation and safety validation. To address these limitations, we propose Large-scale Layout-guided LiDAR generation model ("La La LiDAR"), a novel layout-guided generative framework that introduces semantic-enhanced scene graph diffusion with relation-aware contextual conditioning for structured LiDAR layout generation, followed by foreground-aware control injection for complete scene generation. This enables customizable control over object placement while ensuring spatial and semantic consistency. To support our structured LiDAR generation, we introduce Waymo-SG and nuScenes-SG, two large-scale LiDAR scene graph datasets, along with new evaluation metrics for layout synthesis. Extensive experiments demonstrate that La La LiDAR achieves state-of-the-art performance in both LiDAR generation and downstream perception tasks, establishing a new benchmark for controllable 3D scene generation.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 31 of its 37 references that are in the map. First posted on arXiv 5 Aug 2025.
Builds on
31 of 37 references.
References · 31
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2017Neural Discrete Representation Learningcited by 4,712
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,208
- 2020Searching Efficient 3D Architectures with Sparse Point-Voxel Convolutioncited by 423
- 2018Image Generation from Scene Graphscited by 324
- 2023Robo3D: Towards Robust and Reliable 3D Perception against Corruptionscited by 129
- 2023DiT-3D: Exploring Plain Diffusion Transformers for 3D Shape Generationcited by 110
- 2021Graph-to-3D: End-to-End Generation and Manipulation of 3D Scenes Using Scene Graphscited by 84
- 2023LoGoNet: Towards Accurate 3D Object Detection with Local-to-Global Cross-Modal Fusioncited by 80
19 more
- 2023UltraLiDAR: Learning Compact Representations for LiDAR Completion and Generationcited by 78
- 2024EchoScene: Indoor Scene Generation via Information Echo over Scene Graph Diffusioncited by 67
- 2023UniSeg: A Unified Multi-Modal LiDAR Segmentation Network and the OpenPCSeg Codebasecited by 57
- 2023CommonScenes: Generating Commonsense 3D Indoor Scenes with Scene Graph Diffusioncited by 54
- 2024Multi-Modal Data-Efficient 3D Scene Understanding for Autonomous Drivingcited by 54
- 2024SemCity: Semantic Scene Generation with Triplane Diffusioncited by 53
- 2024RangeLDM: Fast Realistic LiDAR Point Cloud Generationcited by 47
- 2022MotionSC: Data Set and Network for Real-Time Semantic Mapping in Dynamic Environmentscited by 40
- 2024DynamicCity: Large-Scale 4D Occupancy Generation from Dynamic Scenescited by 38
- 2021Learning to Drop Points for LiDAR Scan Synthesiscited by 27
- 2024LiDAR4D: Dynamic Neural Fields for Novel Space-time View LiDAR Synthesiscited by 27
- 2024Text2LiDAR: Text-guided LiDAR Point Cloud Generation via Equirectangular Transformercited by 27
- 2024Multi-Space Alignments Towards Universal LiDAR Segmentationcited by 25
- 2025Compositional Generative Model of Unbounded 4D Citiescited by 17
- 2024Fast LiDAR Data Generation with Rectified Flowscited by 14
- 2025WeatherGen: A Unified Diverse Weather Generator for LiDAR Point Clouds via Spider Mamba Diffusioncited by 12
- 2024Distilling Diffusion Models to Efficient 3D LiDAR Scene Completioncited by 10
- 2025LiDPM: Rethinking Point Diffusion for Lidar Scene Completioncited by 10
- 2025Diffusion Distillation With Direct Preference Optimization For Efficient 3D LiDAR Scene Completioncited by 4
Built on by
Citing papers per year: 2025: 8; 2026: 2.
10 papers.
- 20253D and 4D World Modeling: A Surveycited by 67
- 2025Vision-Language-Action Models for Autonomous Driving: Past, Present, and Futurecited by 33
- 20253EED: Ground Everything Everywhere in 3Dcited by 12
- 2025AdLift: Lifting Adversarial Perturbations to Safeguard 3D Gaussian Splatting Assets Against Instruction-Driven Editingcited by 10
- 2025U4D: Uncertainty-Aware 4D World Modeling from LiDAR Sequencescited by 7
- 2025Forging Spatial Intelligence: A Roadmap of Multi-Modal Data Pre-Training for Autonomous Systemscited by 4
- 2026AdaSFormer: Adaptive Serialized Transformers for Monocular Semantic Scene Completion from Indoor Environmentscited by 3
- 2025Learning to Generate 4D LiDAR Sequencescited by 2
- 2025LaGen: Towards Autoregressive LiDAR Scene Generationcited by 2
- 2026OmniLiDAR: A Unified Diffusion Framework for Multi-Domain 3D LiDAR Generationcited by 2
- 2026OmniLiDAR: A Unified Diffusion Framework for Multi-Domain 3D LiDAR Generation13 May 2026
- 2026AdaSFormer: Adaptive Serialized Transformers for Monocular Semantic Scene Completion from Indoor Environments26 Mar 2026
- 2025Forging Spatial Intelligence: A Roadmap of Multi-Modal Data Pre-Training for Autonomous Systems30 Dec 2025
- 2025Vision-Language-Action Models for Autonomous Driving: Past, Present, and Future18 Dec 2025
- 2025AdLift: Lifting Adversarial Perturbations to Safeguard 3D Gaussian Splatting Assets Against Instruction-Driven Editing8 Dec 2025
- 2025U4D: Uncertainty-Aware 4D World Modeling from LiDAR Sequences2 Dec 2025
- 2025LaGen: Towards Autoregressive LiDAR Scene Generation26 Nov 2025
- 20253EED: Ground Everything Everywhere in 3D3 Nov 2025
- 2025Learning to Generate 4D LiDAR Sequences15 Sep 2025
- 20253D and 4D World Modeling: A Survey4 Sep 2025