Learning to Generate 4D LiDAR Sequences
On the map: World models → World modeling from LiDAR generation
also in 1 more
Abstract (arXiv)
While generative world models have advanced video and occupancy-based data synthesis, LiDAR generation remains underexplored despite its importance for accurate 3D perception. Extending generation to 4D LiDAR data introduces challenges in controllability, temporal stability, and evaluation. We present LiDARCrafter, a unified framework that converts free-form language into editable LiDAR sequences. Instructions are parsed into ego-centric scene graphs, which a tri-branch diffusion model transforms into object layouts, trajectories, and shapes. A range-image diffusion model generates the initial scan, and an autoregressive module extends it into a temporally coherent sequence. The explicit layout design further supports object-level editing, such as insertion or relocation. To enable fair assessment, we provide EvalSuite, a benchmark spanning scene-, object-, and sequence-level metrics. On nuScenes, LiDARCrafter achieves state-of-the-art fidelity, controllability, and temporal consistency, offering a foundation for LiDAR-based simulation and data augmentation.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in World modeling from LiDAR generation, one of 11 directions in World models. Builds on 38 of its 39 references that are in the map. First posted on arXiv 15 Sep 2025.
Builds on
38 of 39 references.
Closest ancestors · 11
Same direction, newest first
- 2025Veila: Panoramic LiDAR Generation from a Monocular RGB Image5 Aug
- 2025Perspective-Invariant 3D Object Detection23 Jul
- 2025SPIRAL: Semantic-Aware Progressive LiDAR Scene Generation and Understanding28 May
- 2025WeatherGen: A Unified Diverse Weather Generator for LiDAR Point Clouds via Spider Mamba Diffusion18 Apr
- 2024LOGen: Toward Lidar Object Generation by Point Diffusion10 Dec
- 2024Fast LiDAR Data Generation with Rectified Flows3 Dec
- 2024Text2LiDAR: Text-guided LiDAR Point Cloud Generation via Equirectangular Transformer29 Jul
- 2024RangeLDM: Fast Realistic LiDAR Point Cloud Generation15 Mar
- 2023LiDAR Data Synthesis with Denoising Diffusion Probabilistic Models17 Sep
- 2023Rethinking Range View Representation for LiDAR Segmentation9 Mar
- 2022Learning to Generate Realistic LiDAR Point Clouds8 Sep
Other references · 27
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 618
- 2020Voxel R-CNN: Towards High Performance Voxel-based 3D Object Detectioncited by 409
- 2018Image Generation from Scene Graphscited by 324
- 2023MagicDrive: Street View Generation with Diverse 3D Geometry Controlcited by 250
- 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Drivingcited by 230
- 2024DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generationcited by 186
- 2023Robo3D: Towards Robust and Reliable 3D Perception against Corruptionscited by 128
- 2023Segment Any Point Cloud Sequences by Distilling Vision Foundation Modelscited by 123
- 2025Epona: Autoregressive Diffusion World Model for Autonomous Drivingcited by 115
15 more
- 2023Street-View Image Generation from a Bird's-Eye View Layoutcited by 102
- 2024UniScene: Unified Occupancy-centric Driving Scene Generationcited by 102
- 2024DriveArena: A Closed-loop Generative Simulation Platform for Autonomous Drivingcited by 98
- 2023UltraLiDAR: Learning Compact Representations for LiDAR Completion and Generationcited by 76
- 2024OccSora: 4D Occupancy Generation Models as World Simulators for Autonomous Drivingcited by 76
- 2024EchoScene: Indoor Scene Generation via Information Echo over Scene Graph Diffusioncited by 66
- 2024GaussianWorld: Gaussian World Model for Streaming 3D Occupancy Predictioncited by 66
- 20253D and 4D World Modeling: A Surveycited by 64
- 2024DynamicCity: Large-Scale 4D Occupancy Generation from Dynamic Scenescited by 37
- 2024DreamForge: Motion-Aware Autoregressive Video Generation for Multi-View Driving Scenescited by 34
- 20244D Contrastive Superflows are Dense 3D Representation Learnerscited by 32
- 2025Genesis: Multimodal Driving Scene Generation with Spatio-Temporal and Cross-Modal Consistencycited by 21
- 2025MMGDreamer: Mixed-Modality Graph for Geometry-Controllable 3D Indoor Scene Generationcited by 18
- 2024PerLDiff: Controllable Street View Synthesis Using Perspective-Layout Diffusion Modelscited by 12
- 2025La La LiDAR: Large-Scale Layout Generation from LiDAR Datacited by 10
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025LiDARCrafter: Dynamic 4D World Modeling from LiDAR Sequences
- 2024LidarDM: Generative LiDAR Simulation in a Generated World
- 2025DriveLiDAR4D: Sequential and Controllable LiDAR Scene Generation for Autonomous Driving
- 2025LaGen: Towards Autoregressive LiDAR Scene Generation
- 2025LiSTAR: Ray-Centric World Models for 4D LiDAR Sequences in Autonomous Driving
- 2024Towards Realistic Scene Generation with LiDAR Diffusion Models
- 2024LiDAR-EDIT: LiDAR Data Generation by Editing the Object Layouts in Real-World Scenes
- 2025U4D: Uncertainty-Aware 4D World Modeling from LiDAR Sequences