Fast LiDAR Data Generation with Rectified Flows
On the map: World models → World modeling from LiDAR generation
also in 1 more
Abstract (arXiv)
Building LiDAR generative models holds promise as powerful data priors for restoration, scene manipulation, and scalable simulation in autonomous mobile robots. In recent years, approaches using diffusion models have emerged, significantly improving training stability and generation quality. Despite their success, diffusion models require numerous iterations of running neural networks to generate high-quality samples, making the increasing computational cost a potential barrier for robotics applications. To address this challenge, this paper presents R2Flow, a fast and high-fidelity generative model for LiDAR data. Our method is based on rectified flows that learn straight trajectories, simulating data generation with significantly fewer sampling steps compared to diffusion models. We also propose an efficient Transformer-based model architecture for processing the image representation of LiDAR range and reflectance measurements. Our experiments on unconditional LiDAR data generation using the KITTI-360 dataset demonstrate the effectiveness of our approach in terms of both efficiency and quality.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Placed in World modeling from LiDAR generation, one of 11 directions in World models. Builds on 30 of its 33 references that are in the map. First posted on arXiv 3 Dec 2024.
Builds on
30 of 33 references.
Closest ancestors · 6
Same direction, newest first
- 2024Towards Realistic Scene Generation with LiDAR Diffusion Models31 Mar
- 2024RangeLDM: Fast Realistic LiDAR Point Cloud Generation15 Mar
- 2023LiDAR Data Synthesis with Denoising Diffusion Probabilistic Models17 Sep
- 2022Generative Range Imaging for Learning Scene Priors of 3D LiDAR Data21 Oct
- 2022Learning to Generate Realistic LiDAR Point Clouds8 Sep
- 2021Learning to Drop Points for LiDAR Scan Synthesis23 Feb
Other references · 24
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2017Neural Discrete Representation Learningcited by 4,650
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
12 more
- 2021Variational Diffusion Modelscited by 1,145
- 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,036
- 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 835
- 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 570
- 2022All are Worth Words: A ViT Backbone for Diffusion Modelscited by 498
- 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 251
- 2022Neighborhood Attention Transformercited by 235
- 20193D Point Cloud Generative Adversarial Network Based on Tree Structured Graph Convolutionscited by 173
- 2024Scalable High-Resolution Pixel-Space Image Synthesis with Hourglass Diffusion Transformerscited by 116
- 2024Improving the Training of Rectified Flowscited by 106
- 2023UltraLiDAR: Learning Compact Representations for LiDAR Completion and Generationcited by 76
- 2023TULIP: Transformer for Upsampling of LiDAR Point Cloudscited by 12
Built on by
Citing papers per year: 2025: 8; 2026: 5.
13 papers.
Sort:
By area:
- 20253D and 4D World Modeling: A Surveycited by 64
- 2025LiDARCrafter: Dynamic 4D World Modeling from LiDAR Sequencescited by 14
- 2025Towards foundational LiDAR world models with efficient latent flow matchingcited by 10
- 2025La La LiDAR: Large-Scale Layout Generation from LiDAR Datacited by 10
- 2025U4D: Uncertainty-Aware 4D World Modeling from LiDAR Sequencescited by 5
- 2025Learning to Generate 4D LiDAR Sequencescited by 2
- 2026R3DPA: Leveraging 3D Representation Alignment and RGB Pretrained Priors for LiDAR Scene Generationcited by 2
- 2026L3DR: 3D-aware LiDAR Diffusion and Rectificationcited by 2
- 2025ReSeFlow: Rectifying SE(3)-Equivariant Policy Learning Flowscited by 0
- 2025LiSTAR: Ray-Centric World Models for 4D LiDAR Sequences in Autonomous Drivingcited by 0
- 2026DRUM: Diffusion-based Raydrop-aware Unpaired Mapping for Sim2Real LiDAR Segmentationcited by 0
- 2026OmniLiDAR: A Unified Diffusion Framework for Multi-Domain 3D LiDAR Generationcited by 0
- 2026Image-to-Point Cloud Registration Made Easy with Rectified Flow-based LiDAR Upsampling16 Jul 2026
- 2026OmniLiDAR: A Unified Diffusion Framework for Multi-Domain 3D LiDAR Generation13 May 2026
- 2026DRUM: Diffusion-based Raydrop-aware Unpaired Mapping for Sim2Real LiDAR Segmentation27 Mar 2026
- 2026L3DR: 3D-aware LiDAR Diffusion and Rectification22 Feb 2026
- 2026R3DPA: Leveraging 3D Representation Alignment and RGB Pretrained Priors for LiDAR Scene Generation12 Jan 2026
- 2025U4D: Uncertainty-Aware 4D World Modeling from LiDAR Sequences2 Dec 2025
- 2025LiSTAR: Ray-Centric World Models for 4D LiDAR Sequences in Autonomous Driving20 Nov 2025
- 2025ReSeFlow: Rectifying SE(3)-Equivariant Policy Learning Flows20 Sep 2025
- 2025Learning to Generate 4D LiDAR Sequences15 Sep 2025
- 20253D and 4D World Modeling: A Survey4 Sep 2025
- 2025LiDARCrafter: Dynamic 4D World Modeling from LiDAR Sequences5 Aug 2025
- 2025La La LiDAR: Large-Scale Layout Generation from LiDAR Data5 Aug 2025
1 more
- 20253D and 4D World Modeling: A Surveycited by 64
- 2025LiDARCrafter: Dynamic 4D World Modeling from LiDAR Sequencescited by 14
- 2025Towards foundational LiDAR world models with efficient latent flow matchingcited by 10
- 2025U4D: Uncertainty-Aware 4D World Modeling from LiDAR Sequencescited by 5
- 2025Learning to Generate 4D LiDAR Sequencescited by 2
- 2026R3DPA: Leveraging 3D Representation Alignment and RGB Pretrained Priors for LiDAR Scene Generationcited by 2
- 2026L3DR: 3D-aware LiDAR Diffusion and Rectificationcited by 2
- 2025LiSTAR: Ray-Centric World Models for 4D LiDAR Sequences in Autonomous Drivingcited by 0
- 2026OmniLiDAR: A Unified Diffusion Framework for Multi-Domain 3D LiDAR Generationcited by 0
- 2026OmniLiDAR: A Unified Diffusion Framework for Multi-Domain 3D LiDAR Generation13 May 2026
- 2026L3DR: 3D-aware LiDAR Diffusion and Rectification22 Feb 2026
- 2026R3DPA: Leveraging 3D Representation Alignment and RGB Pretrained Priors for LiDAR Scene Generation12 Jan 2026
- 2025U4D: Uncertainty-Aware 4D World Modeling from LiDAR Sequences2 Dec 2025
- 2025LiSTAR: Ray-Centric World Models for 4D LiDAR Sequences in Autonomous Driving20 Nov 2025
- 2025Learning to Generate 4D LiDAR Sequences15 Sep 2025
- 20253D and 4D World Modeling: A Survey4 Sep 2025
- 2025LiDARCrafter: Dynamic 4D World Modeling from LiDAR Sequences5 Aug 2025
- 2025Towards foundational LiDAR world models with efficient latent flow matching30 Jun 2025
Similar, not cited
Close in wording, no citation either way
- 2024Fast LiDAR Upsampling using Conditional Diffusion Models
- 2024LOGen: Toward Lidar Object Generation by Point Diffusion
- 2025LaGen: Towards Autoregressive LiDAR Scene Generation
- 2025SPIRAL: Semantic-Aware Progressive LiDAR Scene Generation and Understanding
- 2024Scaling Diffusion Models to Real-World 3D LiDAR Scene Completion
- 2026T2LDM++: A Self-Conditioned Representation Guided Diffusion Model for Realistic Text-to-LiDAR Scene Generation
- 2025A Self-Conditioned Representation Guided Diffusion Model for Realistic Text-to-LiDAR Scene Generation
- 2024Simultaneous Diffusion Sampling for Conditional LiDAR Generation