PatchScene: Patch-based Voxel Diffusion for Large-Scale Scene Completion
On the map: World models → World modeling from LiDAR generation
Abstract (arXiv)
We propose PatchScene, a novel diffusion-based framework for large-scale LiDAR scene completion. Unlike existing methods that rely on global latent representations or dense voxel grids, PatchScene adopts a patch-based voxel diffusion paradigm that explicitly generates fine-grained geometry within localized 3D regions. To ensure coherent reconstruction at both spatial and temporal scales, we introduce a confidence-guided spatio-temporal fusion mechanism that integrates overlapping patches and adjacent frames in a unified generative process. Furthermore, we design an Annular-Flow diffusion strategy that leverages the radial density pattern of LiDAR scans to progressively propagate high-fidelity information from near-range to far-range regions, enabling spatially unbounded scene completion. Extensive experiments on the SemanticKITTI benchmark demonstrate that PatchScene achieves state-of-the-art performance across all standard metrics, surpassing previous approaches in both geometric accuracy and temporal consistency. Remarkably, the model trained on 20 m LiDAR ranges generalizes effectively to 50 m scenes without retraining, highlighting its strong scalability and generalization capability for real-world autonomous driving applications. Project page: https://patchscene.github.io/
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in World modeling from LiDAR generation, one of 11 directions in World models. Builds on 42 of its 48 references that are in the map. First posted on arXiv 2 Jun 2026.
Builds on
42 of 48 references.
Closest ancestors · 6
Same direction, newest first
- 2025LiDPM: Rethinking Point Diffusion for Lidar Scene Completion24 Apr
- 2024DiffSSC: Semantic LiDAR Scan Completion using Denoising Diffusion Probabilistic Models26 Sep
- 2024Towards Realistic Scene Generation with LiDAR Diffusion Models31 Mar
- 2024Scaling Diffusion Models to Real-World 3D LiDAR Scene Completion20 Mar
- 2023LiDAR Data Synthesis with Denoising Diffusion Probabilistic Models17 Sep
- 2022Learning to Generate Realistic LiDAR Point Clouds8 Sep
Other references · 36
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 735
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
- 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
- 2016Semantic Scene Completion from a Single Depth Imagecited by 472
- 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 332
- 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 313
- 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
- 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 189
- 2020LMSCNet: Lightweight Multiscale 3D Semantic Completioncited by 188
24 more
- 2022KISS-ICP: In Defense of Point-to-Point ICP -- Simple, Accurate, and Robust Registration If Done the Right Waycited by 132
- 2023Locally Attentional SDF Diffusion for Controllable 3D Shape Generationcited by 130
- 2020Complete & Label: A Domain Adaptation Approach to Semantic Segmentation of LiDAR Point Cloudscited by 116
- 2023DiT-3D: Exploring Plain Diffusion Transformers for 3D Shape Generationcited by 110
- 2022Sparse Fuse Dense: Towards High Quality 3D Detection with Depth Completioncited by 82
- 2023UltraLiDAR: Learning Compact Representations for LiDAR Completion and Generationcited by 78
- 2020Semantic Scene Completion using Local Deep Implicit Functions on LiDAR Datacited by 74
- 20213D Semantic Scene Completion: a Surveycited by 74
- 2024LidarDM: Generative LiDAR Simulation in a Generated Worldcited by 54
- 2024Omni6DPose: A Benchmark and Model for Universal 6D Object Pose Estimation and Trackingcited by 50
- 2023LODE: Locally Conditioned Eikonal Implicit Scene Completion from Sparse LiDARcited by 31
- 2022Domain generalization of 3D semantic segmentation in autonomous drivingcited by 25
- 2023DiffInDScene: Diffusion-based High-Quality 3D Indoor Scene Generationcited by 23
- 2023SALUDA: Surface-based Automotive Lidar Unsupervised Domain Adaptationcited by 21
- 2022Emergent Visual Sensors for Autonomous Vehiclescited by 19
- 2023Building Volumetric Beliefs for Dynamic Environments Exploiting Map-Based Moving Object Segmentationcited by 15
- 2024RoboKeyGen: Robot Pose and Joint Angles Estimation via Diffusion-based 3D Keypoint Generationcited by 10
- 2024Distilling Diffusion Models to Efficient 3D LiDAR Scene Completioncited by 10
- 2023Robot Structure Prior Guided Temporal Attention for Camera-to-Robot Pose Estimation from Image Sequencecited by 9
- 2020Scene Completeness-Aware Lidar Depth Completion for Driving Scenariocited by 7
- 2023LVDiffusor: Distilling Functional Rearrangement Priors from Large Models into Diffusorcited by 7
- 2025EarthCrafter: Scalable 3D Earth Generation via Dual-Sparse Latent Diffusioncited by 6
- 2026CADGrasp: Learning Contact and Collision Aware General Dexterous Grasping in Cluttered Scenescited by 4
- 2023SCP: Scene Completion Pre-training for 3D Object Detectioncited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Generative Semantic Scene Completion
- 2025LiNeXt: Revisiting LiDAR Completion with Efficient Non-Diffusion Architectures
- 2026CloudDiffusion: Diffusion-Based Scene Completion in the Point Cloud Domain
- 2026L3DR: 3D-aware LiDAR Diffusion and Rectification
- 2025Diffusion Distillation With Direct Preference Optimization For Efficient 3D LiDAR Scene Completion
- 2025SPIRAL: Semantic-Aware Progressive LiDAR Scene Generation and Understanding
- 2026Iterate or Widen? When Test-Time Refinement Helps LiDAR Scene Completion: A Controlled Study of Evidence Geometry, Training Coverage, and Compute
- 2026Geometry Without Coordinates: LiDAR Diffusion as a 3D Feature Bridge