Sparse Single Sweep LiDAR Point Cloud Segmentation via Learning Contextual Shape Priors from Scene Completion
Not on the map. Why?
Abstract (arXiv)
LiDAR point cloud analysis is a core task for 3D computer vision, especially for autonomous driving. However, due to the severe sparsity and noise interference in the single sweep LiDAR point cloud, the accurate semantic segmentation is non-trivial to achieve. In this paper, we propose a novel sparse LiDAR point cloud semantic segmentation framework assisted by learned contextual shape priors. In practice, an initial semantic segmentation (SS) of a single sweep point cloud can be achieved by any appealing network and then flows into the semantic scene completion (SSC) module as the input. By merging multiple frames in the LiDAR sequence as supervision, the optimized SSC module has learned the contextual shape priors from sequential LiDAR data, completing the sparse single sweep point cloud to the dense one. Thus, it inherently improves SS optimization through fully end-to-end training. Besides, a Point-Voxel Interaction (PVI) module is proposed to further enhance the knowledge fusion between SS and SSC tasks, i.e., promoting the interaction of incomplete local geometry of point cloud and complete voxel-wise global structure. Furthermore, the auxiliary SSC and PVI modules can be discarded during inference without extra burden for SS. Extensive experiments confirm that our JS3C-Net achieves superior performance on both SemanticKITTI and SemanticPOSS benchmarks, i.e., 4% and 3% improvement correspondingly.
Key facts. Cited by 222 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 21; 2023: 60; 2024: 62; 2025: 44; 2026: 22.
222 papers.
Sort:
By area:
- 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 404
- 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 357
- 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 325
- 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 310
- 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 306
- 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 287
- 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Drivingcited by 230
- 2023OpenOccupancy: A Large Scale Benchmark for Surrounding Semantic Occupancy Perceptioncited by 218
- 20222DPASS: 2D Priors Assisted Semantic Segmentation on LiDAR Point Cloudscited by 157
- 2024GaussianFormer: Scene as Gaussians for Vision-Based 3D Semantic Occupancy Predictioncited by 155
- 2021InstanceRefer: Cooperative Holistic Understanding for Visual Grounding on Point Clouds through Instance Multi-level Contextual Referringcited by 140
- 2023SelfOcc: Self-Supervised Vision-Based 3D Occupancy Predictioncited by 133
38 more
- 2023Rethinking Range View Representation for LiDAR Segmentationcited by 126
- 2023Spherical Transformer for LiDAR-based 3D Recognitioncited by 124
- 2023PanoOcc: Unified Occupancy Representation for Camera-based 3D Panoptic Segmentationcited by 114
- 2024UniScene: Unified Occupancy-centric Driving Scene Generationcited by 102
- 2023COTR: Compact Occupancy TRansformer for Vision-based 3D Occupancy Predictioncited by 94
- 2024SparseOcc: Rethinking Sparse Latent Representation for Vision-Based Semantic Occupancy Predictioncited by 94
- 2023Symphonize 3D Semantic Scene Completion with Contextual Instance Queriescited by 88
- 2023NDC-Scene: Boost Monocular 3D Semantic Scene Completion in Normalized Device Coordinates Spacecited by 88
- 2021Guided Point Contrastive Learning for Semi-supervised Point Cloud Semantic Segmentationcited by 87
- 2023OccDepth: A Depth-Aware Method for 3D Semantic Scene Completioncited by 85
- 2024GaussianFormer-2: Probabilistic Gaussian Superposition for Efficient 3D Occupancy Predictioncited by 83
- 2023SCPNet: Semantic Scene Completion on Point Cloudcited by 80
- 2023UltraLiDAR: Learning Compact Representations for LiDAR Completion and Generationcited by 76
- 20213D Semantic Scene Completion: a Surveycited by 74
- 2022LidarMultiNet: Towards a Unified Multi-Task Network for LiDAR Perceptioncited by 74
- 2023SSCBench: A Large-Scale 3D Semantic Scene Completion Benchmark for Autonomous Drivingcited by 72
- 2022Scribble-Supervised LiDAR Semantic Segmentationcited by 69
- 2023MSeg3D: Multi-modal 3D Semantic Segmentation for Autonomous Drivingcited by 68
- 2024Driving in the Occupancy World: Vision-Centric 4D Occupancy Forecasting and Planning via World Models for Autonomous Drivingcited by 67
- 2021Box-Aware Feature Enhancement for Single Object Tracking on Point Cloudscited by 66
- 2024GaussianWorld: Gaussian World Model for Streaming 3D Occupancy Predictioncited by 66
- 2021SQN: Weakly-Supervised Semantic Segmentation of Large-Scale 3D Point Cloudscited by 64
- 2021Behind the Curtain: Learning Occluded Shapes for 3D Object Detectioncited by 58
- 2023UniSeg: A Unified Multi-Modal LiDAR Segmentation Network and the OpenPCSeg Codebasecited by 57
- 2022Beyond 3D Siamese Tracking: A Motion-Centric Paradigm for 3D Single Object Tracking in Point Cloudscited by 55
- 2022LiDAR Distillation: Bridging the Beam-Induced Domain Gap for 3D Object Detectioncited by 54
- 2023Using a Waffle Iron for Automotive Point Cloud Semantic Segmentationcited by 53
- 2024SemCity: Semantic Scene Generation with Triplane Diffusioncited by 53
- 2023PointOcc: Cylindrical Tri-Perspective View for Point-based 3D Semantic Occupancy Predictioncited by 51
- 2023FRNet: Frustum-Range Networks for Scalable LiDAR Segmentationcited by 50
- 2024Context and Geometry Aware Voxel Transformer for Semantic Scene Completioncited by 50
- 2023OctreeOcc: Efficient and Multi-Granularity Occupancy Prediction Using Octree Queriescited by 48
- 2024Co-Occ: Coupling Explicit Feature Fusion with Volume Rendering Regularization for Multi-Modal 3D Semantic Occupancy Predictioncited by 46
- 2022Comprehensive Review of Deep Learning-Based 3D Point Cloud Completion Processing and Analysiscited by 44
- 2024MonoOcc: Digging into Monocular Semantic Occupancy Predictioncited by 43
- 2024Not All Voxels Are Equal: Hardness-Aware Semantic Scene Completion with Self-Distillationcited by 43
- 2023PaSCo: Urban 3D Panoptic Scene Completion with Uncertainty Awarenesscited by 42
- 2022LESS: Label-Efficient Semantic Segmentation for LiDAR Point Cloudscited by 41
50 most cited of 222 All 222 (JSON)
- 2026TriO: Tri-Modal Unsupervised Occupancy World Model for Anything Perception25 Sep 2026
- 2026SSC-Priors: Exploring Semantic and Visibility Priors to Boost Lidar Semantic Scene Completion15 Sep 2026
- 2026OPUS-V2: Bridging the Gap between Sparse Points and Dense Voxels29 Aug 2026
- 2026Generative Semantic Scene Completion27 Aug 2026
- 2026Geometry-Aware Spatio-Temporal Context Modeling for 4D Occupancy Forecasting15 Aug 2026
- 2026Iterate or Widen? When Test-Time Refinement Helps LiDAR Scene Completion: A Controlled Study of Evidence Geometry, Training Coverage, and Compute6 Aug 2026
- 2026SparseOcc++: Geometry-Aware Sparse Latent Representation for Semantic Occupancy Prediction6 Jul 2026
- 2026Sparse-Aware Vector Quantization for Bandwidth-Efficient Collaborative 3D Semantic Occupancy Prediction2 Jul 2026
- 2026Semantic Occupancy Prediction with Dual Range-Voxel Representation30 Jun 2026
- 2026EditSSC: Toward Editable Semantic Occupancy Scenes with Unconditional Diffusion Models8 Jun 2026
- 2026Exploring Easy Boosts for Lidar Semantic Scene Completion2 Jun 2026
- 2026WeatherOcc3D: VLM-Assisted Adverse Weather Aware 3D Semantic Occupancy Prediction15 May 2026
38 more
- 2026AdaSFormer: Adaptive Serialized Transformers for Monocular Semantic Scene Completion from Indoor Environments26 Mar 2026
- 2026M2-Occ: Resilient 3D Semantic Occupancy Prediction for Autonomous Driving with Incomplete Camera Inputs10 Mar 2026
- 20264DRC-OCC: Robust Semantic Occupancy Prediction Through Fusion of 4D Radar and Camera8 Mar 2026
- 2026VLMFusionOcc3D: VLM Assisted Multi-Modal 3D Semantic Occupancy Prediction3 Mar 2026
- 2026SelfOccFlow: Towards end-to-end self-supervised 3D Occupancy Flow prediction27 Feb 2026
- 2026SPOT-Occ: Sparse Prototype-guided Transformer for Camera-based 3D Occupancy Prediction4 Feb 2026
- 2026Multi-Resolution Alignment for Voxel Sparsity in Camera-Based 3D Semantic Scene Completion3 Feb 2026
- 2026LiFlow: Flow Matching for 3D LiDAR Scene Completion2 Feb 2026
- 2026FlowSSC: Universal Generative Monocular Semantic Scene Completion via One-Step Latent Diffusion21 Jan 2026
- 2026SUG-Occ: Explicit Semantics and Uncertainty Guided Sparse Learning for Efficient 3D Occupancy Prediction16 Jan 2026
- 2025VOIC: Visible-Occluded Integrated Guidance for 3D Semantic Scene Completion22 Dec 2025
- 2025Enhancing 3D Semantic Scene Completion with a Refinement Module20 Dec 2025
- 2025TransBridge: Boost 3D Object Detection by Scene-Level Completion with Transformer Decoder12 Dec 2025
- 2025Towards Temporal Fusion Beyond the Field of View for Camera-based Semantic Scene Completion16 Nov 2025
- 2025OneOcc: Semantic Occupancy Prediction for Legged Robots with a Single Panoramic Camera5 Nov 2025
- 2025OmniNWM: Omniscient Driving Navigation World Models21 Oct 2025
- 2025Vision-Centric 4D Occupancy Forecasting and Planning via Implicit Residual World Models19 Oct 2025
- 2025CymbaDiff: Structured Spatial Diffusion for Sketch-based 3D Semantic Urban Scene Generation15 Oct 2025
- 2025ST-GS: Vision-Based 3D Semantic Occupancy Prediction with Spatial-Temporal Gaussian Splatting20 Sep 2025
- 2025SPHERE: Semantic-PHysical Engaged REpresentation for 3D Semantic Scene Completion14 Sep 2025
- 2025SliceSemOcc: Vertical Slice Based Multimodal 3D Semantic Occupancy Representation4 Sep 2025
- 2025SplatSSC: Decoupled Depth-Guided Gaussian Splatting for Semantic Scene Completion4 Aug 2025
- 2025VisHall3D: Monocular Semantic Scene Completion from Reconstructing the Visible Regions to Hallucinating the Invisible Regions25 Jul 2025
- 2025One Step Closer: Creating the Future to Boost Monocular Semantic Scene Completion18 Jul 2025
- 2025From Binary to Semantic: Utilizing Large-Scale Binary Occupancy Data for 3D Semantic Occupancy Prediction16 Jul 2025
- 2025Disentangling Instance and Scene Contexts for 3D Semantic Scene Completion11 Jul 2025
- 2025Feed-Forward SceneDINO for Unsupervised Semantic Scene Completion8 Jul 2025
- 2025IPFormer: Visual 3D Panoptic Scene Completion with Context-Adaptive Instance Proposals25 Jun 2025
- 2025OC-SOP: Enhancing Vision-Based 3D Semantic Occupancy Prediction by Object-Centric Awareness23 Jun 2025
- 2025SWA-SOP: Spatially-aware Window Attention for Semantic Occupancy Prediction in Autonomous Driving23 Jun 2025
- 2025A Synthetic Benchmark for Collaborative 3D Semantic Occupancy Prediction in V2X-Enabled Autonomous Driving20 Jun 2025
- 2025QuadricFormer: Scene as Superquadrics for 3D Semantic Occupancy Prediction12 Jun 2025
- 2025VoxDet: Rethinking 3D Semantic Occupancy Prediction as Dense Object Detection5 Jun 2025
- 2025NUC-Net: Non-uniform Cylindrical Partition Network for Efficient LiDAR Semantic Segmentation30 May 2025
- 2025TACOcc:Target-Adaptive Cross-Modal Fusion with Volume Rendering for 3D Semantic Occupancy19 May 2025
- 2025GaussianFormer3D: Multi-Modal Gaussian-based Semantic Occupancy Prediction with 3D Deformable Attention15 May 2025
- 2025LiDPM: Rethinking Point Diffusion for Lidar Scene Completion24 Apr 2025
- 2025MS-Occ: Multi-Stage LiDAR-Camera Fusion for 3D Semantic Occupancy Prediction22 Apr 2025
50 newest of 222 All 222 (JSON)
- 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 325
- 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Drivingcited by 230
- 2023Rethinking Range View Representation for LiDAR Segmentationcited by 126
- 2024Driving in the Occupancy World: Vision-Centric 4D Occupancy Forecasting and Planning via World Models for Autonomous Drivingcited by 67
- 2024GaussianWorld: Gaussian World Model for Streaming 3D Occupancy Predictioncited by 66
- 2022MotionSC: Data Set and Network for Real-Time Semantic Mapping in Dynamic Environmentscited by 40
- 2023MUVO: A Multimodal Generative World Model for Autonomous Driving with Geometric Representationscited by 33
- 2025OmniNWM: Omniscient Driving Navigation World Modelscited by 32
- 2024OccGen: Generative Multi-modal 3D Occupancy Prediction for Autonomous Drivingcited by 28
- 2024DiffSSC: Semantic LiDAR Scan Completion using Denoising Diffusion Probabilistic Modelscited by 16
- 2025LiDPM: Rethinking Point Diffusion for Lidar Scene Completioncited by 10
- 2025Vision-Centric 4D Occupancy Forecasting and Planning via Implicit Residual World Modelscited by 3
12 most cited of 14 All 14 (JSON)
- 2026TriO: Tri-Modal Unsupervised Occupancy World Model for Anything Perception25 Sep 2026
- 2025OmniNWM: Omniscient Driving Navigation World Models21 Oct 2025
- 2025Vision-Centric 4D Occupancy Forecasting and Planning via Implicit Residual World Models19 Oct 2025
- 2025LiDPM: Rethinking Point Diffusion for Lidar Scene Completion24 Apr 2025
- 2024GaussianWorld: Gaussian World Model for Streaming 3D Occupancy Prediction13 Dec 2024
- 2024D2-World: An Efficient World Model through Decoupled Dynamic Flow26 Nov 2024
- 2024DiffSSC: Semantic LiDAR Scan Completion using Denoising Diffusion Probabilistic Models26 Sep 2024
- 2024Driving in the Occupancy World: Vision-Centric 4D Occupancy Forecasting and Planning via World Models for Autonomous Driving26 Aug 2024
- 2024OccGen: Generative Multi-modal 3D Occupancy Prediction for Autonomous Driving23 Apr 2024
- 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Driving27 Nov 2023
- 2023MUVO: A Multimodal Generative World Model for Autonomous Driving with Geometric Representations20 Nov 2023
- 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Driving27 Apr 2023
12 newest of 14 All 14 (JSON)
- 2024SemCity: Semantic Scene Generation with Triplane Diffusioncited by 53
- 2023Diffusion Probabilistic Models for Scene-Scale 3D Categorical Datacited by 33
- 2024SyntheOcc: Synthesize Geometric-Controlled Street View Images through 3D Semantic MPIscited by 14
- 2024OccScene: Semantic Occupancy-based Cross-task Mutual Learning for 3D Scene Generationcited by 10
- 2025Skip Mamba Diffusion for Monocular 3D Semantic Scene Completioncited by 9
- 2026FlowSSC: Universal Generative Monocular Semantic Scene Completion via One-Step Latent Diffusioncited by 2
- 2026LiFlow: Flow Matching for 3D LiDAR Scene Completioncited by 2
- 2026EditSSC: Toward Editable Semantic Occupancy Scenes with Unconditional Diffusion Modelscited by 0
- 2026Generative Semantic Scene Completioncited by 0
- 2026Generative Semantic Scene Completion27 Aug 2026
- 2026EditSSC: Toward Editable Semantic Occupancy Scenes with Unconditional Diffusion Models8 Jun 2026
- 2026LiFlow: Flow Matching for 3D LiDAR Scene Completion2 Feb 2026
- 2026FlowSSC: Universal Generative Monocular Semantic Scene Completion via One-Step Latent Diffusion21 Jan 2026
- 2025Skip Mamba Diffusion for Monocular 3D Semantic Scene Completion13 Jan 2025
- 2024OccScene: Semantic Occupancy-based Cross-task Mutual Learning for 3D Scene Generation15 Dec 2024
- 2024SyntheOcc: Synthesize Geometric-Controlled Street View Images through 3D Semantic MPIs1 Oct 2024
- 2024SemCity: Semantic Scene Generation with Triplane Diffusion12 Mar 2024
- 2023Diffusion Probabilistic Models for Scene-Scale 3D Categorical Data2 Jan 2023
- 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 404
- 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 357
- 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 310
- 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 306
- 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 287
- 2023OpenOccupancy: A Large Scale Benchmark for Surrounding Semantic Occupancy Perceptioncited by 218
- 20222DPASS: 2D Priors Assisted Semantic Segmentation on LiDAR Point Cloudscited by 157
- 2024GaussianFormer: Scene as Gaussians for Vision-Based 3D Semantic Occupancy Predictioncited by 155
- 2021InstanceRefer: Cooperative Holistic Understanding for Visual Grounding on Point Clouds through Instance Multi-level Contextual Referringcited by 140
- 2023SelfOcc: Self-Supervised Vision-Based 3D Occupancy Predictioncited by 133
- 2023Spherical Transformer for LiDAR-based 3D Recognitioncited by 124
- 2023PanoOcc: Unified Occupancy Representation for Camera-based 3D Panoptic Segmentationcited by 114
12 most cited of 194 All 194 (JSON)
- 2026SSC-Priors: Exploring Semantic and Visibility Priors to Boost Lidar Semantic Scene Completion15 Sep 2026
- 2026OPUS-V2: Bridging the Gap between Sparse Points and Dense Voxels29 Aug 2026
- 2026Geometry-Aware Spatio-Temporal Context Modeling for 4D Occupancy Forecasting15 Aug 2026
- 2026SparseOcc++: Geometry-Aware Sparse Latent Representation for Semantic Occupancy Prediction6 Jul 2026
- 2026Sparse-Aware Vector Quantization for Bandwidth-Efficient Collaborative 3D Semantic Occupancy Prediction2 Jul 2026
- 2026Semantic Occupancy Prediction with Dual Range-Voxel Representation30 Jun 2026
- 2026Exploring Easy Boosts for Lidar Semantic Scene Completion2 Jun 2026
- 2026WeatherOcc3D: VLM-Assisted Adverse Weather Aware 3D Semantic Occupancy Prediction15 May 2026
- 2026AdaSFormer: Adaptive Serialized Transformers for Monocular Semantic Scene Completion from Indoor Environments26 Mar 2026
- 2026M2-Occ: Resilient 3D Semantic Occupancy Prediction for Autonomous Driving with Incomplete Camera Inputs10 Mar 2026
- 20264DRC-OCC: Robust Semantic Occupancy Prediction Through Fusion of 4D Radar and Camera8 Mar 2026
- 2026VLMFusionOcc3D: VLM Assisted Multi-Modal 3D Semantic Occupancy Prediction3 Mar 2026
12 newest of 194 All 194 (JSON)