SUG-Occ: Explicit Semantics and Uncertainty Guided Sparse Learning for Efficient 3D Occupancy Prediction
Not on the map. Why?
Abstract (arXiv)
3D semantic occupancy prediction has emerged as a critical perception task for autonomous driving due to its ability to offer voxel-level semantic and geometric understanding of the environment. However, such a refined representation for large-scale scenes incurs prohibitive computation, posing a significant challenge to practical real-time deployment. To address this, we propose SUGOcc, an explicit semantics and uncertainty guided sparse learning framework for efficient occupancy prediction, which exploits the inherent sparsity of 3D scenes to reduce redundant computation while maintaining geometric and semantic integrity. Specifically, we first utilize semantic and uncertainty priors to suppress image projections from free space while employing explicit unsigned distance encoding to enhance geometric consistency, thereby producing a structurally sparse representation. Secondly, we introduce a cascade sparse completion module to enable efficient coarse-to-fine reasoning over the sparse representation via hyper cross sparse convolution, generative upsampling and adaptive pruning. Finally, we propose an object contextual representation (OCR) based mask decoder that refines the voxel-wise predictions through lightweight query-context interactions, thereby avoiding expensive attention operations over volumetric features. Extensive experiments on SemanticKITTI and Occ3D-Nuscenes benchmark demonstrate that the proposed approach outperforms the baselines, achieving notable improvements in both accuracy and efficiency across datasets.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 45 of its 55 references that are in the map. First posted on arXiv 16 Jan 2026.
Builds on
45 of 55 references.
References · 45
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,707
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,201
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
- 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 844
- 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 711
- 2019Segmentation Transformer: Object-Contextual Representations for Semantic Segmentationcited by 573
- 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 568
- 2022DN-DETR: Accelerate DETR Training by Introducing Query DeNoisingcited by 486
33 more
- 2016Semantic Scene Completion from a Single Depth Imagecited by 468
- 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 404
- 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 357
- 2022Mask DINO: Towards A Unified Transformer-based Framework for Object Detection and Segmentationcited by 341
- 2022BEVDet4D: Exploit Temporal Cues in Multi-camera 3D Object Detectioncited by 340
- 2021Categorical Depth Distribution Network for Monocular 3D Object Detectioncited by 326
- 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 325
- 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 310
- 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 306
- 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 287
- 2022SegNeXt: Rethinking Convolutional Attention Design for Semantic Segmentationcited by 252
- 2017Submanifold Sparse Convolutional Networkscited by 223
- 2020Sparse Single Sweep LiDAR Point Cloud Segmentation via Learning Contextual Shape Priors from Scene Completioncited by 222
- 2020LMSCNet: Lightweight Multiscale 3D Semantic Completioncited by 187
- 2019MVX-Net: Multimodal VoxelNet for 3D Object Detectioncited by 162
- 2023FB-OCC: 3D Occupancy Prediction based on Forward-Backward View Transformationcited by 162
- 2023SparseBEV: High-Performance Sparse 3D Object Detection from Multi-Camera Videoscited by 149
- 2022Focal Sparse Convolutional Networks for 3D Object Detectioncited by 142
- 20203D Sketch-aware Semantic Scene Completion via Semi-supervised Structure Priorcited by 124
- 2020S3CNet: A Sparse Semantic Scene Completion Network for LiDAR Point Cloudscited by 102
- 2024SparseOcc: Rethinking Sparse Latent Representation for Vision-Based Semantic Occupancy Predictioncited by 94
- 2020Generative Sparse Detection Networks for 3D Single-shot Object Detectioncited by 69
- 2024Exponential Moving Average of Weights in Deep Learning: Dynamics and Benefitscited by 65
- 2023Fully Sparse 3D Occupancy Predictioncited by 61
- 2024OPUS: Occupancy Prediction Using a Sparse Setcited by 56
- 2023PaSCo: Urban 3D Panoptic Scene Completion with Uncertainty Awarenesscited by 42
- 2023Camera-based 3D Semantic Scene Completion with Sparse Guidance Networkcited by 40
- 2023OccNeRF: Advancing 3D Occupancy Prediction in LiDAR-Free Environmentscited by 39
- 2024A Survey on Occupancy Perception for Autonomous Driving: The Information Fusion Perspectivecited by 37
- 2022Spatial Pruned Sparse Convolution for Efficient 3D Object Detectioncited by 26
- 2023PointBeV: A Sparse Approach to BeV Predictionscited by 23
- 2024ALOcc: Adaptive Lifting-Based 3D Semantic Occupancy and Cost Volume-Based Flow Predictionscited by 19
- 2024ProtoOcc: Accurate, Efficient 3D Occupancy Prediction Using Dual Branch Encoder-Prototype Query Decodercited by 17
Built on by
Not cited yet.