mlsanityData to 7 Oct 2026

SUG-Occ: Explicit Semantics and Uncertainty Guided Sparse Learning for Efficient 3D Occupancy Prediction

arXiv 2601.11396 ↗First posted 16 Jan 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

3D semantic occupancy prediction has emerged as a critical perception task for autonomous driving due to its ability to offer voxel-level semantic and geometric understanding of the environment. However, such a refined representation for large-scale scenes incurs prohibitive computation, posing a significant challenge to practical real-time deployment. To address this, we propose SUGOcc, an explicit semantics and uncertainty guided sparse learning framework for efficient occupancy prediction, which exploits the inherent sparsity of 3D scenes to reduce redundant computation while maintaining geometric and semantic integrity. Specifically, we first utilize semantic and uncertainty priors to suppress image projections from free space while employing explicit unsigned distance encoding to enhance geometric consistency, thereby producing a structurally sparse representation. Secondly, we introduce a cascade sparse completion module to enable efficient coarse-to-fine reasoning over the sparse representation via hyper cross sparse convolution, generative upsampling and adaptive pruning. Finally, we propose an object contextual representation (OCR) based mask decoder that refines the voxel-wise predictions through lightweight query-context interactions, thereby avoiding expensive attention operations over volumetric features. Extensive experiments on SemanticKITTI and Occ3D-Nuscenes benchmark demonstrate that the proposed approach outperforms the baselines, achieving notable improvements in both accuracy and efficiency across datasets.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 45 of its 55 references that are in the map. First posted on arXiv 16 Jan 2026.

Builds on

45 of 55 references.

References · 45

  1. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  2. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  3. 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
  4. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
  5. 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,707
  6. 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,201
  7. 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
  8. 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 844
  9. 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 711
  10. 2019Segmentation Transformer: Object-Contextual Representations for Semantic Segmentationcited by 573
  11. 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 568
  12. 2022DN-DETR: Accelerate DETR Training by Introducing Query DeNoisingcited by 486
33 more
  1. 2016Semantic Scene Completion from a Single Depth Imagecited by 468
  2. 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 404
  3. 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 357
  4. 2022Mask DINO: Towards A Unified Transformer-based Framework for Object Detection and Segmentationcited by 341
  5. 2022BEVDet4D: Exploit Temporal Cues in Multi-camera 3D Object Detectioncited by 340
  6. 2021Categorical Depth Distribution Network for Monocular 3D Object Detectioncited by 326
  7. 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 325
  8. 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 310
  9. 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 306
  10. 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 287
  11. 2022SegNeXt: Rethinking Convolutional Attention Design for Semantic Segmentationcited by 252
  12. 2017Submanifold Sparse Convolutional Networkscited by 223
  13. 2020Sparse Single Sweep LiDAR Point Cloud Segmentation via Learning Contextual Shape Priors from Scene Completioncited by 222
  14. 2020LMSCNet: Lightweight Multiscale 3D Semantic Completioncited by 187
  15. 2019MVX-Net: Multimodal VoxelNet for 3D Object Detectioncited by 162
  16. 2023FB-OCC: 3D Occupancy Prediction based on Forward-Backward View Transformationcited by 162
  17. 2023SparseBEV: High-Performance Sparse 3D Object Detection from Multi-Camera Videoscited by 149
  18. 2022Focal Sparse Convolutional Networks for 3D Object Detectioncited by 142
  19. 20203D Sketch-aware Semantic Scene Completion via Semi-supervised Structure Priorcited by 124
  20. 2020S3CNet: A Sparse Semantic Scene Completion Network for LiDAR Point Cloudscited by 102
  21. 2024SparseOcc: Rethinking Sparse Latent Representation for Vision-Based Semantic Occupancy Predictioncited by 94
  22. 2020Generative Sparse Detection Networks for 3D Single-shot Object Detectioncited by 69
  23. 2024Exponential Moving Average of Weights in Deep Learning: Dynamics and Benefitscited by 65
  24. 2023Fully Sparse 3D Occupancy Predictioncited by 61
  25. 2024OPUS: Occupancy Prediction Using a Sparse Setcited by 56
  26. 2023PaSCo: Urban 3D Panoptic Scene Completion with Uncertainty Awarenesscited by 42
  27. 2023Camera-based 3D Semantic Scene Completion with Sparse Guidance Networkcited by 40
  28. 2023OccNeRF: Advancing 3D Occupancy Prediction in LiDAR-Free Environmentscited by 39
  29. 2024A Survey on Occupancy Perception for Autonomous Driving: The Information Fusion Perspectivecited by 37
  30. 2022Spatial Pruned Sparse Convolution for Efficient 3D Object Detectioncited by 26
  31. 2023PointBeV: A Sparse Approach to BeV Predictionscited by 23
  32. 2024ALOcc: Adaptive Lifting-Based 3D Semantic Occupancy and Cost Volume-Based Flow Predictionscited by 19
  33. 2024ProtoOcc: Accurate, Efficient 3D Occupancy Prediction Using Dual Branch Encoder-Prototype Query Decodercited by 17

Built on by

Not cited yet.