mlsanityData to 7 Oct 2026

SparseOcc++: Geometry-Aware Sparse Latent Representation for Semantic Occupancy Prediction

arXiv 2607.04732 ↗First posted 6 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Vision-based 3D semantic occupancy prediction is essential for autonomous driving, yet dense voxel representations waste computation on largely empty space, while BEV and TPV projections compromise fine-grained 3D structure. Fully sparse representations offer an attractive alternative, but existing methods, including SparseOcc, entangle scene completion with semantic prediction by indiscriminately propagating high-dimensional features into empty regions and applying voxel-wise classification. This creates excessive activations, computational overhead, and geometric ambiguity. We present SparseOcc++, a geometry-aware sparse framework that explicitly decouples scene completion from semantic segmentation. SparseOcc++ reformulates completion as signed-distance regression on sparse anchor voxels through a scene completion field (SCF). To model complex outdoor geometry robustly, it combines orthogonal decomposition with discretized distance learning. A geometry-guided propagation module then converts the SCF into a complete volumetric scene and restricts semantic segmentation to geometrically verified regions. Experiments establish new state of the art: SparseOcc++ improves IoU by 2.3 points and is 3.9x faster than SparseOcc on nuScenes, while achieving a 5.9x speedup over OccFormer on SemanticKITTI.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 88 of its 98 references that are in the map. First posted on arXiv 6 Jul 2026.

Builds on

88 of 98 references.

References · 88

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  4. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  5. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  6. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  7. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  8. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  9. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
  10. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  11. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
  12. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
38 more
  1. 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,707
  2. 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
  3. 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,213
  4. 2022Planning-oriented Autonomous Drivingcited by 1,068
  5. 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
  6. 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 844
  7. 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 711
  8. 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 568
  9. 2016Semantic Scene Completion from a Single Depth Imagecited by 468
  10. 2022TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformerscited by 464
  11. 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 404
  12. 2020Cylindrical and Asymmetrical 3D Convolution Networks for LiDAR Segmentationcited by 388
  13. 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 357
  14. 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 325
  15. 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 310
  16. 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 306
  17. 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 287
  18. 2022Cross-view Transformers for real-time Map-view Semantic Segmentationcited by 264
  19. 2021FIERY: Future Instance Prediction in Bird's-Eye View from Surround Monocular Camerascited by 239
  20. 2023OccWorld: Learning a 3D Occupancy World Model for Autonomous Drivingcited by 230
  21. 2024GenAD: Generative End-to-End Autonomous Drivingcited by 225
  22. 2020Sparse Single Sweep LiDAR Point Cloud Segmentation via Learning Contextual Shape Priors from Scene Completioncited by 222
  23. 2023OpenOccupancy: A Large Scale Benchmark for Surrounding Semantic Occupancy Perceptioncited by 218
  24. 2023Scene as Occupancycited by 208
  25. 2020LMSCNet: Lightweight Multiscale 3D Semantic Completioncited by 187
  26. 2020Predicting Semantic Map Representations from Images using Pyramid Occupancy Networkscited by 175
  27. 2023FB-OCC: 3D Occupancy Prediction based on Forward-Backward View Transformationcited by 162
  28. 20222DPASS: 2D Priors Assisted Semantic Segmentation on LiDAR Point Cloudscited by 157
  29. 2024GaussianFormer: Scene as Gaussians for Vision-Based 3D Semantic Occupancy Predictioncited by 155
  30. 2023DriveAdapter: Breaking the Coupling Barrier of Perception and Planning in End-to-End Autonomous Drivingcited by 142
  31. 2023SelfOcc: Self-Supervised Vision-Based 3D Occupancy Predictioncited by 133
  32. 2021LiDAR R-CNN: An Efficient and Universal 3D Object Detectorcited by 129
  33. 2020Anisotropic Convolutional Networks for 3D Semantic Scene Completioncited by 126
  34. 2023RenderOcc: Vision-Centric 3D Occupancy Prediction with 2D Rendering Supervisioncited by 126
  35. 20203D Sketch-aware Semantic Scene Completion via Semi-supervised Structure Priorcited by 124
  36. 2022BEVSegFormer: Bird's Eye View Semantic Segmentation From Arbitrary Camera Rigscited by 123
  37. 2023PanoOcc: Unified Occupancy Representation for Camera-based 3D Panoptic Segmentationcited by 114
  38. 2023FlashOcc: Fast and Memory-Efficient Occupancy Prediction via Channel-to-Height Plugincited by 101

50 most cited of 88 All 88 (JSON)

Built on by

Not cited yet.