Efficient Semantic Scene Completion Network with Spatial Group Convolution
Not on the map. Why?
Abstract (arXiv)
We introduce Spatial Group Convolution (SGC) for accelerating the computation of 3D dense prediction tasks. SGC is orthogonal to group convolution, which works on spatial dimensions rather than feature channel dimension. It divides input voxels into different groups, then conducts 3D sparse convolution on these separated groups. As only valid voxels are considered when performing convolution, computation can be significantly reduced with a slight loss of accuracy. The proposed operations are validated on semantic scene completion task, which aims to predict a complete 3D volume with semantic labels from a single depth image. With SGC, we further present an efficient 3D sparse convolutional network, which harnesses a multiscale architecture and a coarse-to-fine prediction strategy. Evaluations are conducted on the SUNCG dataset, achieving state-of-the-art performance and fast speed. Code is available at https://github.com/zjhthu/SGC-Release.git
Key facts. Cited by 66 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Jul 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 5; 2023: 17; 2024: 18; 2025: 12; 2026: 3.
66 papers.
Sort:
By area:
- 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 357
- 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 306
- 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 287
- 2023OpenOccupancy: A Large Scale Benchmark for Surrounding Semantic Occupancy Perceptioncited by 218
- 2023SelfOcc: Self-Supervised Vision-Based 3D Occupancy Predictioncited by 133
- 2023NDC-Scene: Boost Monocular 3D Semantic Scene Completion in Normalized Device Coordinates Spacecited by 88
- 2023SCPNet: Semantic Scene Completion on Point Cloudcited by 80
- 20213D Semantic Scene Completion: a Surveycited by 74
- 2022LargeKernel3D: Scaling up Kernels in 3D Sparse CNNscited by 71
- 2023AdaPoinTr: Diverse Point Cloud Completion with Adaptive Geometry-Aware Transformerscited by 65
- 2024Volumetric Environment Representation for Vision-Language Navigationcited by 63
- 2021Semantic Scene Completion via Integrating Instances and Scene in-the-Loopcited by 54
38 more
- 2024Context and Geometry Aware Voxel Transformer for Semantic Scene Completioncited by 50
- 2024Co-Occ: Coupling Explicit Feature Fusion with Volume Rendering Regularization for Multi-Modal 3D Semantic Occupancy Predictioncited by 46
- 2023PaSCo: Urban 3D Panoptic Scene Completion with Uncertainty Awarenesscited by 42
- 2022MotionSC: Data Set and Network for Real-Time Semantic Mapping in Dynamic Environmentscited by 40
- 2023Camera-based 3D Semantic Scene Completion with Sparse Guidance Networkcited by 40
- 2021Semantic Segmentation-assisted Scene Completion for LiDAR Point Cloudscited by 37
- 2024Occupancy as Set of Pointscited by 37
- 2023STEPS: Joint Self-supervised Nighttime Image Enhancement and Depth Estimationcited by 36
- 2024RadarOcc: Robust 3D Occupancy Prediction with 4D Imaging Radarcited by 32
- 2024Hierarchical Temporal Context Learning for Camera-based Semantic Scene Completioncited by 32
- 2023SSC-RS: Elevate LiDAR Semantic Scene Completion with Representation Separation and BEV Fusioncited by 30
- 2023DepthSSC: Monocular 3D Semantic Scene Completion via Depth-Spatial Alignment and Voxel Adaptationcited by 30
- 2024Monocular Occupancy Prediction for Scalable Indoor Scenescited by 29
- 2023S4C: Self-Supervised Semantic Scene Completion with Neural Fieldscited by 27
- 2021PQ-Transformer: Jointly Parsing 3D Objects and Layouts from Point Cloudscited by 26
- 2021Cerberus Transformer: Joint Semantic, Affordance and Attribute Parsingcited by 22
- 2021Not All Voxels Are Equal: Semantic Scene Completion from the Point-Voxel Perspectivecited by 22
- 2023SALUDA: Surface-based Automotive Lidar Unsupervised Domain Adaptationcited by 21
- 2024LiCROcc: Teach Radar for Accurate Semantic Occupancy Prediction using LiDAR and Cameracited by 18
- 2025GaussianFormer3D: Multi-Modal Gaussian-based Semantic Occupancy Prediction with 3D Deformable Attentioncited by 14
- 2024Offboard Occupancy Refinement with Hybrid Propagation for Autonomous Drivingcited by 12
- 2024HybridOcc: NeRF Enhanced Transformer-based Multi-Camera 3D Occupancy Predictioncited by 12
- 2024TALoS: Enhancing Semantic Scene Completion via Test-time Adaptation on the Line of Sightcited by 12
- 2022CasFusionNet: A Cascaded Network for Point Cloud Semantic Scene Completion by Dense Feature Fusioncited by 11
- 2021Semi-supervised Implicit Scene Completion from Sparse LiDARcited by 10
- 2024OccScene: Semantic Occupancy-based Cross-task Mutual Learning for 3D Scene Generationcited by 10
- 2021IMENet: Joint 3D Semantic Scene Completion and 2D Semantic Segmentation through Iterative Mutual Enhancementcited by 9
- 2021Data Augmented 3D Semantic Scene Completion with 2D Segmentation Priorscited by 9
- 2024Label-efficient Semantic Scene Completion with Scribble Annotationscited by 9
- 2024PanoSSC: Exploring Monocular Panoptic 3D Scene Reconstruction for Autonomous Drivingcited by 9
- 2025Skip Mamba Diffusion for Monocular 3D Semantic Scene Completioncited by 9
- 2025PointSea: Point Cloud Completion via Self-structure Augmentationcited by 9
- 20253D Occupancy Prediction with Low-Resolution Queries via Prototype-aware View Transformationcited by 9
- 2024Hierarchical Context Alignment with Disentangled Geometric and Temporal Modeling for Semantic Occupancy Predictioncited by 8
- 2023SSR-2D: Semantic 3D Scene Reconstruction from 2D Imagescited by 7
- 2024Boosting Self-Supervision for Single-View Scene Completion via Knowledge Distillationcited by 6
- 2025VLScene: Vision-Language Guidance Distillation for Camera-Based 3D Semantic Scene Completioncited by 6
- 2022DeepJoin: Learning a Joint Occupancy, Signed Distance, and Normal Field Function for Shape Repaircited by 5
50 most cited of 66 All 66 (JSON)
- 2026Semantic Occupancy Prediction with Dual Range-Voxel Representation30 Jun 2026
- 2026SelfOccFlow: Towards end-to-end self-supervised 3D Occupancy Flow prediction27 Feb 2026
- 2026Multi-Resolution Alignment for Voxel Sparsity in Camera-Based 3D Semantic Scene Completion3 Feb 2026
- 2025Towards Temporal Fusion Beyond the Field of View for Camera-based Semantic Scene Completion16 Nov 2025
- 2025RWKV-PCSSC: Exploring RWKV Model for Point Cloud Semantic Scene Completion13 Nov 2025
- 2025IPFormer: Visual 3D Panoptic Scene Completion with Context-Adaptive Instance Proposals25 Jun 2025
- 2025TACOcc:Target-Adaptive Cross-Modal Fusion with Volume Rendering for 3D Semantic Occupancy19 May 2025
- 2025GaussianFormer3D: Multi-Modal Gaussian-based Semantic Occupancy Prediction with 3D Deformable Attention15 May 2025
- 20253D Occupancy Prediction with Low-Resolution Queries via Prototype-aware View Transformation19 Mar 2025
- 2025Global-Aware Monocular Semantic Scene Completion with State Space Models9 Mar 2025
- 2025Vision-based 3D Semantic Scene Completion via Capture Dynamic Representations8 Mar 2025
- 2025VLScene: Vision-Language Guidance Distillation for Camera-Based 3D Semantic Scene Completion8 Mar 2025
38 more
- 2025PointSea: Point Cloud Completion via Self-structure Augmentation24 Feb 2025
- 2025Learning Temporal 3D Semantic Scene Completion via Optical Flow Guidance20 Feb 2025
- 2025Skip Mamba Diffusion for Monocular 3D Semantic Scene Completion13 Jan 2025
- 2024OccScene: Semantic Occupancy-based Cross-task Mutual Learning for 3D Scene Generation15 Dec 2024
- 2024Hierarchical Context Alignment with Disentangled Geometric and Temporal Modeling for Semantic Occupancy Prediction11 Dec 2024
- 2024Deep Learning for 3D Point Cloud Enhancement: A Survey30 Oct 2024
- 2024TALoS: Enhancing Semantic Scene Completion via Test-time Adaptation on the Line of Sight21 Oct 2024
- 2024HybridOcc: NeRF Enhanced Transformer-based Multi-Camera 3D Occupancy Prediction17 Aug 2024
- 2024LiCROcc: Teach Radar for Accurate Semantic Occupancy Prediction using LiDAR and Camera23 Jul 2024
- 2024Local Occupancy-Enhanced Object Grasping with Multiple Triplanar Projection22 Jul 2024
- 2024Monocular Occupancy Prediction for Scalable Indoor Scenes16 Jul 2024
- 2024Occupancy as Set of Points4 Jul 2024
- 2024Hierarchical Temporal Context Learning for Camera-based Semantic Scene Completion2 Jul 2024
- 2024PanoSSC: Exploring Monocular Panoptic 3D Scene Reconstruction for Autonomous Driving11 Jun 2024
- 2024Label-efficient Semantic Scene Completion with Scribble Annotations24 May 2024
- 2024RadarOcc: Robust 3D Occupancy Prediction with 4D Imaging Radar22 May 2024
- 2024Context and Geometry Aware Voxel Transformer for Semantic Scene Completion22 May 2024
- 2024Boosting Self-Supervision for Single-View Scene Completion via Knowledge Distillation11 Apr 2024
- 2024Co-Occ: Coupling Explicit Feature Fusion with Volume Rendering Regularization for Multi-Modal 3D Semantic Occupancy Prediction6 Apr 2024
- 2024Volumetric Environment Representation for Vision-Language Navigation21 Mar 2024
- 2024Offboard Occupancy Refinement with Hybrid Propagation for Autonomous Driving13 Mar 2024
- 2023Camera-based 3D Semantic Scene Completion with Sparse Guidance Network10 Dec 2023
- 2023PaSCo: Urban 3D Panoptic Scene Completion with Uncertainty Awareness4 Dec 2023
- 2023DepthSSC: Monocular 3D Semantic Scene Completion via Depth-Spatial Alignment and Voxel Adaptation28 Nov 2023
- 2023SelfOcc: Self-Supervised Vision-Based 3D Occupancy Prediction21 Nov 2023
- 2023S4C: Self-Supervised Semantic Scene Completion with Neural Fields11 Oct 2023
- 2023NDC-Scene: Boost Monocular 3D Semantic Scene Completion in Normalized Device Coordinates Space26 Sep 2023
- 2023CVSformer: Cross-View Synthesis Transformer for Semantic Scene Completion16 Jul 2023
- 2023SSC-RS: Elevate LiDAR Semantic Scene Completion with Representation Separation and BEV Fusion27 Jun 2023
- 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Prediction11 Apr 2023
- 2023SALUDA: Surface-based Automotive Lidar Unsupervised Domain Adaptation6 Apr 2023
- 2023Real-time 3D Semantic Scene Completion Via Feature Aggregation and Conditioned Prediction20 Mar 2023
- 2023SCPNet: Semantic Scene Completion on Point Cloud13 Mar 2023
- 2023OpenOccupancy: A Large Scale Benchmark for Surrounding Semantic Occupancy Perception7 Mar 2023
- 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completion23 Feb 2023
- 2023SSR-2D: Semantic 3D Scene Reconstruction from 2D Images7 Feb 2023
- 2023STEPS: Joint Self-supervised Nighttime Image Enhancement and Depth Estimation2 Feb 2023
- 2023AdaPoinTr: Diverse Point Cloud Completion with Adaptive Geometry-Aware Transformers11 Jan 2023
50 newest of 66 All 66 (JSON)
- 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 357
- 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 306
- 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 287
- 2023OpenOccupancy: A Large Scale Benchmark for Surrounding Semantic Occupancy Perceptioncited by 218
- 2023SelfOcc: Self-Supervised Vision-Based 3D Occupancy Predictioncited by 133
- 2023NDC-Scene: Boost Monocular 3D Semantic Scene Completion in Normalized Device Coordinates Spacecited by 88
- 2023SCPNet: Semantic Scene Completion on Point Cloudcited by 80
- 20213D Semantic Scene Completion: a Surveycited by 74
- 2022LargeKernel3D: Scaling up Kernels in 3D Sparse CNNscited by 71
- 2023AdaPoinTr: Diverse Point Cloud Completion with Adaptive Geometry-Aware Transformerscited by 65
- 2024Volumetric Environment Representation for Vision-Language Navigationcited by 63
- 2021Semantic Scene Completion via Integrating Instances and Scene in-the-Loopcited by 54
12 most cited of 62 All 62 (JSON)
- 2026Semantic Occupancy Prediction with Dual Range-Voxel Representation30 Jun 2026
- 2026SelfOccFlow: Towards end-to-end self-supervised 3D Occupancy Flow prediction27 Feb 2026
- 2026Multi-Resolution Alignment for Voxel Sparsity in Camera-Based 3D Semantic Scene Completion3 Feb 2026
- 2025Towards Temporal Fusion Beyond the Field of View for Camera-based Semantic Scene Completion16 Nov 2025
- 2025RWKV-PCSSC: Exploring RWKV Model for Point Cloud Semantic Scene Completion13 Nov 2025
- 2025IPFormer: Visual 3D Panoptic Scene Completion with Context-Adaptive Instance Proposals25 Jun 2025
- 2025TACOcc:Target-Adaptive Cross-Modal Fusion with Volume Rendering for 3D Semantic Occupancy19 May 2025
- 2025GaussianFormer3D: Multi-Modal Gaussian-based Semantic Occupancy Prediction with 3D Deformable Attention15 May 2025
- 20253D Occupancy Prediction with Low-Resolution Queries via Prototype-aware View Transformation19 Mar 2025
- 2025Vision-based 3D Semantic Scene Completion via Capture Dynamic Representations8 Mar 2025
- 2025VLScene: Vision-Language Guidance Distillation for Camera-Based 3D Semantic Scene Completion8 Mar 2025
- 2025PointSea: Point Cloud Completion via Self-structure Augmentation24 Feb 2025
12 newest of 62 All 62 (JSON)