DepthSSC: Monocular 3D Semantic Scene Completion via Depth-Spatial Alignment and Voxel Adaptation
Not on the map. Why?
Abstract (arXiv)
The task of 3D semantic scene completion using monocular cameras is gaining significant attention in the field of autonomous driving. This task aims to predict the occupancy status and semantic labels of each voxel in a 3D scene from partial image inputs. Despite numerous existing methods, many face challenges such as inaccurately predicting object shapes and misclassifying object boundaries. To address these issues, we propose DepthSSC, an advanced method for semantic scene completion using only monocular cameras. DepthSSC integrates the Spatial Transformation Graph Fusion (ST-GF) module with Geometric-Aware Voxelization (GAV), enabling dynamic adjustment of voxel resolution to accommodate the geometric complexity of 3D space. This ensures precise alignment between spatial and depth information, effectively mitigating issues such as object boundary distortion and incorrect depth perception found in previous methods. Evaluations on the SemanticKITTI and SSCBench-KITTI-360 dataset demonstrate that DepthSSC not only captures intricate 3D structural details effectively but also achieves state-of-the-art performance.
Key facts. Cited by 32 papers in the map (data through 14 Oct 2026). Builds on 36 of its 46 references that are in the map. First posted on arXiv 28 Nov 2023.
Builds on
36 of 46 references.
References · 36
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
- 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,218
- 2020Simple and Deep Graph Convolutional Networkscited by 860
- 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 713
- 2020AdaBins: Depth Estimation using Adaptive Binscited by 601
- 2016Semantic Scene Completion from a Single Depth Imagecited by 472
- 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 409
- 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 363
- 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 332
- 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 316
24 more
- 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 313
- 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 293
- 2020Sparse Single Sweep LiDAR Point Cloud Segmentation via Learning Contextual Shape Priors from Scene Completioncited by 223
- 2020Non-Local Spatial Propagation Network for Depth Completioncited by 195
- 2020LMSCNet: Lightweight Multiscale 3D Semantic Completioncited by 188
- 2020Anisotropic Convolutional Networks for 3D Semantic Scene Completioncited by 127
- 2020S3CNet: A Sparse Semantic Scene Completion Network for LiDAR Point Cloudscited by 102
- 2023Symphonize 3D Semantic Scene Completion with Contextual Instance Queriescited by 90
- 2023NDC-Scene: Boost Monocular 3D Semantic Scene Completion in Normalized Device Coordinates Spacecited by 90
- 2023OccDepth: A Depth-Aware Method for 3D Semantic Scene Completioncited by 86
- 2023SCPNet: Semantic Scene Completion on Point Cloudcited by 80
- 2023SSCBench: A Large-Scale 3D Semantic Scene Completion Benchmark for Autonomous Drivingcited by 75
- 2020Semantic Scene Completion using Local Deep Implicit Functions on LiDAR Datacited by 74
- 2020Fast and Robust Iterative Closest Pointcited by 67
- 2019Efficient Semantic Scene Completion Network with Spatial Group Convolutioncited by 66
- 2019RGBD Based Dimensional Decomposition Residual Network for 3D Semantic Scene Completioncited by 55
- 2018Two Stream 3D Semantic Scene Completioncited by 48
- 2019Cascaded Context Pyramid for Full-Resolution 3D Semantic Scene Completioncited by 43
- 2020Depth Based Semantic Scene Completion with Position Importance Aware Losscited by 37
- 2019ForkNet: Multi-branch Volumetric Semantic Completion from a Single Depth Imagecited by 32
- 2023LODE: Locally Conditioned Eikonal Implicit Scene Completion from Sparse LiDARcited by 31
- 2022Cross-Modal Learning with 3D Deformable Attention for Action Recognitioncited by 20
- 2023DebSDF: Delving into the Details and Bias of Neural Indoor Scene Reconstructioncited by 17
- 2021VMNet: Voxel-Mesh Network for Geodesic-Aware 3D Semantic Segmentationcited by 2
Built on by
Citing papers per year: 2023: 3; 2024: 3; 2025: 15; 2026: 11.
32 papers.
Sort:
By area:
- 2025Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Viewscited by 65
- 2023Camera-based 3D Semantic Scene Completion with Sparse Guidance Networkcited by 40
- 2024A Survey on Occupancy Perception for Autonomous Driving: The Information Fusion Perspectivecited by 37
- 2024DrivingRecon: Large 4D Gaussian Reconstruction Model For Autonomous Drivingcited by 29
- 2025MonoFusion: Sparse-View 4D Reconstruction via Monocular Fusioncited by 19
- 2025Top-Down Semantic Refinement for Image Captioningcited by 16
- 2023Building Lane-Level Maps from Aerial Imagescited by 13
- 2024Offboard Occupancy Refinement with Hybrid Propagation for Autonomous Drivingcited by 12
- 2025FlashVLM: Text-Guided Visual Token Selection for Large Multimodal Modelscited by 11
- 2025Does Bigger Mean Better? Comparitive Analysis of CNNs and Biomedical Vision Language Modles in Medical Diagnosiscited by 9
- 2025STORM: Search-Guided Generative World Models for Robotic Manipulationcited by 7
- 2025Rainbow Noise: Stress-Testing Multimodal Harmful-Meme Detectors on LGBTQ Contentcited by 6
20 more
- 2023DAP: Domain-aware Prompt Learning for Vision-and-Language Navigationcited by 4
- 2025CoAgent: Collaborative Planning and Consistency Agent for Coherent Video Generationcited by 4
- 2025Enhancing 3D Semantic Scene Completion with a Refinement Modulecited by 3
- 2026FlowSSC: Universal Generative Monocular Semantic Scene Completion via One-Step Latent Diffusioncited by 2
- 2026AgriWorld:A World Tools Protocol Framework for Verifiable Agricultural Reasoning with Code-Executing LLM Agentscited by 2
- 2025MoE-DiffuSeq: Enhancing Long-Document Diffusion Models with Sparse Attention and Mixture of Expertscited by 1
- 2025HD2-SSC: High-Dimension High-Density Semantic Scene Completion for Autonomous Drivingcited by 0
- 2025A Three-Level Alignment Framework for Large-Scale 3D Retrieval and Controlled 4D Generationcited by 0
- 2025Learning Dynamic Scene Reconstruction with Sinusoidal Geometric Priorscited by 0
- 2025Towards Efficient Post-Training via Fourier-Driven Adapter Architecturescited by 0
- 2025Self-Rewarded Multimodal Coherent Reasoning Across Diverse Visual Domainscited by 0
- 2026Multi-Agent Cooperative Learning for Robust Vision-Language Alignment under OOD Conceptscited by 0
- 2026Bridging the Semantic Chasm: Synergistic Conceptual Anchoring for Generalized Few-Shot and Zero-Shot OOD Perceptioncited by 0
- 2026Multi-Resolution Alignment for Voxel Sparsity in Camera-Based 3D Semantic Scene Completioncited by 0
- 2026A Scalable Curiosity-Driven Game-Theoretic Framework for Long-Tail Multi-Label Learning in Data Miningcited by 0
- 2026CloudDiffusion: Diffusion-Based Scene Completion in the Point Cloud Domaincited by 0
- 2026RayLift: Lifting Complementary Ray-Wise Evidence with 3D Geometry Priors for Semantic Scene Completioncited by 0
- 2026SSC-Priors: Exploring Semantic and Visibility Priors to Boost Lidar Semantic Scene Completioncited by 0
- 2026CrowdOcc: Monocular Semantic Scene Completion for Quadruped Robots in Crowded Indoor Environmentscited by 0
- 2026CacheScope: Exact-Compute Allocation for Training-Free Diffusion Accelerationcited by 0
- 2026CacheScope: Exact-Compute Allocation for Training-Free Diffusion Acceleration8 Oct 2026
- 2026CrowdOcc: Monocular Semantic Scene Completion for Quadruped Robots in Crowded Indoor Environments2 Oct 2026
- 2026SSC-Priors: Exploring Semantic and Visibility Priors to Boost Lidar Semantic Scene Completion15 Sep 2026
- 2026RayLift: Lifting Complementary Ray-Wise Evidence with 3D Geometry Priors for Semantic Scene Completion9 Aug 2026
- 2026CloudDiffusion: Diffusion-Based Scene Completion in the Point Cloud Domain14 Jun 2026
- 2026A Scalable Curiosity-Driven Game-Theoretic Framework for Long-Tail Multi-Label Learning in Data Mining17 Feb 2026
- 2026AgriWorld:A World Tools Protocol Framework for Verifiable Agricultural Reasoning with Code-Executing LLM Agents17 Feb 2026
- 2026Multi-Resolution Alignment for Voxel Sparsity in Camera-Based 3D Semantic Scene Completion3 Feb 2026
- 2026Bridging the Semantic Chasm: Synergistic Conceptual Anchoring for Generalized Few-Shot and Zero-Shot OOD Perception30 Jan 2026
- 2026FlowSSC: Universal Generative Monocular Semantic Scene Completion via One-Step Latent Diffusion21 Jan 2026
- 2026Multi-Agent Cooperative Learning for Robust Vision-Language Alignment under OOD Concepts11 Jan 2026
- 2025Self-Rewarded Multimodal Coherent Reasoning Across Diverse Visual Domains27 Dec 2025
20 more
- 2025CoAgent: Collaborative Planning and Consistency Agent for Coherent Video Generation27 Dec 2025
- 2025Towards Efficient Post-Training via Fourier-Driven Adapter Architectures26 Dec 2025
- 2025Learning Dynamic Scene Reconstruction with Sinusoidal Geometric Priors25 Dec 2025
- 2025A Three-Level Alignment Framework for Large-Scale 3D Retrieval and Controlled 4D Generation25 Dec 2025
- 2025MoE-DiffuSeq: Enhancing Long-Document Diffusion Models with Sparse Attention and Mixture of Experts23 Dec 2025
- 2025FlashVLM: Text-Guided Visual Token Selection for Large Multimodal Models23 Dec 2025
- 2025STORM: Search-Guided Generative World Models for Robotic Manipulation20 Dec 2025
- 2025Enhancing 3D Semantic Scene Completion with a Refinement Module20 Dec 2025
- 2025HD2-SSC: High-Dimension High-Density Semantic Scene Completion for Autonomous Driving11 Nov 2025
- 2025Top-Down Semantic Refinement for Image Captioning25 Oct 2025
- 2025Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Views21 Oct 2025
- 2025Does Bigger Mean Better? Comparitive Analysis of CNNs and Biomedical Vision Language Modles in Medical Diagnosis1 Oct 2025
- 2025MonoFusion: Sparse-View 4D Reconstruction via Monocular Fusion31 Jul 2025
- 2025Rainbow Noise: Stress-Testing Multimodal Harmful-Meme Detectors on LGBTQ Content24 Jul 2025
- 2024DrivingRecon: Large 4D Gaussian Reconstruction Model For Autonomous Driving12 Dec 2024
- 2024A Survey on Occupancy Perception for Autonomous Driving: The Information Fusion Perspective8 May 2024
- 2024Offboard Occupancy Refinement with Hybrid Propagation for Autonomous Driving13 Mar 2024
- 2023Building Lane-Level Maps from Aerial Images20 Dec 2023
- 2023Camera-based 3D Semantic Scene Completion with Sparse Guidance Network10 Dec 2023
- 2023DAP: Domain-aware Prompt Learning for Vision-and-Language Navigation29 Nov 2023
- 2026FlowSSC: Universal Generative Monocular Semantic Scene Completion via One-Step Latent Diffusioncited by 2
- 2025MoE-DiffuSeq: Enhancing Long-Document Diffusion Models with Sparse Attention and Mixture of Expertscited by 1
- 2026CacheScope: Exact-Compute Allocation for Training-Free Diffusion Accelerationcited by 0
- 2026CacheScope: Exact-Compute Allocation for Training-Free Diffusion Acceleration8 Oct 2026
- 2026FlowSSC: Universal Generative Monocular Semantic Scene Completion via One-Step Latent Diffusion21 Jan 2026
- 2025MoE-DiffuSeq: Enhancing Long-Document Diffusion Models with Sparse Attention and Mixture of Experts23 Dec 2025
- 2025Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Viewscited by 65
- 2026AgriWorld:A World Tools Protocol Framework for Verifiable Agricultural Reasoning with Code-Executing LLM Agentscited by 2
- 2025Self-Rewarded Multimodal Coherent Reasoning Across Diverse Visual Domainscited by 0
- 2026AgriWorld:A World Tools Protocol Framework for Verifiable Agricultural Reasoning with Code-Executing LLM Agents17 Feb 2026
- 2025Self-Rewarded Multimodal Coherent Reasoning Across Diverse Visual Domains27 Dec 2025
- 2025Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Views21 Oct 2025
- 2023Camera-based 3D Semantic Scene Completion with Sparse Guidance Networkcited by 40
- 2024A Survey on Occupancy Perception for Autonomous Driving: The Information Fusion Perspectivecited by 37
- 2025MonoFusion: Sparse-View 4D Reconstruction via Monocular Fusioncited by 19
- 2023Building Lane-Level Maps from Aerial Imagescited by 13
- 2024Offboard Occupancy Refinement with Hybrid Propagation for Autonomous Drivingcited by 12
- 2025Does Bigger Mean Better? Comparitive Analysis of CNNs and Biomedical Vision Language Modles in Medical Diagnosiscited by 9
- 2025Rainbow Noise: Stress-Testing Multimodal Harmful-Meme Detectors on LGBTQ Contentcited by 6
- 2023DAP: Domain-aware Prompt Learning for Vision-and-Language Navigationcited by 4
- 2025CoAgent: Collaborative Planning and Consistency Agent for Coherent Video Generationcited by 4
- 2025Enhancing 3D Semantic Scene Completion with a Refinement Modulecited by 3
- 2025A Three-Level Alignment Framework for Large-Scale 3D Retrieval and Controlled 4D Generationcited by 0
- 2025Learning Dynamic Scene Reconstruction with Sinusoidal Geometric Priorscited by 0
12 most cited of 18 All 18 (JSON)
- 2026CrowdOcc: Monocular Semantic Scene Completion for Quadruped Robots in Crowded Indoor Environments2 Oct 2026
- 2026SSC-Priors: Exploring Semantic and Visibility Priors to Boost Lidar Semantic Scene Completion15 Sep 2026
- 2026RayLift: Lifting Complementary Ray-Wise Evidence with 3D Geometry Priors for Semantic Scene Completion9 Aug 2026
- 2026A Scalable Curiosity-Driven Game-Theoretic Framework for Long-Tail Multi-Label Learning in Data Mining17 Feb 2026
- 2026Multi-Resolution Alignment for Voxel Sparsity in Camera-Based 3D Semantic Scene Completion3 Feb 2026
- 2025CoAgent: Collaborative Planning and Consistency Agent for Coherent Video Generation27 Dec 2025
- 2025Towards Efficient Post-Training via Fourier-Driven Adapter Architectures26 Dec 2025
- 2025Learning Dynamic Scene Reconstruction with Sinusoidal Geometric Priors25 Dec 2025
- 2025A Three-Level Alignment Framework for Large-Scale 3D Retrieval and Controlled 4D Generation25 Dec 2025
- 2025Enhancing 3D Semantic Scene Completion with a Refinement Module20 Dec 2025
- 2025Does Bigger Mean Better? Comparitive Analysis of CNNs and Biomedical Vision Language Modles in Medical Diagnosis1 Oct 2025
- 2025MonoFusion: Sparse-View 4D Reconstruction via Monocular Fusion31 Jul 2025
12 newest of 18 All 18 (JSON)