One Step Closer: Creating the Future to Boost Monocular Semantic Scene Completion
Not on the map. Why?
Abstract (arXiv)
In recent years, visual 3D Semantic Scene Completion (SSC) has emerged as a critical perception task for autonomous driving due to its ability to infer complete 3D scene layouts and semantics from single 2D images. However, in real-world traffic scenarios, a significant portion of the scene remains occluded or outside the camera's field of view -- a fundamental challenge that existing monocular SSC methods fail to address adequately. To overcome these limitations, we propose Creating the Future SSC (CF-SSC), a novel temporal SSC framework that leverages pseudo-future frame prediction to expand the model's effective perceptual range. Our approach combines poses and depths to establish accurate 3D correspondences, enabling geometrically-consistent fusion of past, present, and predicted future frames in 3D space. Unlike conventional methods that rely on simple feature stacking, our 3D-aware architecture achieves more robust scene completion by explicitly modeling spatial-temporal relationships. Comprehensive experiments on SemanticKITTI and SSCBench-KITTI-360 benchmarks demonstrate state-of-the-art performance, validating the effectiveness of our approach, highlighting our method's ability to improve occlusion reasoning and 3D scene completion accuracy.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 34 of its 41 references that are in the map. First posted on arXiv 18 Jul 2025.
Builds on
34 of 41 references.
References · 34
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
- 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 570
- 2016Semantic Scene Completion from a Single Depth Imagecited by 468
- 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 404
- 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 357
- 2022Mask DINO: Towards A Unified Transformer-based Framework for Object Detection and Segmentationcited by 341
- 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 310
22 more
- 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 306
- 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 287
- 2020Sparse Single Sweep LiDAR Point Cloud Segmentation via Learning Contextual Shape Priors from Scene Completioncited by 222
- 2020LMSCNet: Lightweight Multiscale 3D Semantic Completioncited by 187
- 2017DeepVO: Towards End-to-End Visual Odometry with Deep Recurrent Convolutional Neural Networkscited by 173
- 2020Anisotropic Convolutional Networks for 3D Semantic Scene Completioncited by 126
- 2021Video Frame Interpolation Transformercited by 122
- 2020Stochastic Latent Residual Video Predictioncited by 106
- 2020S3CNet: A Sparse Semantic Scene Completion Network for LiDAR Point Cloudscited by 102
- 2023Symphonize 3D Semantic Scene Completion with Contextual Instance Queriescited by 88
- 2023NDC-Scene: Boost Monocular 3D Semantic Scene Completion in Normalized Device Coordinates Spacecited by 88
- 2021Greedy Hierarchical Variational Autoencoders for Large-Scale Video Predictioncited by 75
- 2023SSCBench: A Large-Scale 3D Semantic Scene Completion Benchmark for Autonomous Drivingcited by 72
- 2023A Dynamic Multi-Scale Voxel Flow Network for Video Predictioncited by 53
- 2024MonoOcc: Digging into Monocular Semantic Occupancy Predictioncited by 43
- 2024Not All Voxels Are Equal: Hardness-Aware Semantic Scene Completion with Self-Distillationcited by 43
- 2024Hierarchical Temporal Context Learning for Camera-based Semantic Scene Completioncited by 32
- 2022Optimizing Video Prediction via Video Frame Interpolationcited by 28
- 2023BiFormer: Learning Bilateral Motion Estimation via Bilateral Transformer for 4K Video Frame Interpolationcited by 23
- 2024CVT-Occ: Cost Volume Temporal Fusion for 3D Occupancy Predictioncited by 23
- 2023Bridging Stereo Geometry and BEV Representation with Reliable Mutual Interaction for Semantic Scene Completioncited by 21
- 2022MSPred: Video Prediction at Multiple Spatio-Temporal Scales with Hierarchical Recurrent Networkscited by 12
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.