mlsanityData to 7 Oct 2026

One Step Closer: Creating the Future to Boost Monocular Semantic Scene Completion

arXiv 2507.13801 ↗First posted 18 Jul 2025cs.CV cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

In recent years, visual 3D Semantic Scene Completion (SSC) has emerged as a critical perception task for autonomous driving due to its ability to infer complete 3D scene layouts and semantics from single 2D images. However, in real-world traffic scenarios, a significant portion of the scene remains occluded or outside the camera's field of view -- a fundamental challenge that existing monocular SSC methods fail to address adequately. To overcome these limitations, we propose Creating the Future SSC (CF-SSC), a novel temporal SSC framework that leverages pseudo-future frame prediction to expand the model's effective perceptual range. Our approach combines poses and depths to establish accurate 3D correspondences, enabling geometrically-consistent fusion of past, present, and predicted future frames in 3D space. Unlike conventional methods that rely on simple feature stacking, our 3D-aware architecture achieves more robust scene completion by explicitly modeling spatial-temporal relationships. Comprehensive experiments on SemanticKITTI and SSCBench-KITTI-360 benchmarks demonstrate state-of-the-art performance, validating the effectiveness of our approach, highlighting our method's ability to improve occlusion reasoning and 3D scene completion accuracy.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 34 of its 41 references that are in the map. First posted on arXiv 18 Jul 2025.

Builds on

34 of 41 references.

References · 34

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  5. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
  6. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  7. 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 570
  8. 2016Semantic Scene Completion from a Single Depth Imagecited by 468
  9. 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 404
  10. 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 357
  11. 2022Mask DINO: Towards A Unified Transformer-based Framework for Object Detection and Segmentationcited by 341
  12. 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 310
22 more
  1. 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 306
  2. 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 287
  3. 2020Sparse Single Sweep LiDAR Point Cloud Segmentation via Learning Contextual Shape Priors from Scene Completioncited by 222
  4. 2020LMSCNet: Lightweight Multiscale 3D Semantic Completioncited by 187
  5. 2017DeepVO: Towards End-to-End Visual Odometry with Deep Recurrent Convolutional Neural Networkscited by 173
  6. 2020Anisotropic Convolutional Networks for 3D Semantic Scene Completioncited by 126
  7. 2021Video Frame Interpolation Transformercited by 122
  8. 2020Stochastic Latent Residual Video Predictioncited by 106
  9. 2020S3CNet: A Sparse Semantic Scene Completion Network for LiDAR Point Cloudscited by 102
  10. 2023Symphonize 3D Semantic Scene Completion with Contextual Instance Queriescited by 88
  11. 2023NDC-Scene: Boost Monocular 3D Semantic Scene Completion in Normalized Device Coordinates Spacecited by 88
  12. 2021Greedy Hierarchical Variational Autoencoders for Large-Scale Video Predictioncited by 75
  13. 2023SSCBench: A Large-Scale 3D Semantic Scene Completion Benchmark for Autonomous Drivingcited by 72
  14. 2023A Dynamic Multi-Scale Voxel Flow Network for Video Predictioncited by 53
  15. 2024MonoOcc: Digging into Monocular Semantic Occupancy Predictioncited by 43
  16. 2024Not All Voxels Are Equal: Hardness-Aware Semantic Scene Completion with Self-Distillationcited by 43
  17. 2024Hierarchical Temporal Context Learning for Camera-based Semantic Scene Completioncited by 32
  18. 2022Optimizing Video Prediction via Video Frame Interpolationcited by 28
  19. 2023BiFormer: Learning Bilateral Motion Estimation via Bilateral Transformer for 4K Video Frame Interpolationcited by 23
  20. 2024CVT-Occ: Cost Volume Temporal Fusion for 3D Occupancy Predictioncited by 23
  21. 2023Bridging Stereo Geometry and BEV Representation with Reliable Mutual Interaction for Semantic Scene Completioncited by 21
  22. 2022MSPred: Video Prediction at Multiple Spatio-Temporal Scales with Hierarchical Recurrent Networkscited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.