Towards Temporal Fusion Beyond the Field of View for Camera-based Semantic Scene Completion
Not on the map. Why?
Abstract (arXiv)
Recent camera-based 3D semantic scene completion (SSC) methods have increasingly explored leveraging temporal cues to enrich the features of the current frame. However, while these approaches primarily focus on enhancing in-frame regions, they often struggle to reconstruct critical out-of-frame areas near the sides of the ego-vehicle, although previous frames commonly contain valuable contextual information about these unseen regions. To address this limitation, we propose the Current-Centric Contextual 3D Fusion (C3DFusion) module, which generates hidden region-aware 3D feature geometry by explicitly aligning 3D-lifted point features from both current and historical frames. C3DFusion performs enhanced temporal fusion through two complementary techniques-historical context blurring and current-centric feature densification-which suppress noise from inaccurately warped historical point features by attenuating their scale, and enhance current point features by increasing their volumetric contribution. Simply integrated into standard SSC architectures, C3DFusion demonstrates strong effectiveness, significantly outperforming state-of-the-art methods on the SemanticKITTI and SSCBench-KITTI-360 datasets. Furthermore, it exhibits robust generalization, achieving notable performance gains when applied to other baseline models.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 40 of its 47 references that are in the map. First posted on arXiv 16 Nov 2025.
Builds on
40 of 47 references.
References · 40
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
- 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 713
- 2016Semantic Scene Completion from a Single Depth Imagecited by 472
- 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 409
- 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 363
- 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 332
28 more
- 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 313
- 2022BEVFormer v2: Adapting Modern Image Backbones to Bird's-Eye-View Recognition via Perspective Supervisioncited by 302
- 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 293
- 2020Sparse Single Sweep LiDAR Point Cloud Segmentation via Learning Contextual Shape Priors from Scene Completioncited by 223
- 2020LMSCNet: Lightweight Multiscale 3D Semantic Completioncited by 188
- 2020On the uncertainty of self-supervised monocular depth estimationcited by 182
- 2023FB-OCC: 3D Occupancy Prediction based on Forward-Backward View Transformationcited by 165
- 2020Anisotropic Convolutional Networks for 3D Semantic Scene Completioncited by 127
- 20203D Sketch-aware Semantic Scene Completion via Semi-supervised Structure Priorcited by 126
- 2023PanoOcc: Unified Occupancy Representation for Camera-based 3D Panoptic Segmentationcited by 115
- 2020S3CNet: A Sparse Semantic Scene Completion Network for LiDAR Point Cloudscited by 102
- 2023COTR: Compact Occupancy TRansformer for Vision-based 3D Occupancy Predictioncited by 96
- 2023Symphonize 3D Semantic Scene Completion with Contextual Instance Queriescited by 90
- 2023OccDepth: A Depth-Aware Method for 3D Semantic Scene Completioncited by 86
- 2021MobileStereoNet: Towards Lightweight Deep Networks for Stereo Matchingcited by 82
- 2023SCPNet: Semantic Scene Completion on Point Cloudcited by 80
- 2023SSCBench: A Large-Scale 3D Semantic Scene Completion Benchmark for Autonomous Drivingcited by 75
- 2019Efficient Semantic Scene Completion Network with Spatial Group Convolutioncited by 66
- 2024Context and Geometry Aware Voxel Transformer for Semantic Scene Completioncited by 50
- 2023Camera-based 3D Semantic Scene Completion with Sparse Guidance Networkcited by 40
- 2021Semantic Segmentation-assisted Scene Completion for LiDAR Point Cloudscited by 37
- 2024Hierarchical Temporal Context Learning for Camera-based Semantic Scene Completioncited by 32
- 2024CVT-Occ: Cost Volume Temporal Fusion for 3D Occupancy Predictioncited by 24
- 2024ProtoOcc: Accurate, Efficient 3D Occupancy Prediction Using Dual Branch Encoder-Prototype Query Decodercited by 17
- 2023Regulating Intermediate 3D Features for Vision-Centric Autonomous Drivingcited by 12
- 2024Hierarchical Context Alignment with Disentangled Geometric and Temporal Modeling for Semantic Occupancy Predictioncited by 8
- 2025Learning Temporal 3D Semantic Scene Completion via Optical Flow Guidancecited by 3
- 2025One Step Closer: Creating the Future to Boost Monocular Semantic Scene Completioncited by 3
Built on by
Not cited yet.