CurriFlow: Curriculum-Guided Depth Fusion with Optical Flow-Based Temporal Alignment for 3D Semantic Scene Completion
Not on the map. Why?
Abstract (arXiv)
Semantic Scene Completion (SSC) aims to infer complete 3D geometry and semantics from monocular images, serving as a crucial capability for camera-based perception in autonomous driving. However, existing SSC methods relying on temporal stacking or depth projection often lack explicit motion reasoning and struggle with occlusions and noisy depth supervision. We propose CurriFlow, a novel semantic occupancy prediction framework that integrates optical flow-based temporal alignment with curriculum-guided depth fusion. CurriFlow employs a multi-level fusion strategy to align segmentation, visual, and depth features across frames using pre-trained optical flow, thereby improving temporal consistency and dynamic object understanding. To enhance geometric robustness, a curriculum learning mechanism progressively transitions from sparse yet accurate LiDAR depth to dense but noisy stereo depth during training, ensuring stable optimization and seamless adaptation to real-world deployment. Furthermore, semantic priors from the Segment Anything Model (SAM) provide category-agnostic supervision, strengthening voxel-level semantic learning and spatial consistency. Experiments on the SemanticKITTI benchmark demonstrate that CurriFlow achieves state-of-the-art performance with a mean IoU of 16.9, validating the effectiveness of our motion-guided and curriculum-aware design for camera-based 3D semantic scene completion.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 36 of its 45 references that are in the map. First posted on arXiv 14 Oct 2025.
Builds on
36 of 45 references.
References · 36
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2023Segment Anythingcited by 8,158
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2017Squeeze-and-Excitation Networkscited by 4,763
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,054
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
- 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 966
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 914
24 more
- 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 780
- 2016Semantic Scene Completion from a Single Depth Imagecited by 468
- 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 404
- 2023Segment Anything in High Qualitycited by 373
- 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 357
- 2022BEVFusion: A Simple and Robust LiDAR-Camera Fusion Frameworkcited by 334
- 2016Convolutional Pose Machinescited by 325
- 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 325
- 2021GMFlow: Learning Optical Flow via Global Matchingcited by 324
- 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 306
- 2022Vision Transformer with Deformable Attentioncited by 293
- 2022FlowFormer: A Transformer Architecture for Optical Flowcited by 273
- 2022Neighborhood Attention Transformercited by 235
- 2020LMSCNet: Lightweight Multiscale 3D Semantic Completioncited by 187
- 2017Flow-Guided Feature Aggregation for Video Object Detectioncited by 177
- 2023CompletionFormer: Depth Completion with Convolutions and Vision Transformerscited by 92
- 2023OccDepth: A Depth-Aware Method for 3D Semantic Scene Completioncited by 85
- 2021MobileStereoNet: Towards Lightweight Deep Networks for Stereo Matchingcited by 82
- 2024Context and Geometry Aware Voxel Transformer for Semantic Scene Completioncited by 50
- 2024Not All Voxels Are Equal: Hardness-Aware Semantic Scene Completion with Self-Distillationcited by 43
- 2025Multimodal Fusion and Vision-Language Models: A Survey for Robot Visioncited by 37
- 2017SurfNet: Generating 3D shape surfaces using deep residual networkscited by 32
- 2025DPFlow: Adaptive Optical Flow Estimation with a Dual-Pyramid Frameworkcited by 30
- 2023UniOcc: Unifying Vision-Centric 3D Occupancy Prediction with Geometric and Semantic Renderingcited by 25
Built on by
Citing papers per year: 2025: 1.
1 paper.