mlsanityData to 7 Oct 2026

CurriFlow: Curriculum-Guided Depth Fusion with Optical Flow-Based Temporal Alignment for 3D Semantic Scene Completion

arXiv 2510.12362 ↗First posted 14 Oct 2025cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Semantic Scene Completion (SSC) aims to infer complete 3D geometry and semantics from monocular images, serving as a crucial capability for camera-based perception in autonomous driving. However, existing SSC methods relying on temporal stacking or depth projection often lack explicit motion reasoning and struggle with occlusions and noisy depth supervision. We propose CurriFlow, a novel semantic occupancy prediction framework that integrates optical flow-based temporal alignment with curriculum-guided depth fusion. CurriFlow employs a multi-level fusion strategy to align segmentation, visual, and depth features across frames using pre-trained optical flow, thereby improving temporal consistency and dynamic object understanding. To enhance geometric robustness, a curriculum learning mechanism progressively transitions from sparse yet accurate LiDAR depth to dense but noisy stereo depth during training, ensuring stable optimization and seamless adaptation to real-world deployment. Furthermore, semantic priors from the Segment Anything Model (SAM) provide category-agnostic supervision, strengthening voxel-level semantic learning and spatial consistency. Experiments on the SemanticKITTI benchmark demonstrate that CurriFlow achieves state-of-the-art performance with a mean IoU of 16.9, validating the effectiveness of our motion-guided and curriculum-aware design for camera-based 3D semantic scene completion.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 36 of its 45 references that are in the map. First posted on arXiv 14 Oct 2025.

Builds on

36 of 45 references.

References · 36

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  3. 2023Segment Anythingcited by 8,158
  4. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  5. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  6. 2017Squeeze-and-Excitation Networkscited by 4,763
  7. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  8. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  9. 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,054
  10. 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
  11. 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 966
  12. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 914
24 more
  1. 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 780
  2. 2016Semantic Scene Completion from a Single Depth Imagecited by 468
  3. 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 404
  4. 2023Segment Anything in High Qualitycited by 373
  5. 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 357
  6. 2022BEVFusion: A Simple and Robust LiDAR-Camera Fusion Frameworkcited by 334
  7. 2016Convolutional Pose Machinescited by 325
  8. 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 325
  9. 2021GMFlow: Learning Optical Flow via Global Matchingcited by 324
  10. 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 306
  11. 2022Vision Transformer with Deformable Attentioncited by 293
  12. 2022FlowFormer: A Transformer Architecture for Optical Flowcited by 273
  13. 2022Neighborhood Attention Transformercited by 235
  14. 2020LMSCNet: Lightweight Multiscale 3D Semantic Completioncited by 187
  15. 2017Flow-Guided Feature Aggregation for Video Object Detectioncited by 177
  16. 2023CompletionFormer: Depth Completion with Convolutions and Vision Transformerscited by 92
  17. 2023OccDepth: A Depth-Aware Method for 3D Semantic Scene Completioncited by 85
  18. 2021MobileStereoNet: Towards Lightweight Deep Networks for Stereo Matchingcited by 82
  19. 2024Context and Geometry Aware Voxel Transformer for Semantic Scene Completioncited by 50
  20. 2024Not All Voxels Are Equal: Hardness-Aware Semantic Scene Completion with Self-Distillationcited by 43
  21. 2025Multimodal Fusion and Vision-Language Models: A Survey for Robot Visioncited by 37
  22. 2017SurfNet: Generating 3D shape surfaces using deep residual networkscited by 32
  23. 2025DPFlow: Adaptive Optical Flow Estimation with a Dual-Pyramid Frameworkcited by 30
  24. 2023UniOcc: Unifying Vision-Centric 3D Occupancy Prediction with Geometric and Semantic Renderingcited by 25

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.