mlsanityData to 7 Oct 2026

Learning Temporal 3D Semantic Scene Completion via Optical Flow Guidance

arXiv 2502.14520 ↗First posted 20 Feb 2025cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

3D Semantic Scene Completion (SSC) provides comprehensive scene geometry and semantics for autonomous driving perception, which is crucial for enabling accurate and reliable decision-making. However, existing SSC methods are limited to capturing sparse information from the current frame or naively stacking multi-frame temporal features, thereby failing to acquire effective scene context. These approaches ignore critical motion dynamics and struggle to achieve temporal consistency. To address the above challenges, we propose a novel temporal SSC method FlowScene: Learning Temporal 3D Semantic Scene Completion via Optical Flow Guidance. By leveraging optical flow, FlowScene can integrate motion, different viewpoints, occlusions, and other contextual cues, thereby significantly improving the accuracy of 3D scene completion. Specifically, our framework introduces two key components: (1) a Flow-Guided Temporal Aggregation module that aligns and aggregates temporal features using optical flow, capturing motion-aware context and deformable structures; and (2) an Occlusion-Guided Voxel Refinement module that injects occlusion masks and temporally aggregated features into 3D voxel space, adaptively refining voxel representations for explicit geometric modeling. Experimental results demonstrate that FlowScene achieves state-of-the-art performance on the SemanticKITTI and SSCBench-KITTI-360 benchmarks.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 40 of its 49 references that are in the map. First posted on arXiv 20 Feb 2025.

Builds on

40 of 49 references.

References · 40

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  3. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  4. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  5. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  6. 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,054
  7. 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,040
  8. 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 966
  9. 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 780
  10. 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 570
  11. 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 568
  12. 2016Semantic Scene Completion from a Single Depth Imagecited by 468
28 more
  1. 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 404
  2. 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 357
  3. 2021GMFlow: Learning Optical Flow via Global Matchingcited by 324
  4. 2023SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous Drivingcited by 310
  5. 2023VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completioncited by 306
  6. 2023OccFormer: Dual-path Transformer for Vision-based 3D Semantic Occupancy Predictioncited by 287
  7. 2022FlowFormer: A Transformer Architecture for Optical Flowcited by 273
  8. 2022Neighborhood Attention Transformercited by 235
  9. 2020Sparse Single Sweep LiDAR Point Cloud Segmentation via Learning Contextual Shape Priors from Scene Completioncited by 222
  10. 2017UnFlow: Unsupervised Learning of Optical Flow with a Bidirectional Census Losscited by 202
  11. 2020LMSCNet: Lightweight Multiscale 3D Semantic Completioncited by 187
  12. 2017Flow-Guided Feature Aggregation for Video Object Detectioncited by 177
  13. 2020Anisotropic Convolutional Networks for 3D Semantic Scene Completioncited by 126
  14. 2023Symphonize 3D Semantic Scene Completion with Contextual Instance Queriescited by 88
  15. 2023NDC-Scene: Boost Monocular 3D Semantic Scene Completion in Normalized Device Coordinates Spacecited by 88
  16. 2020Semantic Scene Completion using Local Deep Implicit Functions on LiDAR Datacited by 74
  17. 2019Efficient Semantic Scene Completion Network with Spatial Group Convolutioncited by 66
  18. 2017Cosine Normalization: Using Cosine Similarity Instead of Dot Product in Neural Networkscited by 58
  19. 2024Context and Geometry Aware Voxel Transformer for Semantic Scene Completioncited by 50
  20. 2024MonoOcc: Digging into Monocular Semantic Occupancy Predictioncited by 43
  21. 2024Not All Voxels Are Equal: Hardness-Aware Semantic Scene Completion with Self-Distillationcited by 43
  22. 2023Camera-based 3D Semantic Scene Completion with Sparse Guidance Networkcited by 40
  23. 2024Hierarchical Temporal Context Learning for Camera-based Semantic Scene Completioncited by 32
  24. 2018View-volume Network for Semantic Scene Completion from a Single Depth Imagecited by 26
  25. 2023LoSh: Long-Short Text Joint Prediction Network for Referring Video Object Segmentationcited by 23
  26. 2017End-to-end Flow Correlation Tracking with Spatial-temporal Attentioncited by 21
  27. 2024Optical Flow Based Detection and Tracking of Moving Objects for Autonomous Vehiclescited by 6
  28. 2024DeVOS: Flow-Guided Deformable Transformer for Video Object Segmentationcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.