mlsanityData to 7 Oct 2026

RAFT-MSF++: Temporal Geometry-Motion Feature Fusion for Self-Supervised Monocular Scene Flow

arXiv 2604.19349 ↗First posted 21 Apr 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Monocular scene flow estimation aims to recover dense 3D motion from image sequences, yet most existing methods are limited to two-frame inputs, restricting temporal modeling and robustness to occlusions. We propose RAFT-MSF++, a self-supervised multi-frame framework that recurrently fuses temporal features to jointly estimate depth and scene flow. Central to our approach is the Geometry-Motion Feature (GMF), which compactly encodes coupled motion and geometry cues and is iteratively updated for effective temporal reasoning. To ensure the robustness of this temporal fusion against occlusions, we incorporate relative positional attention to inject spatial priors and an occlusion regularization module to propagate reliable motion from visible regions. These components enable the GMF to effectively propagate information even in ambiguous areas. Extensive experiments show that RAFT-MSF++ achieves 24.14% SF-all on the KITTI Scene Flow benchmark, with a 30.99% improvement over the baseline and better robustness in occluded regions. The code is available at https://github.com/sunzunyi/RAFT-MSF-PlusPlus.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 47 references that are in the map. First posted on arXiv 21 Apr 2026.

Builds on

33 of 47 references.

References · 33

  1. 2023Segment Anythingcited by 8,158
  2. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  3. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
  4. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  5. 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 966
  6. 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
  7. 2018GeoNet: Unsupervised Learning of Dense Depth, Optical Flow and Camera Posecited by 341
  8. 2018FlowNet3D: Learning Scene Flow in 3D Point Cloudscited by 241
  9. 2021Learning to Estimate Hidden Motions with Global Motion Aggregationcited by 223
  10. 2017UnFlow: Unsupervised Learning of Optical Flow with a Bidirectional Census Losscited by 202
  11. 2023Spring: A High-Resolution High-Detail Dataset and Benchmark for Scene Flow, Optical Flow and Stereocited by 170
  12. 2018DF-Net: Unsupervised Joint Learning of Depth and Flow using Cross-Task Consistencycited by 148
21 more
  1. 2019SelFlow: Self-Supervised Learning of Optical Flowcited by 128
  2. 2020RAFT-3D: Scene Flow using Rigid-Motion Embeddingscited by 121
  3. 2017Occlusion Aware Unsupervised Learning of Optical Flowcited by 101
  4. 2018Every Pixel Counts ++: Joint Learning of Geometry and Motion with 3D Holistic Understandingcited by 101
  5. 2023VideoFlow: Exploiting Temporal Cues for Multi-frame Optical Flow Estimationcited by 82
  6. 2021SMURF: Self-Teaching Multi-Frame Unsupervised RAFT with Full-Image Warpingcited by 74
  7. 2020Self-Supervised Monocular Scene Flow Estimationcited by 64
  8. 2024MemFlow: Optical Flow Estimation and Prediction with Memorycited by 55
  9. 2019Deep Rigid Instance Scene Flowcited by 54
  10. 2018A Fusion Approach for Multi-Frame Optical Flow Estimationcited by 37
  11. 2023TransFlow: Transformer as Flow Learnercited by 32
  12. 2021Self-Supervised Multi-Frame Monocular Scene Flowcited by 29
  13. 2019Mono-SF: Multi-View Geometry Meets Single-View Depth for Monocular Scene Flow Estimation of Dynamic Traffic Scenescited by 27
  14. 2025Zero-Shot Monocular Scene Flow Estimation in the Wildcited by 20
  15. 2022Self-distilled Feature Aggregation for Self-supervised Monocular Depth Estimationcited by 17
  16. 2022M-FUSE: Multi-frame Fusion for Scene Flow Estimationcited by 14
  17. 2022RMS-FlowNet: Efficient and Robust Multi-Scale Scene Flow Estimation for Large-Scale Point Cloudscited by 13
  18. 2018ProFlow: Learning to Predict Optical Flowcited by 10
  19. 2020A Deep Temporal Fusion Framework for Scene Flow Using a Learnable Motion Model and Occlusionscited by 9
  20. 2022RAFT-MSF: Self-Supervised Monocular Scene Flow using Recurrent Optimizercited by 7
  21. 2023EMR-MSF: Self-Supervised Recurrent Monocular Scene Flow Exploiting Ego-Motion Rigiditycited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023Learning Monocular Depth in Dynamic Environment via Context-aware Temporal Attention
  2. 2026ReFlow: Self-correction Motion Learning for Dynamic Scene Reconstruction
  3. 2025Injecting Frame-Event Complementary Fusion into Diffusion for Optical Flow in Challenging Scenes
  4. 2023DifFlow3D: Toward Robust Uncertainty-Aware Scene Flow Estimation with Diffusion Model
  5. 2024FlowMamba: Learning Point Cloud Scene Flow with Global Motion Propagation
  6. 2026Stream3Dv2: Geometric-Semantic Fusion Enhanced Streaming Zero-Shot 3D Scene Understanding
  7. 2026MotionSpaceFlow: Representation-Aware Flow Matching in Direct Motion Space
  8. 2025MambaFlow: A Novel and Flow-guided State Space Model for Scene Flow Estimation