mlsanityData to 14 Oct 2026

FlowDepth: Decoupling Optical Flow for Self-Supervised Monocular Depth Estimation

arXiv 2403.19294 ↗First posted 28 Mar 2024cs.CV cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Self-supervised multi-frame methods have currently achieved promising results in depth estimation. However, these methods often suffer from mismatch problems due to the moving objects, which break the static assumption. Additionally, unfairness can occur when calculating photometric errors in high-freq or low-texture regions of the images. To address these issues, existing approaches use additional semantic priori black-box networks to separate moving objects and improve the model only at the loss level. Therefore, we propose FlowDepth, where a Dynamic Motion Flow Module (DMFM) decouples the optical flow by a mechanism-based approach and warps the dynamic regions thus solving the mismatch problem. For the unfairness of photometric errors caused by high-freq and low-texture regions, we use Depth-Cue-Aware Blur (DCABlur) and Cost-Volume sparsity loss respectively at the input and the loss level to solve the problem. Experimental results on the KITTI and Cityscapes datasets show that our method outperforms the state-of-the-art methods.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 26 of its 30 references that are in the map. First posted on arXiv 28 Mar 2024.

Builds on

26 of 30 references.

References · 26

  1. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
  2. 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 820
  3. 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 782
  4. 2014Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecturecited by 483
  5. 20193D Packing for Self-Supervised Monocular Depth Estimationcited by 439
  6. 2020Softmax Splatting for Video Frame Interpolationcited by 279
  7. 2018Competitive Collaboration: Joint Unsupervised Learning of Depth, Camera Motion, Optical Flow and Motion Segmentationcited by 222
  8. 2021The Temporal Opportunist: Self-Supervised Multi-Frame Monocular Depthcited by 190
  9. 2019Depth from Videos in the Wild: Unsupervised Monocular Depth Learning from Unknown Camerascited by 170
  10. 2018Depth Prediction Without the Sensors: Leveraging Structure for Unsupervised Learning from Monocular Videoscited by 155
  11. 2018DF-Net: Unsupervised Joint Learning of Depth and Flow using Cross-Task Consistencycited by 148
  12. 2019Self-supervised Learning with Geometric Constraints in Monocular Video: Connecting Flow, Depth, and Cameracited by 130
14 more
  1. 2020EfficientPS: Efficient Panoptic Segmentationcited by 111
  2. 2022Lite-Mono: A Lightweight CNN and Transformer Architecture for Self-Supervised Monocular Depth Estimationcited by 100
  3. 2020Unsupervised Monocular Depth Learning in Dynamic Scenescited by 84
  4. 2020Don't Forget The Past: Recurrent Depth Estimation from Monocular Videocited by 71
  5. 2020MonoRec: Semi-Supervised Dense Reconstruction in Dynamic Environments from a Single Moving Cameracited by 59
  6. 2021Learning Monocular Depth in Dynamic Scenes via Instance-Aware Projection Consistencycited by 58
  7. 2021Fine-grained Semantics-aware Representation Enhancement for Self-supervised Monocular Depth Estimationcited by 55
  8. 2022Disentangling Object Motion and Occlusion for Unsupervised Multi-frame Monocular Depthcited by 48
  9. 2021Attentive and Contrastive Learning for Joint Depth and Motion Field Estimationcited by 24
  10. 2021S2R-DepthNet: Learning a Generalizable Depth-specific Structural Representationcited by 23
  11. 2020EffiScene: Efficient Per-Pixel Rigidity Inference for Unsupervised Joint Learning of Optical Flow, Depth, Camera Pose and Motion Segmentationcited by 22
  12. 2023RM-Depth: Unsupervised Learning of Recurrent Monocular Depth in Dynamic Scenescited by 22
  13. 2022Self-Supervised Monocular Depth Estimation: Solving the Edge-Fattening Problemcited by 20
  14. 2022Frequency-Aware Self-Supervised Monocular Depth Estimationcited by 3

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 1.

2 papers.