mlsanityData to 14 Oct 2026

Edge-aware Consistent Stereo Video Depth Estimation

arXiv 2305.02645 ↗First posted 4 May 2023cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Video depth estimation is crucial in various applications, such as scene reconstruction and augmented reality. In contrast to the naive method of estimating depths from images, a more sophisticated approach uses temporal information, thereby eliminating flickering and geometrical inconsistencies. We propose a consistent method for dense video depth estimation; however, unlike the existing monocular methods, ours relates to stereo videos. This technique overcomes the limitations arising from the monocular input. As a benefit of using stereo inputs, a left-right consistency loss is introduced to improve the performance. Besides, we use SLAM-based camera pose estimation in the process. To address the problem of depth blurriness during test-time training (TTT), we present an edge-preserving loss function that improves the visibility of fine details while preserving geometrical consistency. We show that our edge-aware stereo video model can accurately estimate the dense depth maps.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 21 of its 28 references that are in the map. First posted on arXiv 4 May 2023.

Builds on

21 of 28 references.

References · 21

  1. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
  2. 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 806
  3. 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 784
  4. 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 782
  5. 2019GA-Net: Guided Aggregation Net for End-to-end Stereo Matchingcited by 244
  6. 2019Group-wise Correlation Stereo Networkcited by 235
  7. 2020Consistent Video Depth Estimationcited by 220
  8. 2016DeMoN: Depth and Motion Network for Learning Monocular Stereocited by 201
  9. 2020Robust Consistent Video Depth Estimationcited by 188
  10. 2018DeepV2D: Video to Depth with Differentiable Structure from Motioncited by 185
  11. 2020Novel View Synthesis of Dynamic Scenes with Globally Coherent Depths from a Monocular Cameracited by 166
  12. 2020Hierarchical Neural Architecture Search for Deep Stereo Matchingcited by 166
9 more
  1. 2019Self-supervised Learning with Geometric Constraints in Monocular Video: Connecting Flow, Depth, and Cameracited by 130
  2. 2017SfM-Net: Learning of Structure and Motion from Videocited by 89
  3. 2021MobileStereoNet: Towards Lightweight Deep Networks for Stereo Matchingcited by 82
  4. 2020Don't Forget The Past: Recurrent Depth Estimation from Monocular Videocited by 71
  5. 2021Consistent Depth of Moving Objects in Videocited by 56
  6. 2019Deep Rigid Instance Scene Flowcited by 54
  7. 2022M-FUSE: Multi-frame Fusion for Scene Flow Estimationcited by 14
  8. 2019Temporally Consistent Depth Prediction with Flow-Guided Memory Unitscited by 10
  9. 2023High-Resolution Synthetic RGB-D Datasets for Monocular Depth Estimationcited by 10

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.