mlsanityData to 7 Oct 2026

Scale-Invariant Monocular Depth Estimation via SSI Depth

arXiv 2406.09374 ↗First posted 13 Jun 2024cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

Existing methods for scale-invariant monocular depth estimation (SI MDE) often struggle due to the complexity of the task, and limited and non-diverse datasets, hindering generalizability in real-world scenarios. This is while shift-and-scale-invariant (SSI) depth estimation, simplifying the task and enabling training with abundant stereo datasets achieves high performance. We present a novel approach that leverages SSI inputs to enhance SI depth estimation, streamlining the network's role and facilitating in-the-wild generalization for SI depth estimation while only using a synthetic dataset for training. Emphasizing the generation of high-resolution details, we introduce a novel sparse ordinal loss that substantially improves detail generation in SSI MDE, addressing critical limitations in existing approaches. Through in-the-wild qualitative examples and zero-shot evaluation we substantiate the practical utility of our approach in computational photography applications, showcasing its ability to generate highly detailed SI depth maps and achieve generalization in diverse scenarios.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 38 of its 50 references that are in the map. First posted on arXiv 13 Jun 2024.

Builds on

38 of 50 references.

References · 38

  1. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  2. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  3. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
  4. 2021Vision Transformers for Dense Predictioncited by 1,789
  5. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  6. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
  7. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
  8. 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 885
  9. 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
  10. 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 721
  11. 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
  12. 2018Exploring the Limits of Weakly Supervised Pretrainingcited by 604
26 more
  1. 2020AdaBins: Depth Estimation using Adaptive Binscited by 596
  2. 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 494
  3. 2014Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecturecited by 483
  4. 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 357
  5. 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
  6. 2019DIODE: A Dense Indoor and Outdoor DEpth Datasetcited by 236
  7. 2019Enforcing geometric constraints of virtual normal for depth predictioncited by 233
  8. 2020Learning to Recover 3D Scene Shape from a Single Imagecited by 214
  9. 20203D Photography using Context-aware Layered Depth Inpaintingcited by 206
  10. 2018Evaluation of CNN-based Single-Image Depth Estimation Methodscited by 137
  11. 20193D Ken Burns Effect from a Single Imagecited by 128
  12. 2019Learning the Depths of Moving People by Watching Frozen Peoplecited by 120
  13. 2021Boosting Monocular Depth Estimation Models to High-Resolution via Content-Adaptive Multi-Resolution Mergingcited by 104
  14. 2022LocalBins: Improving Depth Estimation by Learning Local Distributionscited by 92
  15. 2020OpenRooms: An End-to-End Open Framework for Photorealistic Indoor Scene Datasetscited by 73
  16. 2018Synthetic Depth-of-Field with a Single-Camera Mobile Phonecited by 70
  17. 2018T2Net: Synthetic-to-Realistic Translation for Solving Single-Image Depth Estimation Taskscited by 70
  18. 2016A Large Dataset of Object Scanscited by 64
  19. 2019Structure-Aware Residual Pyramid Network for Monocular Depth Estimationcited by 49
  20. 2021Virtual Normal: Enforcing Geometric Constraints for Accurate and Robust Depth Predictioncited by 48
  21. 2022BokehMe: When Neural Rendering Meets Classical Renderingcited by 48
  22. 2019Bilateral Cyclic Constraint and Adaptive Regularization for Unsupervised Monocular Depth Predictioncited by 44
  23. 2023PatchFusion: An End-to-End Tile-Based Framework for High-Resolution Monocular Metric Depth Estimationcited by 39
  24. 2020Holopix50k: A Large-Scale In-the-wild Stereo Image Datasetcited by 36
  25. 2018Learning Single-Image Depth from Videos using Quality Assessment Networkscited by 25
  26. 2017Surface Normals in the Wildcited by 8

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 3.

4 papers.