Scale-Invariant Monocular Depth Estimation via SSI Depth
Not on the map. Why?
Abstract (arXiv)
Existing methods for scale-invariant monocular depth estimation (SI MDE) often struggle due to the complexity of the task, and limited and non-diverse datasets, hindering generalizability in real-world scenarios. This is while shift-and-scale-invariant (SSI) depth estimation, simplifying the task and enabling training with abundant stereo datasets achieves high performance. We present a novel approach that leverages SSI inputs to enhance SI depth estimation, streamlining the network's role and facilitating in-the-wild generalization for SI depth estimation while only using a synthetic dataset for training. Emphasizing the generation of high-resolution details, we introduce a novel sparse ordinal loss that substantially improves detail generation in SSI MDE, addressing critical limitations in existing approaches. Through in-the-wild qualitative examples and zero-shot evaluation we substantiate the practical utility of our approach in computational photography applications, showcasing its ability to generate highly detailed SI depth maps and achieve generalization in diverse scenarios.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 38 of its 50 references that are in the map. First posted on arXiv 13 Jun 2024.
Builds on
38 of 50 references.
References · 38
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
- 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 885
- 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
- 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 721
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
- 2018Exploring the Limits of Weakly Supervised Pretrainingcited by 604
26 more
- 2020AdaBins: Depth Estimation using Adaptive Binscited by 596
- 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 494
- 2014Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecturecited by 483
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 357
- 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
- 2019DIODE: A Dense Indoor and Outdoor DEpth Datasetcited by 236
- 2019Enforcing geometric constraints of virtual normal for depth predictioncited by 233
- 2020Learning to Recover 3D Scene Shape from a Single Imagecited by 214
- 20203D Photography using Context-aware Layered Depth Inpaintingcited by 206
- 2018Evaluation of CNN-based Single-Image Depth Estimation Methodscited by 137
- 20193D Ken Burns Effect from a Single Imagecited by 128
- 2019Learning the Depths of Moving People by Watching Frozen Peoplecited by 120
- 2021Boosting Monocular Depth Estimation Models to High-Resolution via Content-Adaptive Multi-Resolution Mergingcited by 104
- 2022LocalBins: Improving Depth Estimation by Learning Local Distributionscited by 92
- 2020OpenRooms: An End-to-End Open Framework for Photorealistic Indoor Scene Datasetscited by 73
- 2018Synthetic Depth-of-Field with a Single-Camera Mobile Phonecited by 70
- 2018T2Net: Synthetic-to-Realistic Translation for Solving Single-Image Depth Estimation Taskscited by 70
- 2016A Large Dataset of Object Scanscited by 64
- 2019Structure-Aware Residual Pyramid Network for Monocular Depth Estimationcited by 49
- 2021Virtual Normal: Enforcing Geometric Constraints for Accurate and Robust Depth Predictioncited by 48
- 2022BokehMe: When Neural Rendering Meets Classical Renderingcited by 48
- 2019Bilateral Cyclic Constraint and Adaptive Regularization for Unsupervised Monocular Depth Predictioncited by 44
- 2023PatchFusion: An End-to-End Tile-Based Framework for High-Resolution Monocular Metric Depth Estimationcited by 39
- 2020Holopix50k: A Large-Scale In-the-wild Stereo Image Datasetcited by 36
- 2018Learning Single-Image Depth from Videos using Quality Assessment Networkscited by 25
- 2017Surface Normals in the Wildcited by 8
Built on by
Citing papers per year: 2024: 1; 2025: 3.
4 papers.
- 2024Colorful Diffuse Intrinsic Image Decomposition in the Wildcited by 44
- 2025Vid2Sim: Realistic and Interactive Simulation from Video for Urban Navigationcited by 30
- 2025Jasmine: Harnessing Diffusion Prior for Self-supervised Depth Estimationcited by 20
- 2025RPG360: Robust 360 Depth Estimation with Perspective Foundation Models and Graph Optimizationcited by 4
- 2025RPG360: Robust 360 Depth Estimation with Perspective Foundation Models and Graph Optimization28 Sep 2025
- 2025Jasmine: Harnessing Diffusion Prior for Self-supervised Depth Estimation20 Mar 2025
- 2025Vid2Sim: Realistic and Interactive Simulation from Video for Urban Navigation12 Jan 2025
- 2024Colorful Diffuse Intrinsic Image Decomposition in the Wild20 Sep 2024