A Critical Synthesis of Uncertainty Quantification and Foundation Models in Monocular Depth Estimation
Not on the map. Why?
Abstract (arXiv)
While recent foundation models have enabled significant breakthroughs in monocular depth estimation, a clear path towards safe and reliable deployment in the real-world remains elusive. Metric depth estimation, which involves predicting absolute distances, poses particular challenges, as even the most advanced foundation models remain prone to critical errors. Since quantifying the uncertainty has emerged as a promising endeavor to address these limitations and enable trustworthy deployment, we fuse five different uncertainty quantification methods with the current state-of-the-art DepthAnythingV2 foundation model. To cover a wide range of metric depth domains, we evaluate their performance on four diverse datasets. Our findings identify fine-tuning with the Gaussian Negative Log-Likelihood Loss (GNLL) as a particularly promising approach, offering reliable uncertainty estimates while maintaining predictive performance and computational efficiency on par with the baseline, encompassing both training and inference time. By fusing uncertainty quantification and foundation models within the context of monocular depth estimation, this paper lays a critical foundation for future research aimed at improving not only model performance but also its explainability. Extending this critical synthesis of uncertainty quantification and foundation models into other crucial tasks, such as semantic segmentation and pose estimation, presents exciting opportunities for safer and more reliable machine vision systems.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 47 of its 76 references that are in the map. First posted on arXiv 14 Jan 2025.
Builds on
47 of 76 references.
References · 47
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
- 2024Depth Anything V2cited by 1,385
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 731
- 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 721
- 2021A Survey of Uncertainty in Deep Neural Networkscited by 675
35 more
- 2019Deep Ensembles: A Loss Landscape Perspectivecited by 438
- 2017Training Confidence-calibrated Classifiers for Detecting Out-of-Distribution Samplescited by 389
- 2020Simple and Principled Uncertainty Estimation with Deterministic Deep Learning via Distance Awarenesscited by 389
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 357
- 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
- 2020Learning to Recover 3D Scene Shape from a Single Imagecited by 214
- 2021Deep Deterministic Uncertainty: A Simple Baselinecited by 200
- 2020BOP Challenge 2020 on 6D Object Localizationcited by 192
- 2020On the uncertainty of self-supervised monocular depth estimationcited by 182
- 2016Single-Image Depth Perception in the Wildcited by 179
- 2018Understanding Measures of Uncertainty for Adversarial Example Detectioncited by 177
- 2022BinsFormer: Revisiting Adaptive Bins for Monocular Depth Estimationcited by 166
- 2023DDP: Diffusion Model for Dense Visual Predictioncited by 148
- 2021Transformer-Based Attention Networks for Continuous Pixel-Wise Predictioncited by 125
- 2019A General Framework for Uncertainty Estimation in Deep Learningcited by 119
- 2023The Surprising Effectiveness of Diffusion Models for Optical Flow and Monocular Depth Estimationcited by 116
- 2024RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusioncited by 109
- 2023Towards Zero-Shot Scale-Aware Monocular Depth Estimationcited by 100
- 2020OASIS: A Large-Scale Dataset for Single Image 3D in the Wildcited by 62
- 2021Towards Real-Time Monocular Depth Estimation for Robotics: A Surveycited by 55
- 2020Toward Hierarchical Self-Supervised Monocular Absolute Depth Estimation for Autonomous Driving Applicationscited by 40
- 2018Bayesian QuickNAT: Model Uncertainty in Deep Whole-Brain Segmentation for Structure-wise Quality Controlcited by 39
- 2019Training-Free Uncertainty Estimation for Dense Regression: Sensitivity as a Surrogatecited by 28
- 2022Gradient-based Uncertainty for Monocular Depth Estimationcited by 26
- 2020Adaptive confidence thresholding for monocular depth estimationcited by 25
- 2022Latent Discriminant deterministic Uncertaintycited by 17
- 2023DUDES: Deep Uncertainty Distillation using Ensembles for Semantic Segmentationcited by 15
- 2021Trust Your Robots! Predictive Uncertainty Estimation of Neural Networks with Sparse Gaussian Processescited by 12
- 2021SLURP: Side Learning Uncertainty for Regression Problemscited by 12
- 2018Adversarial Examples - A Complete Characterisation of the Phenomenoncited by 11
- 2023U-CE: Uncertainty-aware Cross-Entropy for Semantic Segmentationcited by 11
- 2024InseRF: Text-Driven Generative Object Insertion in Neural 3D Scenescited by 10
- 2022Visual Attention-based Self-supervised Absolute Depth Estimation using Geometric Priors in Autonomous Drivingcited by 8
- 2023Variational Predictioncited by 2
- 2024A Comparative Study on Multi-task Uncertainty Quantification in Semantic Segmentation and Monocular Depth Estimationcited by 2
Built on by
Citing papers per year: 2025: 2.
2 papers.