mlsanityData to 7 Oct 2026

A Critical Synthesis of Uncertainty Quantification and Foundation Models in Monocular Depth Estimation

arXiv 2501.08188 ↗First posted 14 Jan 2025cs.CV cs.AI cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

While recent foundation models have enabled significant breakthroughs in monocular depth estimation, a clear path towards safe and reliable deployment in the real-world remains elusive. Metric depth estimation, which involves predicting absolute distances, poses particular challenges, as even the most advanced foundation models remain prone to critical errors. Since quantifying the uncertainty has emerged as a promising endeavor to address these limitations and enable trustworthy deployment, we fuse five different uncertainty quantification methods with the current state-of-the-art DepthAnythingV2 foundation model. To cover a wide range of metric depth domains, we evaluate their performance on four diverse datasets. Our findings identify fine-tuning with the Gaussian Negative Log-Likelihood Loss (GNLL) as a particularly promising approach, offering reliable uncertainty estimates while maintaining predictive performance and computational efficiency on par with the baseline, encompassing both training and inference time. By fusing uncertainty quantification and foundation models within the context of monocular depth estimation, this paper lays a critical foundation for future research aimed at improving not only model performance but also its explainability. Extending this critical synthesis of uncertainty quantification and foundation models into other crucial tasks, such as semantic segmentation and pose estimation, presents exciting opportunities for safer and more reliable machine vision systems.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 47 of its 76 references that are in the map. First posted on arXiv 14 Jan 2025.

Builds on

47 of 76 references.

References · 47

  1. 2017On Calibration of Modern Neural Networkscited by 4,860
  2. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
  3. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
  4. 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
  5. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
  6. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  7. 2024Depth Anything V2cited by 1,385
  8. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
  9. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
  10. 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 731
  11. 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 721
  12. 2021A Survey of Uncertainty in Deep Neural Networkscited by 675
35 more
  1. 2019Deep Ensembles: A Loss Landscape Perspectivecited by 438
  2. 2017Training Confidence-calibrated Classifiers for Detecting Out-of-Distribution Samplescited by 389
  3. 2020Simple and Principled Uncertainty Estimation with Deterministic Deep Learning via Distance Awarenesscited by 389
  4. 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 357
  5. 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
  6. 2020Learning to Recover 3D Scene Shape from a Single Imagecited by 214
  7. 2021Deep Deterministic Uncertainty: A Simple Baselinecited by 200
  8. 2020BOP Challenge 2020 on 6D Object Localizationcited by 192
  9. 2020On the uncertainty of self-supervised monocular depth estimationcited by 182
  10. 2016Single-Image Depth Perception in the Wildcited by 179
  11. 2018Understanding Measures of Uncertainty for Adversarial Example Detectioncited by 177
  12. 2022BinsFormer: Revisiting Adaptive Bins for Monocular Depth Estimationcited by 166
  13. 2023DDP: Diffusion Model for Dense Visual Predictioncited by 148
  14. 2021Transformer-Based Attention Networks for Continuous Pixel-Wise Predictioncited by 125
  15. 2019A General Framework for Uncertainty Estimation in Deep Learningcited by 119
  16. 2023The Surprising Effectiveness of Diffusion Models for Optical Flow and Monocular Depth Estimationcited by 116
  17. 2024RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusioncited by 109
  18. 2023Towards Zero-Shot Scale-Aware Monocular Depth Estimationcited by 100
  19. 2020OASIS: A Large-Scale Dataset for Single Image 3D in the Wildcited by 62
  20. 2021Towards Real-Time Monocular Depth Estimation for Robotics: A Surveycited by 55
  21. 2020Toward Hierarchical Self-Supervised Monocular Absolute Depth Estimation for Autonomous Driving Applicationscited by 40
  22. 2018Bayesian QuickNAT: Model Uncertainty in Deep Whole-Brain Segmentation for Structure-wise Quality Controlcited by 39
  23. 2019Training-Free Uncertainty Estimation for Dense Regression: Sensitivity as a Surrogatecited by 28
  24. 2022Gradient-based Uncertainty for Monocular Depth Estimationcited by 26
  25. 2020Adaptive confidence thresholding for monocular depth estimationcited by 25
  26. 2022Latent Discriminant deterministic Uncertaintycited by 17
  27. 2023DUDES: Deep Uncertainty Distillation using Ensembles for Semantic Segmentationcited by 15
  28. 2021Trust Your Robots! Predictive Uncertainty Estimation of Neural Networks with Sparse Gaussian Processescited by 12
  29. 2021SLURP: Side Learning Uncertainty for Regression Problemscited by 12
  30. 2018Adversarial Examples - A Complete Characterisation of the Phenomenoncited by 11
  31. 2023U-CE: Uncertainty-aware Cross-Entropy for Semantic Segmentationcited by 11
  32. 2024InseRF: Text-Driven Generative Object Insertion in Neural 3D Scenescited by 10
  33. 2022Visual Attention-based Self-supervised Absolute Depth Estimation using Geometric Priors in Autonomous Drivingcited by 8
  34. 2023Variational Predictioncited by 2
  35. 2024A Comparative Study on Multi-task Uncertainty Quantification in Semantic Segmentation and Monocular Depth Estimationcited by 2

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.