Gradient-based Uncertainty for Monocular Depth Estimation
Not on the map. Why?
Abstract (arXiv)
In monocular depth estimation, disturbances in the image context, like moving objects or reflecting materials, can easily lead to erroneous predictions. For that reason, uncertainty estimates for each pixel are necessary, in particular for safety-critical applications such as automated driving. We propose a post hoc uncertainty estimation approach for an already trained and thus fixed depth estimation model, represented by a deep neural network. The uncertainty is estimated with the gradients which are extracted with an auxiliary loss function. To avoid relying on ground-truth information for the loss definition, we present an auxiliary loss function based on the correspondence of the depth prediction for an image and its horizontally flipped counterpart. Our approach achieves state-of-the-art uncertainty estimation results on the KITTI and NYU Depth V2 benchmarks without the need to retrain the neural network. Models and code are publicly available at https://github.com/jhornauer/GrUMoDepth.
Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). Builds on 27 of its 32 references that are in the map. First posted on arXiv 3 Aug 2022.
Builds on
27 of 32 references.
References · 27
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
- 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
- 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
- 2014Deep Neural Networks are Easily Fooled: High Confidence Predictions for Unrecognizable Imagescited by 774
- 2020AdaBins: Depth Estimation using Adaptive Binscited by 596
- 2016Deeper Depth Prediction with Fully Convolutional Residual Networkscited by 402
- 2021On the Importance of Gradients for Detecting Distributional Shifts in the Wildcited by 338
- 2017Sparsity Invariant CNNscited by 325
- 2019Unsupervised Scale-consistent Depth and Ego-motion Learning from Monocular Videocited by 244
15 more
- 2020D3VO: Deep Depth, Deep Pose and Deep Uncertainty for Monocular Visual Odometrycited by 206
- 2019Evaluating Scalable Bayesian Deep Learning Methods for Robust Computer Visioncited by 182
- 2020On the uncertainty of self-supervised monocular depth estimationcited by 182
- 2018Uncertainty Estimates and Multi-Hypotheses Networks for Optical Flowcited by 135
- 2018Deep Virtual Stereo Odometry: Leveraging Deep Depth Prediction for Monocular Direct Sparse Odometrycited by 85
- 2021Self-Supervised Monocular Depth Estimation with Internal Feature Fusioncited by 67
- 2019Learning monocular depth estimation infusing traditional stereo knowledgecited by 64
- 2020Gradients as a Measure of Uncertainty in Neural Networkscited by 55
- 2018Classification Uncertainty of Deep Neural Networks Based on Gradient Informationcited by 43
- 2019Training-Free Uncertainty Estimation for Dense Regression: Sensitivity as a Surrogatecited by 28
- 2017ProbFlow: Joint Optical Flow and Uncertainty Estimationcited by 24
- 2021CamLessMonoDepth: Monocular Depth Estimation with Unknown Camera Parameterscited by 8
- 2021SUB-Depth: Self-distillation and Uncertainty Boosting Self-supervised Monocular Depth Estimationcited by 7
- 2021NVS-MonoDepth: Improving Monocular Depth Prediction with Novel View Synthesiscited by 7
- 2019Region Deformer Networks for Unsupervised Depth Estimation from Unconstrained Monocular Videoscited by 4
Built on by
Citing papers per year: 2022: 1; 2023: 11; 2024: 8; 2025: 4; 2026: 2.
26 papers.
Sort:
By area:
- 2024NeRF On-the-go: Exploiting Uncertainty for Distractor-free NeRFs in the Wildcited by 85
- 2024Stereo Anywhere: Robust Zero-Shot Deep Stereo Matching Even Where Either Stereo or Mono Failcited by 45
- 2024Diffusion Models for Monocular Depth Estimation: Overcoming Challenging Conditionscited by 29
- 2023POCO: 3D Pose and Shape Estimation with Confidencecited by 20
- 2025Toward Real-world BEV Perception: Depth Uncertainty Estimation via Gaussian Splattingcited by 20
- 2024RankED: Addressing Imbalance and Uncertainty in Edge Detection Using Ranking-based Lossescited by 18
- 2024Diffusion Model Guided Sampling with Pixel-Wise Aleatoric Uncertainty Estimationcited by 17
- 2022ZigZag: Universal Sampling-free Uncertainty Estimation Through Two-Step Inferencecited by 15
- 2023Single Image Depth Prediction Made Better: A Multivariate Gaussian Takecited by 14
- 2023Pixel-wise Gradient Uncertainty for Convolutional Neural Networks applied to Out-of-Distribution Segmentationcited by 11
- 2023Human as Points: Explicit Point-based 3D Human Reconstruction from Single-view RGB Imagescited by 8
- 2023ProbVLM: Probabilistic Adapter for Frozen Vision-Language Modelscited by 7
14 more
- 2023Out-of-Distribution Detection for Monocular Depth Estimationcited by 7
- 2023Discretization-Induced Dirichlet Posterior for Robust Uncertainty Quantification on Regressioncited by 7
- 2025Revisiting Gradient-based Uncertainty for Monocular Depth Estimationcited by 5
- 2023Robust Self-Supervised Extrinsic Self-Calibrationcited by 4
- 2024Uni-SLAM: Uncertainty-Aware Neural Implicit SLAM for Real-Time Dense Indoor Scene Reconstructioncited by 3
- 2023ADU-Depth: Attention-based Distillation with Uncertainty Modeling for Depth Estimationcited by 2
- 2025A Critical Synthesis of Uncertainty Quantification and Foundation Models in Monocular Depth Estimationcited by 2
- 2023Measuring and Modeling Uncertainty Degree for Monocular Depth Estimationcited by 1
- 2023FocDepthFormer: Transformer with latent LSTM for Depth Estimation from Focal Stackcited by 1
- 2024Consistency Regularisation for Unsupervised Domain Adaptation in Monocular Depth Estimationcited by 1
- 2024Probabilistic Modeling of Disparity Uncertainty for Robust and Efficient Stereo Matchingcited by 1
- 2025Adaptive Dual Uncertainty Optimization: Boosting Monocular 3D Object Detection under Test-Time Shiftscited by 1
- 2026Robust Uncertainty Estimation under Distribution Shift via Difference Reconstructioncited by 0
- 2026A Calibration Audit of Confidence in Feed-Forward 3D Reconstruction Modelscited by 0
- 2026A Calibration Audit of Confidence in Feed-Forward 3D Reconstruction Models30 Aug 2026
- 2026Robust Uncertainty Estimation under Distribution Shift via Difference Reconstruction27 Jan 2026
- 2025Adaptive Dual Uncertainty Optimization: Boosting Monocular 3D Object Detection under Test-Time Shifts28 Aug 2025
- 2025Toward Real-world BEV Perception: Depth Uncertainty Estimation via Gaussian Splatting2 Apr 2025
- 2025Revisiting Gradient-based Uncertainty for Monocular Depth Estimation9 Feb 2025
- 2025A Critical Synthesis of Uncertainty Quantification and Foundation Models in Monocular Depth Estimation14 Jan 2025
- 2024Probabilistic Modeling of Disparity Uncertainty for Robust and Efficient Stereo Matching24 Dec 2024
- 2024Stereo Anywhere: Robust Zero-Shot Deep Stereo Matching Even Where Either Stereo or Mono Fail5 Dec 2024
- 2024Uni-SLAM: Uncertainty-Aware Neural Implicit SLAM for Real-Time Dense Indoor Scene Reconstruction29 Nov 2024
- 2024Diffusion Model Guided Sampling with Pixel-Wise Aleatoric Uncertainty Estimation29 Nov 2024
- 2024Diffusion Models for Monocular Depth Estimation: Overcoming Challenging Conditions23 Jul 2024
- 2024NeRF On-the-go: Exploiting Uncertainty for Distractor-free NeRFs in the Wild29 May 2024
14 more
- 2024Consistency Regularisation for Unsupervised Domain Adaptation in Monocular Depth Estimation27 May 2024
- 2024RankED: Addressing Imbalance and Uncertainty in Edge Detection Using Ranking-based Losses4 Mar 2024
- 2023Human as Points: Explicit Point-based 3D Human Reconstruction from Single-view RGB Images6 Nov 2023
- 2023FocDepthFormer: Transformer with latent LSTM for Depth Estimation from Focal Stack17 Oct 2023
- 2023ADU-Depth: Attention-based Distillation with Uncertainty Modeling for Depth Estimation26 Sep 2023
- 2023POCO: 3D Pose and Shape Estimation with Confidence24 Aug 2023
- 2023Discretization-Induced Dirichlet Posterior for Robust Uncertainty Quantification on Regression17 Aug 2023
- 2023Out-of-Distribution Detection for Monocular Depth Estimation11 Aug 2023
- 2023Robust Self-Supervised Extrinsic Self-Calibration4 Aug 2023
- 2023Measuring and Modeling Uncertainty Degree for Monocular Depth Estimation19 Jul 2023
- 2023ProbVLM: Probabilistic Adapter for Frozen Vision-Language Models1 Jul 2023
- 2023Single Image Depth Prediction Made Better: A Multivariate Gaussian Take31 Mar 2023
- 2023Pixel-wise Gradient Uncertainty for Convolutional Neural Networks applied to Out-of-Distribution Segmentation13 Mar 2023
- 2022ZigZag: Universal Sampling-free Uncertainty Estimation Through Two-Step Inference21 Nov 2022
- 2024NeRF On-the-go: Exploiting Uncertainty for Distractor-free NeRFs in the Wildcited by 85
- 2024Stereo Anywhere: Robust Zero-Shot Deep Stereo Matching Even Where Either Stereo or Mono Failcited by 45
- 2023POCO: 3D Pose and Shape Estimation with Confidencecited by 20
- 2025Toward Real-world BEV Perception: Depth Uncertainty Estimation via Gaussian Splattingcited by 20
- 2024RankED: Addressing Imbalance and Uncertainty in Edge Detection Using Ranking-based Lossescited by 18
- 2022ZigZag: Universal Sampling-free Uncertainty Estimation Through Two-Step Inferencecited by 15
- 2023Single Image Depth Prediction Made Better: A Multivariate Gaussian Takecited by 14
- 2023Pixel-wise Gradient Uncertainty for Convolutional Neural Networks applied to Out-of-Distribution Segmentationcited by 11
- 2023Human as Points: Explicit Point-based 3D Human Reconstruction from Single-view RGB Imagescited by 8
- 2023Out-of-Distribution Detection for Monocular Depth Estimationcited by 7
- 2023Discretization-Induced Dirichlet Posterior for Robust Uncertainty Quantification on Regressioncited by 7
- 2025Revisiting Gradient-based Uncertainty for Monocular Depth Estimationcited by 5
12 most cited of 23 All 23 (JSON)
- 2026A Calibration Audit of Confidence in Feed-Forward 3D Reconstruction Models30 Aug 2026
- 2026Robust Uncertainty Estimation under Distribution Shift via Difference Reconstruction27 Jan 2026
- 2025Adaptive Dual Uncertainty Optimization: Boosting Monocular 3D Object Detection under Test-Time Shifts28 Aug 2025
- 2025Toward Real-world BEV Perception: Depth Uncertainty Estimation via Gaussian Splatting2 Apr 2025
- 2025Revisiting Gradient-based Uncertainty for Monocular Depth Estimation9 Feb 2025
- 2025A Critical Synthesis of Uncertainty Quantification and Foundation Models in Monocular Depth Estimation14 Jan 2025
- 2024Probabilistic Modeling of Disparity Uncertainty for Robust and Efficient Stereo Matching24 Dec 2024
- 2024Stereo Anywhere: Robust Zero-Shot Deep Stereo Matching Even Where Either Stereo or Mono Fail5 Dec 2024
- 2024Uni-SLAM: Uncertainty-Aware Neural Implicit SLAM for Real-Time Dense Indoor Scene Reconstruction29 Nov 2024
- 2024NeRF On-the-go: Exploiting Uncertainty for Distractor-free NeRFs in the Wild29 May 2024
- 2024Consistency Regularisation for Unsupervised Domain Adaptation in Monocular Depth Estimation27 May 2024
- 2024RankED: Addressing Imbalance and Uncertainty in Edge Detection Using Ranking-based Losses4 Mar 2024
12 newest of 23 All 23 (JSON)