Heteroscedastic Uncertainty Estimation Framework for Unsupervised Registration
Not on the map. Why?
Abstract (arXiv)
Deep learning methods for unsupervised registration often rely on objectives that assume a uniform noise level across the spatial domain (e.g. mean-squared error loss), but noise distributions are often heteroscedastic and input-dependent in real-world medical images. Thus, this assumption often leads to degradation in registration performance, mainly due to the undesired influence of noise-induced outliers. To mitigate this, we propose a framework for heteroscedastic image uncertainty estimation that can adaptively reduce the influence of regions with high uncertainty during unsupervised registration. The framework consists of a collaborative training strategy for the displacement and variance estimators, and a novel image fidelity weighting scheme utilizing signal-to-noise ratios. Our approach prevents the model from being driven away by spurious gradients caused by the simplified homoscedastic assumption, leading to more accurate displacement estimation. To illustrate its versatility and effectiveness, we tested our framework on two representative registration architectures across three medical image datasets. Our method consistently outperforms baselines and produces sensible uncertainty estimates. The code is publicly available at urlhttps://voldemort108x.github.io/heterouncertainty/.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 19 of its 32 references that are in the map. First posted on arXiv 1 Dec 2023.
Builds on
19 of 32 references.
References · 19
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2018VoxelMorph: A Learning Framework for Deformable Medical Image Registrationcited by 657
- 2019Deep Learning for Segmentation using an Open Large-Scale Dataset in 2D Echocardiographycited by 243
- 2019Unsupervised Learning of Probabilistic Diffeomorphic Registration for Images and Surfacescited by 186
- 2020On the uncertainty of self-supervised monocular depth estimationcited by 182
- 2020SynthMorph: learning contrast-invariant registration without acquired imagescited by 137
- 2021Estimating and Exploiting the Aleatoric Uncertainty in Surface Normal Estimationcited by 116
- 2021Learning Accurate Dense Correspondences and When to Trust Themcited by 113
- 2020Stochastic Segmentation Networks: Modelling Spatially Correlated Aleatoric Uncertaintycited by 100
- 2021HyperMorph: Amortized Hyperparameter Learning for Image Registrationcited by 84
- 2022XMorpher: Full Transformer for Deformable Medical Image Registration via Cross Attentioncited by 46
7 more
- 2019Bilateral Cyclic Constraint and Adaptive Regularization for Unsupervised Monocular Depth Predictioncited by 44
- 2021An Adaptive Framework for Learning Unsupervised Depth Completioncited by 30
- 2020Fully Automated Left Atrium Segmentation from Anatomical Cine Long-axis MRI Sequences using Deep Convolutional Neural Network with Unscented Kalman Filtercited by 9
- 2022Learning correspondences of cardiac motion from images using biomechanics-informed modelingcited by 8
- 2017Adaptive Regularization of Some Inverse Problems in Image Analysiscited by 4
- 2020A Comparative Study for Non-rigid Image Registration and Rigid Image Registrationcited by 2
- 2016A Bayesian Heteroscedastic GLM with Application to fMRI Data with Motion Spikescited by 1
Built on by
Citing papers per year: 2024: 1; 2025: 7; 2026: 6.
14 papers.
Sort:
By area:
- 2025Uncertainty Quantification for Machine Learning in Healthcare: A Surveycited by 11
- 2025Extending Foundational Monocular Depth Estimators to Fisheye Cameras with Calibration Tokenscited by 9
- 2025Adapting Vision Foundation Models for Real-time Ultrasound Image Segmentationcited by 8
- 2024Hierarchical Uncertainty Estimation for Learning-based Registration in Neuroimagingcited by 4
- 2025ETA: Energy-based Test-time Adaptation for Depth Completioncited by 4
- 2025Encoder-Only Image Registrationcited by 3
- 2025Uncertainty Estimation for Pretrained Medical Image Registration Models via Transformation Equivariancecited by 1
- 2026WaveDiT: Distribution-Aware Wavelet Flow Matching for Efficient 3D Brain MRI Synthesiscited by 1
- 2026Triangular Consistency as a Universal Constraint for Learning Optical Flowcited by 1
- 2026VisTa3D: A Dataset and Benchmark for Thin Object Reconstruction from Vision, Tactile, and 3D Point Cloudscited by 1
- 2025Learning Correlation-aware Aleatoric Uncertainty for 3D Hand Pose Estimationcited by 0
- 2026Adaptive Conditional Contrast-Agnostic Deformable Image Registration with Uncertainty Estimationcited by 0
- 2026Recursive Uncertainty-Gated Image Registration for Learning-based Algorithms23 Sep 2026
- 2026VisTa3D: A Dataset and Benchmark for Thin Object Reconstruction from Vision, Tactile, and 3D Point Clouds21 Aug 2026
- 2026Triangular Consistency as a Universal Constraint for Learning Optical Flow18 Jun 2026
- 2026WaveDiT: Distribution-Aware Wavelet Flow Matching for Efficient 3D Brain MRI Synthesis7 Jun 2026
- 2026Pareto-Guided Optimization for Uncertainty-Aware Medical Image Segmentation27 Jan 2026
- 2026Adaptive Conditional Contrast-Agnostic Deformable Image Registration with Uncertainty Estimation9 Jan 2026
- 2025Uncertainty Estimation for Pretrained Medical Image Registration Models via Transformation Equivariance27 Sep 2025
- 2025Learning Correlation-aware Aleatoric Uncertainty for 3D Hand Pose Estimation1 Sep 2025
- 2025Encoder-Only Image Registration30 Aug 2025
- 2025ETA: Energy-based Test-time Adaptation for Depth Completion8 Aug 2025
- 2025Extending Foundational Monocular Depth Estimators to Fisheye Cameras with Calibration Tokens6 Aug 2025
- 2025Uncertainty Quantification for Machine Learning in Healthcare: A Survey4 May 2025
- 2025Uncertainty Quantification for Machine Learning in Healthcare: A Surveycited by 11
- 2025Extending Foundational Monocular Depth Estimators to Fisheye Cameras with Calibration Tokenscited by 9
- 2025Adapting Vision Foundation Models for Real-time Ultrasound Image Segmentationcited by 8
- 2024Hierarchical Uncertainty Estimation for Learning-based Registration in Neuroimagingcited by 4
- 2025ETA: Energy-based Test-time Adaptation for Depth Completioncited by 4
- 2025Encoder-Only Image Registrationcited by 3
- 2025Uncertainty Estimation for Pretrained Medical Image Registration Models via Transformation Equivariancecited by 1
- 2026Triangular Consistency as a Universal Constraint for Learning Optical Flowcited by 1
- 2026VisTa3D: A Dataset and Benchmark for Thin Object Reconstruction from Vision, Tactile, and 3D Point Cloudscited by 1
- 2025Learning Correlation-aware Aleatoric Uncertainty for 3D Hand Pose Estimationcited by 0
- 2026Adaptive Conditional Contrast-Agnostic Deformable Image Registration with Uncertainty Estimationcited by 0
- 2026Pareto-Guided Optimization for Uncertainty-Aware Medical Image Segmentationcited by 0
12 most cited of 13 All 13 (JSON)
- 2026Recursive Uncertainty-Gated Image Registration for Learning-based Algorithms23 Sep 2026
- 2026VisTa3D: A Dataset and Benchmark for Thin Object Reconstruction from Vision, Tactile, and 3D Point Clouds21 Aug 2026
- 2026Triangular Consistency as a Universal Constraint for Learning Optical Flow18 Jun 2026
- 2026Pareto-Guided Optimization for Uncertainty-Aware Medical Image Segmentation27 Jan 2026
- 2026Adaptive Conditional Contrast-Agnostic Deformable Image Registration with Uncertainty Estimation9 Jan 2026
- 2025Uncertainty Estimation for Pretrained Medical Image Registration Models via Transformation Equivariance27 Sep 2025
- 2025Learning Correlation-aware Aleatoric Uncertainty for 3D Hand Pose Estimation1 Sep 2025
- 2025Encoder-Only Image Registration30 Aug 2025
- 2025ETA: Energy-based Test-time Adaptation for Depth Completion8 Aug 2025
- 2025Extending Foundational Monocular Depth Estimators to Fisheye Cameras with Calibration Tokens6 Aug 2025
- 2025Uncertainty Quantification for Machine Learning in Healthcare: A Survey4 May 2025
- 2025Adapting Vision Foundation Models for Real-time Ultrasound Image Segmentation31 Mar 2025
12 newest of 13 All 13 (JSON)