PixCUE: Joint Uncertainty Estimation and Image Reconstruction in MRI using Deep Pixel Classification
Not on the map. Why?
Abstract (arXiv)
Deep learning (DL) models are capable of successfully exploiting latent representations in MR data and have become state-of-the-art for accelerated MRI reconstruction. However, undersampling the measurements in k-space as well as the over- or under-parameterized and non-transparent nature of DL make these models exposed to uncertainty. Consequently, uncertainty estimation has become a major issue in DL MRI reconstruction. To estimate uncertainty, Monte Carlo (MC) inference techniques have become a common practice where multiple reconstructions are utilized to compute the variance in reconstruction as a measurement of uncertainty. However, these methods demand high computational costs as they require multiple inferences through the DL model. To this end, we introduce a method to estimate uncertainty during MRI reconstruction using a pixel classification framework. The proposed method, PixCUE (stands for Pixel Classification Uncertainty Estimation) produces the reconstructed image along with an uncertainty map during a single forward pass through the DL model. We demonstrate that this approach generates uncertainty maps that highly correlate with the reconstruction errors with respect to various MR imaging sequences and under numerous adversarial conditions. We also show that the estimated uncertainties are correlated to that of the conventional MC method. We further provide an empirical relationship between the uncertainty estimations using PixCUE and well-established reconstruction metrics such as NMSE, PSNR, and SSIM. We conclude that PixCUE is capable of reliably estimating the uncertainty in MRI reconstruction with a minimum additional computational cost.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 34 of its 79 references that are in the map. First posted on arXiv 28 Feb 2023.
Builds on
34 of 79 references.
References · 34
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2016Variational Inference: A Review for Statisticianscited by 1,466
- 2021A Survey of Uncertainty in Deep Neural Networkscited by 675
- 2018fastMRI: An Open Dataset and Benchmarks for Accelerated MRIcited by 464
- 2016Deep Convolutional Neural Network for Inverse Problems in Imagingcited by 431
- 2017MoDL: Model Based Deep Learning Architecture for Inverse Problemscited by 384
- 2017Learning a Variational Network for Reconstruction of Accelerated MRI Datacited by 340
- 2021What Are Bayesian Neural Network Posteriors Really Like?cited by 307
- 2018Analyzing Inverse Problems with Invertible Neural Networkscited by 239
- 2017A Deep Cascade of Convolutional Neural Networks for Dynamic MR Image Reconstructioncited by 231
22 more
- 2017Image reconstruction by domain transform manifold learningcited by 231
- 2019On instabilities of deep learning in image reconstruction - Does AI come at a cost?cited by 211
- 2020End-to-End Variational Networks for Accelerated MRI Reconstructioncited by 201
- 2015Bayesian Convolutional Neural Networks with Bernoulli Approximate Variational Inferencecited by 159
- 2017Compressed Sensing MRI Reconstruction using a Generative Adversarial Network with a Cyclic Losscited by 82
- 2019Deep Learning Methods for Parallel Magnetic Resonance Image Reconstructioncited by 81
- 2017A Deep Cascade of Convolutional Neural Networks for MR Image Reconstructioncited by 74
- 2022Swin Transformer for Fast MRIcited by 56
- 2019Reducing Uncertainty in Undersampled MRI Reconstruction with Active Acquisitioncited by 55
- 2019Uncertainty Quantification in Deep MRI Reconstructioncited by 49
- 2022Bayesian MRI Reconstruction with Joint Uncertainty Estimation using Diffusion Modelscited by 46
- 2021Bayesian Uncertainty Estimation of Learned Variational MRI Reconstructioncited by 30
- 2020Deep learning for fast MR imaging: a review for learning reconstruction from incomplete k-space datacited by 24
- 2021Conditional Invertible Neural Networks for Medical Imagingcited by 19
- 2021Towards Lower-Dose PET using Physics-Based Uncertainty-Aware Multimodal Learning with Robustness to Out-of-Distribution Datacited by 18
- 2019Dual-domain Cascade of U-nets for Multi-channel Magnetic Resonance Image Reconstructioncited by 12
- 2017Towards Understanding the Invertibility of Convolutional Neural Networkscited by 10
- 2021Accelerating Quantitative Susceptibility Mapping using Compressed Sensing and Deep Neural Networkcited by 8
- 2022Multi-branch Cascaded Swin Transformers with Attention to k-space Sampling Pattern for Accelerated MRI Reconstructioncited by 4
- 2020SUREMap: Predicting Uncertainty in CNN-based Image Reconstruction Using Stein's Unbiased Risk Estimatecited by 3
- 2014Multichannel Compressive Sensing MRI Using Noiselet Encodingcited by 2
- 20223D-EPI Blip-Up/Down Acquisition (BUDA) with CAIPI and Joint Hankel Structured Low-Rank Reconstruction for Rapid Distortion-Free High-Resolution T2* Mappingcited by 2
Built on by
Citing papers per year: 2026: 3.
3 papers.