Uncertainty-aware GAN with Adaptive Loss for Robust MRI Image Enhancement
Not on the map. Why?
Abstract (arXiv)
Image-to-image translation is an ill-posed problem as unique one-to-one mapping may not exist between the source and target images. Learning-based methods proposed in this context often evaluate the performance on test data that is similar to the training data, which may be impractical. This demands robust methods that can quantify uncertainty in the prediction for making informed decisions, especially for critical areas such as medical imaging. Recent works that employ conditional generative adversarial networks (GANs) have shown improved performance in learning photo-realistic image-to-image mappings between the source and the target images. However, these methods do not focus on (i)~robustness of the models to out-of-distribution (OOD)-noisy data and (ii)~uncertainty quantification. This paper proposes a GAN-based framework that (i)~models an adaptive loss function for robustness to OOD-noisy data that automatically tunes the spatially varying norm for penalizing the residuals and (ii)~estimates the per-voxel uncertainty in the predictions. We demonstrate our method on two key applications in medical imaging: (i)~undersampled magnetic resonance imaging (MRI) reconstruction (ii)~MRI modality propagation. Our experiments with two different real-world datasets show that the proposed method (i)~is robust to OOD-noisy test data and provides improved accuracy and (ii)~quantifies voxel-level uncertainty in the predictions.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 26 of its 47 references that are in the map. First posted on arXiv 7 Oct 2021.
Builds on
26 of 47 references.
References · 26
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,472
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2016Universal adversarial perturbationscited by 774
- 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
- 2017Unsupervised Image-to-Image Translation Networkscited by 602
- 2020Generalized ODIN: Detecting Out-of-distribution Image without Learning from Out-of-distribution Datacited by 408
14 more
- 2017Deep Learning for Medical Image Analysiscited by 399
- 2016NIPS 2016 Tutorial: Generative Adversarial Networkscited by 284
- 2018Aleatoric uncertainty estimation with test-time augmentation for medical image segmentation with convolutional neural networkscited by 278
- 2017A General and Adaptive Robust Loss Functioncited by 236
- 2017A Deep Cascade of Convolutional Neural Networks for Dynamic MR Image Reconstructioncited by 231
- 2018Exploring Uncertainty Measures in Deep Networks for Multiple Sclerosis Lesion Detection and Segmentationcited by 146
- 2018Image Synthesis in Multi-Contrast MRI with Conditional Generative Adversarial Networkscited by 131
- 2019Reducing Uncertainty in Undersampled MRI Reconstruction with Active Acquisitioncited by 55
- 2017Bayesian Image Quality Transfer with CNNs: Exploring Uncertainty in dMRI Super-Resolutioncited by 29
- 2021Towards Lower-Dose PET using Physics-Based Uncertainty-Aware Multimodal Learning with Robustness to Out-of-Distribution Datacited by 18
- 2019Robust Super-Resolution GAN, with Manifold-based and Perception Losscited by 15
- 2021A Mixed-Supervision Multilevel GAN Framework for Image Quality Enhancementcited by 11
- 2019Adversarial training with cycle consistency for unsupervised super-resolution in endomicroscopycited by 9
- 2016On the Empirical Effect of Gaussian Noise in Under-sampled MRI Reconstructioncited by 5
Built on by
Citing papers per year: 2021: 3; 2022: 2; 2023: 5; 2024: 1; 2025: 3; 2026: 1.
15 papers.
Sort:
By area:
- 2022BayesCap: Bayesian Identity Cap for Calibrated Uncertainty in Frozen Neural Networkscited by 23
- 2021Robustness via Uncertainty-aware Cycle Consistencycited by 16
- 2021Uncertainty-Aware Deep Co-training for Semi-supervised Medical Image Segmentationcited by 12
- 2023ProbVLM: Probabilistic Adapter for Frozen Vision-Language Modelscited by 7
- 2023USIM-DAL: Uncertainty-aware Statistical Image Modeling-based Dense Active Learning for Super-resolutioncited by 4
- 2023Likelihood Annealing: Fast Calibrated Uncertainty for Regressioncited by 3
- 2025Trustworthy image-to-image translation: evaluating uncertainty calibration in unpaired training scenarioscited by 3
- 2025SRSR: Enhancing Semantic Accuracy in Real-World Image Super-Resolution with Spatially Re-Focused Text-Conditioningcited by 3
- 2022Unsupervised Joint Image Transfer and Uncertainty Quantification Using Patch Invariant Networkscited by 2
- 2023Uncertainty Estimation in Contrast-Enhanced MR Image Translation with Multi-Axis Fusioncited by 2
- 2024Uncertainty-Aware Regularization for Image-to-Image Translationcited by 1
- 2021Dense Uncertainty Estimation via an Ensemble-based Conditional Latent Variable Modelcited by 0
3 more
- 2023Uncertainty-Driven Multi-Scale Feature Fusion Network for Real-time Image Derainingcited by 0
- 2025Uncertainty-aware Test-Time Training (UT3) for Efficient On-the-fly Domain Adaptive Dense Regressioncited by 0
- 2026Uncertainty-Aware Test-Time Adaptation for Cross-Region Spatio-Temporal Fusion of Land Surface Temperaturecited by 0
- 2026Uncertainty-Aware Test-Time Adaptation for Cross-Region Spatio-Temporal Fusion of Land Surface Temperature5 Apr 2026
- 2025SRSR: Enhancing Semantic Accuracy in Real-World Image Super-Resolution with Spatially Re-Focused Text-Conditioning26 Oct 2025
- 2025Uncertainty-aware Test-Time Training (UT3) for Efficient On-the-fly Domain Adaptive Dense Regression3 Sep 2025
- 2025Trustworthy image-to-image translation: evaluating uncertainty calibration in unpaired training scenarios29 Jan 2025
- 2024Uncertainty-Aware Regularization for Image-to-Image Translation24 Nov 2024
- 2023Uncertainty Estimation in Contrast-Enhanced MR Image Translation with Multi-Axis Fusion20 Nov 2023
- 2023Uncertainty-Driven Multi-Scale Feature Fusion Network for Real-time Image Deraining19 Jul 2023
- 2023ProbVLM: Probabilistic Adapter for Frozen Vision-Language Models1 Jul 2023
- 2023USIM-DAL: Uncertainty-aware Statistical Image Modeling-based Dense Active Learning for Super-resolution27 May 2023
- 2023Likelihood Annealing: Fast Calibrated Uncertainty for Regression21 Feb 2023
- 2022BayesCap: Bayesian Identity Cap for Calibrated Uncertainty in Frozen Neural Networks14 Jul 2022
- 2022Unsupervised Joint Image Transfer and Uncertainty Quantification Using Patch Invariant Networks9 Jul 2022
- 2022BayesCap: Bayesian Identity Cap for Calibrated Uncertainty in Frozen Neural Networkscited by 23
- 2021Robustness via Uncertainty-aware Cycle Consistencycited by 16
- 2021Uncertainty-Aware Deep Co-training for Semi-supervised Medical Image Segmentationcited by 12
- 2023USIM-DAL: Uncertainty-aware Statistical Image Modeling-based Dense Active Learning for Super-resolutioncited by 4
- 2023Likelihood Annealing: Fast Calibrated Uncertainty for Regressioncited by 3
- 2025Trustworthy image-to-image translation: evaluating uncertainty calibration in unpaired training scenarioscited by 3
- 2025SRSR: Enhancing Semantic Accuracy in Real-World Image Super-Resolution with Spatially Re-Focused Text-Conditioningcited by 3
- 2022Unsupervised Joint Image Transfer and Uncertainty Quantification Using Patch Invariant Networkscited by 2
- 2023Uncertainty Estimation in Contrast-Enhanced MR Image Translation with Multi-Axis Fusioncited by 2
- 2024Uncertainty-Aware Regularization for Image-to-Image Translationcited by 1
- 2021Dense Uncertainty Estimation via an Ensemble-based Conditional Latent Variable Modelcited by 0
- 2023Uncertainty-Driven Multi-Scale Feature Fusion Network for Real-time Image Derainingcited by 0
12 most cited of 14 All 14 (JSON)
- 2026Uncertainty-Aware Test-Time Adaptation for Cross-Region Spatio-Temporal Fusion of Land Surface Temperature5 Apr 2026
- 2025SRSR: Enhancing Semantic Accuracy in Real-World Image Super-Resolution with Spatially Re-Focused Text-Conditioning26 Oct 2025
- 2025Uncertainty-aware Test-Time Training (UT3) for Efficient On-the-fly Domain Adaptive Dense Regression3 Sep 2025
- 2025Trustworthy image-to-image translation: evaluating uncertainty calibration in unpaired training scenarios29 Jan 2025
- 2024Uncertainty-Aware Regularization for Image-to-Image Translation24 Nov 2024
- 2023Uncertainty Estimation in Contrast-Enhanced MR Image Translation with Multi-Axis Fusion20 Nov 2023
- 2023Uncertainty-Driven Multi-Scale Feature Fusion Network for Real-time Image Deraining19 Jul 2023
- 2023USIM-DAL: Uncertainty-aware Statistical Image Modeling-based Dense Active Learning for Super-resolution27 May 2023
- 2023Likelihood Annealing: Fast Calibrated Uncertainty for Regression21 Feb 2023
- 2022BayesCap: Bayesian Identity Cap for Calibrated Uncertainty in Frozen Neural Networks14 Jul 2022
- 2022Unsupervised Joint Image Transfer and Uncertainty Quantification Using Patch Invariant Networks9 Jul 2022
- 2021Uncertainty-Aware Deep Co-training for Semi-supervised Medical Image Segmentation23 Nov 2021
12 newest of 14 All 14 (JSON)