Reliable deep-learning-based phase imaging with uncertainty quantification
Not on the map. Why?
Abstract (arXiv)
Emerging deep-learning (DL)-based techniques have significant potential to revolutionize biomedical imaging. However, one outstanding challenge is the lack of reliability assessment in the DL predictions, whose errors are commonly revealed only in hindsight. Here, we propose a new Bayesian convolutional neural network (BNN)-based framework that overcomes this issue by quantifying the uncertainty of DL predictions. Foremost, we show that BNN-predicted uncertainty maps provide surrogate estimates of the true error from the network model and measurement itself. The uncertainty maps characterize imperfections often unknown in real-world applications, such as noise, model error, incomplete training data, and out-of-distribution testing data. Quantifying this uncertainty provides a per-pixel estimate of the confidence level of the DL prediction as well as the quality of the model and dataset. We demonstrate this framework in the application of large space-bandwidth product phase imaging using a physics-guided coded illumination scheme. From only five multiplexed illumination measurements, our BNN predicts gigapixel phase images in both static and dynamic biological samples with quantitative credibility assessment. Furthermore, we show that low-certainty regions can identify spatially and temporally rare biological phenomena. We believe our uncertainty learning framework is widely applicable to many DL-based biomedical imaging techniques for assessing the reliability of DL predictions.
Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Jan 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 6; 2023: 5; 2024: 5; 2025: 5; 2026: 1.
26 papers.
Sort:
By area:
- 2023On the use of deep learning for phase recoverycited by 20
- 2022Uncertainty Quantification for Deep Unrolling-Based Computational Imagingcited by 10
- 2024Task-Driven Uncertainty Quantification in Inverse Problems via Conformal Predictioncited by 8
- 2022Compressive Ptychography using Deep Image and Generative Priorscited by 5
- 2021Uncertainty quantification for ptychography using normalizing flowscited by 4
- 2023Cycle Consistency-based Uncertainty Quantification of Neural Networks in Inverse Imaging Problemscited by 4
- 2025Conformalized Generative Bayesian Imaging: An Uncertainty Quantification Framework for Computational Imagingcited by 4
- 2021Physical model simulator-trained neural network for computational 3D phase imaging of multiple-scattering samplescited by 3
- 2022Block Modulating Video Compression: An Ultra Low Complexity Image Compression Encoder for Resource Limited Platformscited by 3
- 2023Uncertainty-aware Grounded Action Transformation towards Sim-to-Real Transfer for Traffic Signal Controlcited by 3
- 2023Learned, uncertainty-driven adaptive acquisition for photon-efficient scanning microscopycited by 3
- 2024Neural Network-Based Processing and Reconstruction of Compromised Biophotonic Image Datacited by 3
14 more
- 2021Deep-learning-driven Reliable Single-pixel Imaging with Uncertainty Approximationcited by 2
- 2023Local Conditional Neural Fields for Versatile and Generalizable Large-Scale Reconstructions in Computational Imagingcited by 2
- 2025Conformal Bounds on Full-Reference Image Quality for Imaging Inverse Problemscited by 2
- 2022Differentiable Microscopy Designs an All Optical Phase Retrieval Microscopecited by 1
- 2022Density Regression and Uncertainty Quantification with Bayesian Deep Noise Neural Networkscited by 1
- 2024Deep learning phase recovery: data-driven, physics-driven, or combining both?cited by 1
- 2024Joint Segmentation and Image Reconstruction with Error Prediction in Photoacoustic Imaging using Deep Learningcited by 1
- 2025CameraVDP: Perceptual Display Assessment with Uncertainty Estimation via Camera and Visual Difference Predictioncited by 1
- 2026ShuffleFlow: Scalable Posterior Inference for Bayesian Inverse Imagingcited by 1
- 2021Blaschke Product Neural Networks (BPNN): A Physics-Infused Neural Network for Phase Retrieval of Meromorphic Functionscited by 0
- 2022A Deep Generative Approach to Oversampling in Ptychographycited by 0
- 2024General Intelligent Imaging and Uncertainty Quantification by Deterministic Diffusion Modelcited by 0
- 2025QUTCC: Quantile Uncertainty Training and Conformal Calibration for Imaging Inverse Problemscited by 0
- 2025Self-supervised physics-informed generative networks for phase retrieval from a single X-ray hologramcited by 0
- 2026ShuffleFlow: Scalable Posterior Inference for Bayesian Inverse Imaging19 Jun 2026
- 2025CameraVDP: Perceptual Display Assessment with Uncertainty Estimation via Camera and Visual Difference Prediction10 Sep 2025
- 2025Self-supervised physics-informed generative networks for phase retrieval from a single X-ray hologram21 Aug 2025
- 2025QUTCC: Quantile Uncertainty Training and Conformal Calibration for Imaging Inverse Problems19 Jul 2025
- 2025Conformal Bounds on Full-Reference Image Quality for Imaging Inverse Problems14 May 2025
- 2025Conformalized Generative Bayesian Imaging: An Uncertainty Quantification Framework for Computational Imaging10 Apr 2025
- 2024General Intelligent Imaging and Uncertainty Quantification by Deterministic Diffusion Model23 Aug 2024
- 2024Joint Segmentation and Image Reconstruction with Error Prediction in Photoacoustic Imaging using Deep Learning2 Jul 2024
- 2024Task-Driven Uncertainty Quantification in Inverse Problems via Conformal Prediction28 May 2024
- 2024Deep learning phase recovery: data-driven, physics-driven, or combining both?1 Apr 2024
- 2024Neural Network-Based Processing and Reconstruction of Compromised Biophotonic Image Data21 Mar 2024
- 2023Learned, uncertainty-driven adaptive acquisition for photon-efficient scanning microscopy24 Oct 2023
14 more
- 2023On the use of deep learning for phase recovery2 Aug 2023
- 2023Uncertainty-aware Grounded Action Transformation towards Sim-to-Real Transfer for Traffic Signal Control23 Jul 2023
- 2023Local Conditional Neural Fields for Versatile and Generalizable Large-Scale Reconstructions in Computational Imaging12 Jul 2023
- 2023Cycle Consistency-based Uncertainty Quantification of Neural Networks in Inverse Imaging Problems22 May 2023
- 2022A Deep Generative Approach to Oversampling in Ptychography28 Jul 2022
- 2022Uncertainty Quantification for Deep Unrolling-Based Computational Imaging2 Jul 2022
- 2022Density Regression and Uncertainty Quantification with Bayesian Deep Noise Neural Networks12 Jun 2022
- 2022Block Modulating Video Compression: An Ultra Low Complexity Image Compression Encoder for Resource Limited Platforms7 May 2022
- 2022Compressive Ptychography using Deep Image and Generative Priors5 May 2022
- 2022Differentiable Microscopy Designs an All Optical Phase Retrieval Microscope28 Mar 2022
- 2021Blaschke Product Neural Networks (BPNN): A Physics-Infused Neural Network for Phase Retrieval of Meromorphic Functions26 Nov 2021
- 2021Uncertainty quantification for ptychography using normalizing flows1 Nov 2021
- 2021Deep-learning-driven Reliable Single-pixel Imaging with Uncertainty Approximation24 Jul 2021
- 2021Physical model simulator-trained neural network for computational 3D phase imaging of multiple-scattering samples29 Mar 2021
- 2023On the use of deep learning for phase recoverycited by 20
- 2022Uncertainty Quantification for Deep Unrolling-Based Computational Imagingcited by 10
- 2024Task-Driven Uncertainty Quantification in Inverse Problems via Conformal Predictioncited by 8
- 2022Compressive Ptychography using Deep Image and Generative Priorscited by 5
- 2021Uncertainty quantification for ptychography using normalizing flowscited by 4
- 2023Cycle Consistency-based Uncertainty Quantification of Neural Networks in Inverse Imaging Problemscited by 4
- 2025Conformalized Generative Bayesian Imaging: An Uncertainty Quantification Framework for Computational Imagingcited by 4
- 2021Physical model simulator-trained neural network for computational 3D phase imaging of multiple-scattering samplescited by 3
- 2022Block Modulating Video Compression: An Ultra Low Complexity Image Compression Encoder for Resource Limited Platformscited by 3
- 2023Uncertainty-aware Grounded Action Transformation towards Sim-to-Real Transfer for Traffic Signal Controlcited by 3
- 2023Learned, uncertainty-driven adaptive acquisition for photon-efficient scanning microscopycited by 3
- 2024Neural Network-Based Processing and Reconstruction of Compromised Biophotonic Image Datacited by 3
12 most cited of 25 All 25 (JSON)
- 2026ShuffleFlow: Scalable Posterior Inference for Bayesian Inverse Imaging19 Jun 2026
- 2025CameraVDP: Perceptual Display Assessment with Uncertainty Estimation via Camera and Visual Difference Prediction10 Sep 2025
- 2025Self-supervised physics-informed generative networks for phase retrieval from a single X-ray hologram21 Aug 2025
- 2025QUTCC: Quantile Uncertainty Training and Conformal Calibration for Imaging Inverse Problems19 Jul 2025
- 2025Conformal Bounds on Full-Reference Image Quality for Imaging Inverse Problems14 May 2025
- 2025Conformalized Generative Bayesian Imaging: An Uncertainty Quantification Framework for Computational Imaging10 Apr 2025
- 2024Joint Segmentation and Image Reconstruction with Error Prediction in Photoacoustic Imaging using Deep Learning2 Jul 2024
- 2024Task-Driven Uncertainty Quantification in Inverse Problems via Conformal Prediction28 May 2024
- 2024Deep learning phase recovery: data-driven, physics-driven, or combining both?1 Apr 2024
- 2024Neural Network-Based Processing and Reconstruction of Compromised Biophotonic Image Data21 Mar 2024
- 2023Learned, uncertainty-driven adaptive acquisition for photon-efficient scanning microscopy24 Oct 2023
- 2023On the use of deep learning for phase recovery2 Aug 2023
12 newest of 25 All 25 (JSON)