On the use of deep learning for phase recovery
Not on the map. Why?
Abstract (arXiv)
Phase recovery (PR) refers to calculating the phase of the light field from its intensity measurements. As exemplified from quantitative phase imaging and coherent diffraction imaging to adaptive optics, PR is essential for reconstructing the refractive index distribution or topography of an object and correcting the aberration of an imaging system. In recent years, deep learning (DL), often implemented through deep neural networks, has provided unprecedented support for computational imaging, leading to more efficient solutions for various PR problems. In this review, we first briefly introduce conventional methods for PR. Then, we review how DL provides support for PR from the following three stages, namely, pre-processing, in-processing, and post-processing. We also review how DL is used in phase image processing. Finally, we summarize the work in DL for PR and outlook on how to better use DL to improve the reliability and efficiency in PR. Furthermore, we present a live-updating resource (https://github.com/kqwang/phase-recovery) for readers to learn more about PR.
Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). Builds on 89 of its 377 references that are in the map. First posted on arXiv 2 Aug 2023.
Builds on
89 of 377 references.
References · 89
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
- 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,358
- 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,224
- 2017Deep Image Priorcited by 1,098
- 2021Multi-Stage Progressive Image Restorationcited by 816
- 2021A Survey of Uncertainty in Deep Neural Networkscited by 680
- 2017FFDNet: Toward a Fast and Flexible Solution for CNN based Image Denoisingcited by 510
- 2016Deep Convolutional Neural Network for Inverse Problems in Imagingcited by 433
38 more
- 2016The Little Engine that Could: Regularization by Denoising (RED)cited by 307
- 2018All-Optical Machine Learning Using Diffractive Deep Neural Networkscited by 177
- 2014Phase Retrieval via Wirtinger Flow: Theory and Algorithmscited by 125
- 2018Deep Decoder: Concise Image Representations from Untrained Non-convolutional Networkscited by 120
- 2020Photonics for artificial intelligence and neuromorphic computingcited by 112
- 2018Phase Retrieval Under a Generative Priorcited by 73
- 2017Phase recovery and holographic image reconstruction using deep learning in neural networkscited by 54
- 2018prDeep: Robust Phase Retrieval with a Flexible Deep Networkcited by 47
- 2017Lensless computational imaging through deep learningcited by 44
- 2018PhaseStain: Digital staining of label-free quantitative phase microscopy images using deep learningcited by 41
- 2019Algorithmic Guarantees for Inverse Imaging with Untrained Network Priorscited by 32
- 2016Solving Systems of Random Quadratic Equations via Truncated Amplitude Flowcited by 29
- 2019Reliable deep-learning-based phase imaging with uncertainty quantificationcited by 26
- 2018Low Photon Count Phase Retrieval Using Deep Learningcited by 24
- 2020Deep Phase Decoder: Self-calibrating phase microscopy with an untrained deep neural networkcited by 24
- 2017Shape Inpainting using 3D Generative Adversarial Network and Recurrent Convolutional Networkscited by 23
- 2022Diffractive all-optical computing for quantitative phase imagingcited by 22
- 2022To image, or not to image: Class-specific diffractive cameras with all-optical erasure of undesired objectscited by 21
- 2021Computational Imaging Without a Computer: Seeing Through Random Diffusers at the Speed of Lightcited by 19
- 2018Physics-based Learned Design: Optimized Coded-Illumination for Quantitative Phase Imagingcited by 18
- 2019Alternating Phase Projected Gradient Descent with Generative Priors for Solving Compressive Phase Retrievalcited by 18
- 2019Data-Driven Design for Fourier Ptychographic Microscopycited by 18
- 2021AutoPhaseNN: Unsupervised Physics-aware Deep Learning of 3D Nanoscale Bragg Coherent Diffraction Imagingcited by 18
- 2022Fourier Imager Network (FIN): A deep neural network for hologram reconstruction with superior external generalizationcited by 18
- 2018Real-time coherent diffraction inversion using deep generative networkscited by 17
- 2018Cross-modality deep learning brings bright-field microscopy contrast to holographycited by 17
- 2019Learning to Synthesize: Robust Phase Retrieval at Low Photon countscited by 16
- 2019Diffraction tomography with a deep image priorcited by 15
- 2019Deep Iterative Reconstruction for Phase Retrievalcited by 14
- 2022Self-supervised learning of hologram reconstruction using physics consistencycited by 14
- 2020Early-detection and classification of live bacteria using time-lapse coherent imaging and deep learningcited by 13
- 2020Phase Imaging with Computational Specificity (PICS) for measuring dry mass changes in sub-cellular compartmentscited by 13
- 2019Online Regularization by Denoising with Applications to Phase Retrievalcited by 12
- 2021Computer-free, all-optical reconstruction of holograms using diffractive networkscited by 12
- 2021Holographic image reconstruction with phase recovery and autofocusing using recurrent neural networkscited by 10
- 2023Quantitative phase imaging (QPI) through random diffusers using a diffractive optical networkcited by 10
- 2018Illumination Pattern Design with Deep Learning for Single-Shot Fourier Ptychographic Microscopycited by 9
- 2020Inverse Problems, Deep Learning, and Symmetry Breakingcited by 8
50 most cited of 89 All 89 (JSON)
Built on by
Citing papers per year: 2023: 1; 2024: 7; 2025: 8; 2026: 4.
20 papers.
Sort:
By area:
- 2024All-optical complex field imaging using diffractive processorscited by 2
- 2025DDRM-PR: Fourier Phase Retrieval using Denoising Diffusion Restoration Modelscited by 2
- 2024Low-light phase retrieval with implicit generative priorscited by 1
- 2024Single Exposure Quantitative Phase Imaging with a Conventional Microscope using Diffusion Modelscited by 1
- 2024Single-shot reconstruction of three-dimensional morphology of biological cells in digital holographic microscopy using a physics-driven neural networkcited by 1
- 2025Towards generalizable deep ptychography neural networkscited by 1
- 2025RamPINN: Recovering Raman Spectra From Coherent Anti-Stokes Spectra Using Embedded Physicscited by 1
- 2026Circular Phase Representation and Geometry-Aware Optimization for Ptychographic Image Reconstructioncited by 1
- 2023Single-shot Phase Retrieval from a Fractional Fourier Transform Perspectivecited by 0
- 2024Res-U2Net: Untrained Deep Learning for Phase Retrieval and Image Reconstructioncited by 0
- 2024Artificial intelligence inspired freeform optics design: a reviewcited by 0
- 2024Single-Shot Phase Diversity Wavefront Sensing in Deep Turbulence via Metasurface Opticscited by 0
8 more
- 2025GUSLO: General and Unified Structured Light Optimizationcited by 0
- 2025Towards Robust and Generalizable Gerchberg Saxton based Physics Inspired Neural Networks for Computer Generated Holography: A Sensitivity Analysis Frameworkcited by 0
- 2025prNet: Data-Driven Phase Retrieval via Stochastic Refinementcited by 0
- 2025I2I-PR: Deep Iterative Refinement for Phase Retrieval using Image-to-Image Diffusion Modelscited by 0
- 2025Self-supervised physics-informed generative networks for phase retrieval from a single X-ray hologramcited by 0
- 2026Pupil Design for Computational Wavefront Estimationcited by 0
- 2026Contrast-invariant deep ptychography neural networkscited by 0
- 2026Real-Time Atomic-Resolution Electron Phase Imaging without Probe Calibration via Ptychography-Supervised Learningcited by 0
- 2026Real-Time Atomic-Resolution Electron Phase Imaging without Probe Calibration via Ptychography-Supervised Learning22 Sep 2026
- 2026Contrast-invariant deep ptychography neural networks3 Aug 2026
- 2026Circular Phase Representation and Geometry-Aware Optimization for Ptychographic Image Reconstruction29 Apr 2026
- 2026Pupil Design for Computational Wavefront Estimation31 Mar 2026
- 2025RamPINN: Recovering Raman Spectra From Coherent Anti-Stokes Spectra Using Embedded Physics7 Oct 2025
- 2025Towards generalizable deep ptychography neural networks29 Sep 2025
- 2025Self-supervised physics-informed generative networks for phase retrieval from a single X-ray hologram21 Aug 2025
- 2025I2I-PR: Deep Iterative Refinement for Phase Retrieval using Image-to-Image Diffusion Models13 Jul 2025
- 2025prNet: Data-Driven Phase Retrieval via Stochastic Refinement13 Jul 2025
- 2025Towards Robust and Generalizable Gerchberg Saxton based Physics Inspired Neural Networks for Computer Generated Holography: A Sensitivity Analysis Framework30 Apr 2025
- 2025GUSLO: General and Unified Structured Light Optimization24 Jan 2025
- 2025DDRM-PR: Fourier Phase Retrieval using Denoising Diffusion Restoration Models6 Jan 2025
8 more
- 2024Single-Shot Phase Diversity Wavefront Sensing in Deep Turbulence via Metasurface Optics24 Oct 2024
- 2024Single-shot reconstruction of three-dimensional morphology of biological cells in digital holographic microscopy using a physics-driven neural network30 Sep 2024
- 2024Artificial intelligence inspired freeform optics design: a review18 Sep 2024
- 2024Single Exposure Quantitative Phase Imaging with a Conventional Microscope using Diffusion Models6 Jun 2024
- 2024Res-U2Net: Untrained Deep Learning for Phase Retrieval and Image Reconstruction9 Apr 2024
- 2024Low-light phase retrieval with implicit generative priors27 Feb 2024
- 2024All-optical complex field imaging using diffractive processors30 Jan 2024
- 2023Single-shot Phase Retrieval from a Fractional Fourier Transform Perspective18 Nov 2023
- 2025DDRM-PR: Fourier Phase Retrieval using Denoising Diffusion Restoration Modelscited by 2
- 2024Single Exposure Quantitative Phase Imaging with a Conventional Microscope using Diffusion Modelscited by 1
- 2025I2I-PR: Deep Iterative Refinement for Phase Retrieval using Image-to-Image Diffusion Modelscited by 0
- 2025I2I-PR: Deep Iterative Refinement for Phase Retrieval using Image-to-Image Diffusion Models13 Jul 2025
- 2025DDRM-PR: Fourier Phase Retrieval using Denoising Diffusion Restoration Models6 Jan 2025
- 2024Single Exposure Quantitative Phase Imaging with a Conventional Microscope using Diffusion Models6 Jun 2024
- 2024All-optical complex field imaging using diffractive processorscited by 2
- 2024Low-light phase retrieval with implicit generative priorscited by 1
- 2024Single-shot reconstruction of three-dimensional morphology of biological cells in digital holographic microscopy using a physics-driven neural networkcited by 1
- 2025Towards generalizable deep ptychography neural networkscited by 1
- 2025RamPINN: Recovering Raman Spectra From Coherent Anti-Stokes Spectra Using Embedded Physicscited by 1
- 2026Circular Phase Representation and Geometry-Aware Optimization for Ptychographic Image Reconstructioncited by 1
- 2023Single-shot Phase Retrieval from a Fractional Fourier Transform Perspectivecited by 0
- 2024Res-U2Net: Untrained Deep Learning for Phase Retrieval and Image Reconstructioncited by 0
- 2024Artificial intelligence inspired freeform optics design: a reviewcited by 0
- 2024Single-Shot Phase Diversity Wavefront Sensing in Deep Turbulence via Metasurface Opticscited by 0
- 2025GUSLO: General and Unified Structured Light Optimizationcited by 0
- 2025Towards Robust and Generalizable Gerchberg Saxton based Physics Inspired Neural Networks for Computer Generated Holography: A Sensitivity Analysis Frameworkcited by 0
12 most cited of 17 All 17 (JSON)
- 2026Real-Time Atomic-Resolution Electron Phase Imaging without Probe Calibration via Ptychography-Supervised Learning22 Sep 2026
- 2026Contrast-invariant deep ptychography neural networks3 Aug 2026
- 2026Circular Phase Representation and Geometry-Aware Optimization for Ptychographic Image Reconstruction29 Apr 2026
- 2026Pupil Design for Computational Wavefront Estimation31 Mar 2026
- 2025RamPINN: Recovering Raman Spectra From Coherent Anti-Stokes Spectra Using Embedded Physics7 Oct 2025
- 2025Towards generalizable deep ptychography neural networks29 Sep 2025
- 2025Self-supervised physics-informed generative networks for phase retrieval from a single X-ray hologram21 Aug 2025
- 2025prNet: Data-Driven Phase Retrieval via Stochastic Refinement13 Jul 2025
- 2025Towards Robust and Generalizable Gerchberg Saxton based Physics Inspired Neural Networks for Computer Generated Holography: A Sensitivity Analysis Framework30 Apr 2025
- 2025GUSLO: General and Unified Structured Light Optimization24 Jan 2025
- 2024Single-Shot Phase Diversity Wavefront Sensing in Deep Turbulence via Metasurface Optics24 Oct 2024
- 2024Single-shot reconstruction of three-dimensional morphology of biological cells in digital holographic microscopy using a physics-driven neural network30 Sep 2024
12 newest of 17 All 17 (JSON)