Phase recovery and holographic image reconstruction using deep learning in neural networks
Not on the map. Why?
Abstract (arXiv)
Phase recovery from intensity-only measurements forms the heart of coherent imaging techniques and holography. Here we demonstrate that a neural network can learn to perform phase recovery and holographic image reconstruction after appropriate training. This deep learning-based approach provides an entirely new framework to conduct holographic imaging by rapidly eliminating twin-image and self-interference related spatial artifacts. Compared to existing approaches, this neural network based method is significantly faster to compute, and reconstructs improved phase and amplitude images of the objects using only one hologram, i.e., requires less number of measurements in addition to being computationally faster. We validated this method by reconstructing phase and amplitude images of various samples, including blood and Pap smears, and tissue sections. These results are broadly applicable to any phase recovery problem, and highlight that through machine learning challenging problems in imaging science can be overcome, providing new avenues to design powerful computational imaging systems.
Key facts. Cited by 54 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 May 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 14; 2022: 11; 2023: 8; 2024: 13; 2025: 5; 2026: 3.
54 papers.
Sort:
By area:
- 2023Physics-Informed Computer Vision: A Review and Perspectivescited by 28
- 2022Diffractive all-optical computing for quantitative phase imagingcited by 22
- 2023On the use of deep learning for phase recoverycited by 20
- 2021AutoPhaseNN: Unsupervised Physics-aware Deep Learning of 3D Nanoscale Bragg Coherent Diffraction Imagingcited by 18
- 2022Fourier Imager Network (FIN): A deep neural network for hologram reconstruction with superior external generalizationcited by 18
- 2022Self-supervised learning of hologram reconstruction using physics consistencycited by 14
- 2021FUTURE-AI: Guiding Principles and Consensus Recommendations for Trustworthy Artificial Intelligence in Medical Imagingcited by 13
- 2021Holographic image reconstruction with phase recovery and autofocusing using recurrent neural networkscited by 10
- 2023Multispectral Quantitative Phase Imaging Using a Diffractive Optical Networkcited by 10
- 2023eFIN: Enhanced Fourier Imager Network for generalizable autofocusing and pixel super-resolution in holographic imagingcited by 8
- 2022Few-shot Transfer Learning for Holographic Image Reconstruction using a Recurrent Neural Networkcited by 7
- 2021Neural network-based image reconstruction in swept-source optical coherence tomography using undersampled spectral datacited by 6
38 more
- 2022Diffractive Interconnects: All-Optical Permutation Operation Using Diffractive Networkscited by 6
- 2022Rapid and stain-free quantification of viral plaque via lens-free holography and deep learningcited by 6
- 2021Uncertainty quantification for ptychography using normalizing flowscited by 4
- 2021Phase Retrieval using Expectation Consistent Signal Recovery Algorithm based on Hypernetworkcited by 3
- 2021Physical model simulator-trained neural network for computational 3D phase imaging of multiple-scattering samplescited by 3
- 2021SPI-GAN: Towards Single-Pixel Imaging through Generative Adversarial Networkcited by 3
- 2021Hformer: Hybrid CNN-Transformer for Fringe Order Prediction in Phase Unwrapping of Fringe Projectioncited by 3
- 2022Fast Autofocusing using Tiny Transformer Networks for Digital Holographic Microscopycited by 3
- 2023Stochastic Light Field Holographycited by 3
- 2024Predicting ptychography probe positions using single-shot phase retrieval neural networkcited by 3
- 2021Deep-learning-driven Reliable Single-pixel Imaging with Uncertainty Approximationcited by 2
- 2022Physics-informed neural networks for diffraction tomographycited by 2
- 2023Local Conditional Neural Fields for Versatile and Generalizable Large-Scale Reconstructions in Computational Imagingcited by 2
- 2023CrysFormer: Protein Structure Prediction via 3d Patterson Maps and Partial Structure Attentioncited by 2
- 2024All-optical complex field imaging using diffractive processorscited by 2
- 2024Multiplane Quantitative Phase Imaging Using a Wavelength-Multiplexed Diffractive Optical Processorcited by 2
- 2024Hybrid deep learning and physics-based neural network for programmable illumination computational microscopycited by 2
- 2024Fast and Robust Phase Retrieval via Deep Expectation-Consistent Approximationcited by 2
- 2022Differentiable Microscopy Designs an All Optical Phase Retrieval Microscopecited by 1
- 2023SimPINNs: Simulation-Driven Physics-Informed Neural Networks for Enhanced Performance in Nonlinear Inverse Problemscited by 1
- 2024Low-light phase retrieval with implicit generative priorscited by 1
- 2024Enhancing Digital Hologram Reconstruction Using Reverse-Attention Loss for Untrained Physics-Driven Deep Learning Models with Uncertain Distancecited by 1
- 2024Deep learning phase recovery: data-driven, physics-driven, or combining both?cited by 1
- 2024Joint Segmentation and Image Reconstruction with Error Prediction in Photoacoustic Imaging using Deep Learningcited by 1
- 2024Single-shot reconstruction of three-dimensional morphology of biological cells in digital holographic microscopy using a physics-driven neural networkcited by 1
- 2021Advances in Electron Microscopy with Deep Learningcited by 0
- 2021Dynamic imaging and characterization of volatile aerosols in e-cigarette emissions using deep learning-based holographic microscopycited by 0
- 2021Fast Computational Ghost Imaging using Unpaired Deep Learning and a Constrained Generative Adversarial Networkcited by 0
- 2021Lensless multicore-fiber microendoscope for real-time tailored light field generation with phase encoder neural network (CoreNet)cited by 0
- 2022DH-GAN: A Physics-driven Untrained Generative Adversarial Network for 3D Microscopic Imaging using Digital Holographycited by 0
- 2022Virtual impactor-based label-free bio-aerosol detection using holography and deep learningcited by 0
- 20243D-2D Neural Nets for Phase Retrieval in Noisy Interferometric Imagingcited by 0
- 2024Physics-informed generative real-time lens-free imagingcited by 0
- 2024UMSPU: Universal Multi-Size Phase Unwrapping via Mutual Self-Distillation and Adaptive Boosting Ensemble Segmenterscited by 0
- 2025PtyGenography: using generative models for regularization of the phase retrieval problemcited by 0
- 2025RecCrysFormer: Refined Protein Structural Prediction from 3D Patterson Maps via Recycling Training Runscited by 0
- 2025DiffPR: Diffusion-Based Phase Reconstruction via Frequency-Decoupled Learningcited by 0
- 2025Self-supervised physics-informed generative networks for phase retrieval from a single X-ray hologramcited by 0
50 most cited of 54 All 54 (JSON)
- 2026Reconstructed holograms and explanation-aware evaluation for low-cost computational pollen analysis in veterinary cytology19 Sep 2026
- 2026Photonic AI: A Hybrid Diffractive Holographic Neural System for Passive Optical Real-Time Image Classification14 Apr 2026
- 2026A unified self-supervised framework for single-frame Fresnel CDI and overlapped ptychography24 Feb 2026
- 2025Generalizable Holographic Reconstruction via Amplitude-Only Diffusion Priors16 Sep 2025
- 2025Self-supervised physics-informed generative networks for phase retrieval from a single X-ray hologram21 Aug 2025
- 2025DiffPR: Diffusion-Based Phase Reconstruction via Frequency-Decoupled Learning12 Jun 2025
- 2025RecCrysFormer: Refined Protein Structural Prediction from 3D Patterson Maps via Recycling Training Runs28 Feb 2025
- 2025PtyGenography: using generative models for regularization of the phase retrieval problem3 Feb 2025
- 2024UMSPU: Universal Multi-Size Phase Unwrapping via Mutual Self-Distillation and Adaptive Boosting Ensemble Segmenters7 Dec 2024
- 2024Single-shot reconstruction of three-dimensional morphology of biological cells in digital holographic microscopy using a physics-driven neural network30 Sep 2024
- 2024Fast and Robust Phase Retrieval via Deep Expectation-Consistent Approximation12 Jul 2024
- 2024Joint Segmentation and Image Reconstruction with Error Prediction in Photoacoustic Imaging using Deep Learning2 Jul 2024
38 more
- 2024Predicting ptychography probe positions using single-shot phase retrieval neural network31 May 2024
- 2024Deep learning phase recovery: data-driven, physics-driven, or combining both?1 Apr 2024
- 2024Multiplane Quantitative Phase Imaging Using a Wavelength-Multiplexed Diffractive Optical Processor16 Mar 2024
- 2024Physics-informed generative real-time lens-free imaging12 Mar 2024
- 2024Low-light phase retrieval with implicit generative priors27 Feb 2024
- 20243D-2D Neural Nets for Phase Retrieval in Noisy Interferometric Imaging8 Feb 2024
- 2024All-optical complex field imaging using diffractive processors30 Jan 2024
- 2024Hybrid deep learning and physics-based neural network for programmable illumination computational microscopy17 Jan 2024
- 2024Enhancing Digital Hologram Reconstruction Using Reverse-Attention Loss for Untrained Physics-Driven Deep Learning Models with Uncertain Distance11 Jan 2024
- 2023CrysFormer: Protein Structure Prediction via 3d Patterson Maps and Partial Structure Attention5 Oct 2023
- 2023SimPINNs: Simulation-Driven Physics-Informed Neural Networks for Enhanced Performance in Nonlinear Inverse Problems27 Sep 2023
- 2023Multispectral Quantitative Phase Imaging Using a Diffractive Optical Network5 Aug 2023
- 2023On the use of deep learning for phase recovery2 Aug 2023
- 2023Stochastic Light Field Holography12 Jul 2023
- 2023Local Conditional Neural Fields for Versatile and Generalizable Large-Scale Reconstructions in Computational Imaging12 Jul 2023
- 2023Physics-Informed Computer Vision: A Review and Perspectives29 May 2023
- 2023eFIN: Enhanced Fourier Imager Network for generalizable autofocusing and pixel super-resolution in holographic imaging9 Jan 2023
- 2022Self-supervised learning of hologram reconstruction using physics consistency17 Sep 2022
- 2022Virtual impactor-based label-free bio-aerosol detection using holography and deep learning30 Aug 2022
- 2022Physics-informed neural networks for diffraction tomography28 Jul 2022
- 2022Rapid and stain-free quantification of viral plaque via lens-free holography and deep learning30 Jun 2022
- 2022Diffractive Interconnects: All-Optical Permutation Operation Using Diffractive Networks21 Jun 2022
- 2022DH-GAN: A Physics-driven Untrained Generative Adversarial Network for 3D Microscopic Imaging using Digital Holography25 May 2022
- 2022Fourier Imager Network (FIN): A deep neural network for hologram reconstruction with superior external generalization22 Apr 2022
- 2022Differentiable Microscopy Designs an All Optical Phase Retrieval Microscope28 Mar 2022
- 2022Fast Autofocusing using Tiny Transformer Networks for Digital Holographic Microscopy15 Mar 2022
- 2022Few-shot Transfer Learning for Holographic Image Reconstruction using a Recurrent Neural Network27 Jan 2022
- 2022Diffractive all-optical computing for quantitative phase imaging22 Jan 2022
- 2021Hformer: Hybrid CNN-Transformer for Fringe Order Prediction in Phase Unwrapping of Fringe Projection13 Dec 2021
- 2021Lensless multicore-fiber microendoscope for real-time tailored light field generation with phase encoder neural network (CoreNet)24 Nov 2021
- 2021Uncertainty quantification for ptychography using normalizing flows1 Nov 2021
- 2021AutoPhaseNN: Unsupervised Physics-aware Deep Learning of 3D Nanoscale Bragg Coherent Diffraction Imaging28 Sep 2021
- 2021FUTURE-AI: Guiding Principles and Consensus Recommendations for Trustworthy Artificial Intelligence in Medical Imaging20 Sep 2021
- 2021Deep-learning-driven Reliable Single-pixel Imaging with Uncertainty Approximation24 Jul 2021
- 2021SPI-GAN: Towards Single-Pixel Imaging through Generative Adversarial Network3 Jul 2021
- 2021Fast Computational Ghost Imaging using Unpaired Deep Learning and a Constrained Generative Adversarial Network9 Jun 2021
- 2021Dynamic imaging and characterization of volatile aerosols in e-cigarette emissions using deep learning-based holographic microscopy31 Mar 2021
- 2021Physical model simulator-trained neural network for computational 3D phase imaging of multiple-scattering samples29 Mar 2021
50 newest of 54 All 54 (JSON)
- 2023Physics-Informed Computer Vision: A Review and Perspectivescited by 28
- 2022Diffractive all-optical computing for quantitative phase imagingcited by 22
- 2023On the use of deep learning for phase recoverycited by 20
- 2021AutoPhaseNN: Unsupervised Physics-aware Deep Learning of 3D Nanoscale Bragg Coherent Diffraction Imagingcited by 18
- 2022Fourier Imager Network (FIN): A deep neural network for hologram reconstruction with superior external generalizationcited by 18
- 2022Self-supervised learning of hologram reconstruction using physics consistencycited by 14
- 2021FUTURE-AI: Guiding Principles and Consensus Recommendations for Trustworthy Artificial Intelligence in Medical Imagingcited by 13
- 2021Holographic image reconstruction with phase recovery and autofocusing using recurrent neural networkscited by 10
- 2023Multispectral Quantitative Phase Imaging Using a Diffractive Optical Networkcited by 10
- 2023eFIN: Enhanced Fourier Imager Network for generalizable autofocusing and pixel super-resolution in holographic imagingcited by 8
- 2022Few-shot Transfer Learning for Holographic Image Reconstruction using a Recurrent Neural Networkcited by 7
- 2021Neural network-based image reconstruction in swept-source optical coherence tomography using undersampled spectral datacited by 6
12 most cited of 52 All 52 (JSON)
- 2026Reconstructed holograms and explanation-aware evaluation for low-cost computational pollen analysis in veterinary cytology19 Sep 2026
- 2026Photonic AI: A Hybrid Diffractive Holographic Neural System for Passive Optical Real-Time Image Classification14 Apr 2026
- 2026A unified self-supervised framework for single-frame Fresnel CDI and overlapped ptychography24 Feb 2026
- 2025Self-supervised physics-informed generative networks for phase retrieval from a single X-ray hologram21 Aug 2025
- 2025RecCrysFormer: Refined Protein Structural Prediction from 3D Patterson Maps via Recycling Training Runs28 Feb 2025
- 2025PtyGenography: using generative models for regularization of the phase retrieval problem3 Feb 2025
- 2024UMSPU: Universal Multi-Size Phase Unwrapping via Mutual Self-Distillation and Adaptive Boosting Ensemble Segmenters7 Dec 2024
- 2024Single-shot reconstruction of three-dimensional morphology of biological cells in digital holographic microscopy using a physics-driven neural network30 Sep 2024
- 2024Fast and Robust Phase Retrieval via Deep Expectation-Consistent Approximation12 Jul 2024
- 2024Joint Segmentation and Image Reconstruction with Error Prediction in Photoacoustic Imaging using Deep Learning2 Jul 2024
- 2024Predicting ptychography probe positions using single-shot phase retrieval neural network31 May 2024
- 2024Deep learning phase recovery: data-driven, physics-driven, or combining both?1 Apr 2024
12 newest of 52 All 52 (JSON)