Data-Driven Design for Fourier Ptychographic Microscopy
Not on the map. Why?
Abstract (arXiv)
Fourier Ptychographic Microscopy (FPM) is a computational imaging method that is able to super-resolve features beyond the diffraction-limit set by the objective lens of a traditional microscope. This is accomplished by using synthetic aperture and phase retrieval algorithms to combine many measurements captured by an LED array microscope with programmable source patterns. FPM provides simultaneous large field-of-view and high resolution imaging, but at the cost of reduced temporal resolution, thereby limiting live cell applications. In this work, we learn LED source pattern designs that compress the many required measurements into only a few, with negligible loss in reconstruction quality or resolution. This is accomplished by recasting the super-resolution reconstruction as a Physics-based Neural Network and learning the experimental design to optimize the network's overall performance. Specifically, we learn LED patterns for different applications (e.g. amplitude contrast and quantitative phase imaging) and show that the designs we learn through simulation generalize well in the experimental setting. Further, we discuss a context-specific loss function, practical memory limitations, and interpretability of our learned designs.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 6; 2023: 2; 2024: 4; 2025: 1.
18 papers.
Sort:
- 2023On the use of deep learning for phase recoverycited by 20
- 2021Time-Multiplexed Coded Aperture Imaging: Learned Coded Aperture and Pixel Exposures for Compressive Imaging Systemscited by 15
- 2021End-to-End Sequential Sampling and Reconstruction for MRIcited by 13
- 2023Thin On-Sensor Nanophotonic Array Camerascited by 13
- 2022Learning Spatially Varying Pixel Exposures for Motion Deblurringcited by 12
- 2022Physics vs. Learned Priors: Rethinking Camera and Algorithm Design for Task-Specific Imagingcited by 6
- 2021Adaptive Illumination based Depth Sensing using Deep Superpixel and Soft Sampling Approximationcited by 2
- 2021Differentiable model-based adaptive optics for two-photon microscopycited by 2
- 2022Resource-Efficient Invariant Networks: Exponential Gains by Unrolled Optimizationcited by 2
- 2022LWGNet: Learned Wirtinger Gradients for Fourier Ptychographic Phase Retrievalcited by 2
- 2024Hybrid deep learning and physics-based neural network for programmable illumination computational microscopycited by 2
- 2021Joint Optimization of Hadamard Sensing and Reconstruction in Compressed Sensing Fluorescence Microscopycited by 1
6 more
- 2022Differentiable Microscopy Designs an All Optical Phase Retrieval Microscopecited by 1
- 2022Differentiable Microscopy for Content and Task Aware Compressive Fluorescence Imagingcited by 1
- 2024Integration of Programmable Diffraction with Digital Neural Networkscited by 1
- 2024Latent Space Imagingcited by 1
- 2025Direct Image Classification from Fourier Ptychographic Microscopy Measurements without Reconstructioncited by 1
- 2024Batch-FPM: Random batch-update multi-parameter physical Fourier ptychography neural networkcited by 0
- 2025Direct Image Classification from Fourier Ptychographic Microscopy Measurements without Reconstruction8 May 2025
- 2024Batch-FPM: Random batch-update multi-parameter physical Fourier ptychography neural network25 Aug 2024
- 2024Latent Space Imaging9 Jul 2024
- 2024Integration of Programmable Diffraction with Digital Neural Networks15 Jun 2024
- 2024Hybrid deep learning and physics-based neural network for programmable illumination computational microscopy17 Jan 2024
- 2023Thin On-Sensor Nanophotonic Array Cameras5 Aug 2023
- 2023On the use of deep learning for phase recovery2 Aug 2023
- 2022LWGNet: Learned Wirtinger Gradients for Fourier Ptychographic Phase Retrieval8 Aug 2022
- 2022Physics vs. Learned Priors: Rethinking Camera and Algorithm Design for Task-Specific Imaging21 Apr 2022
- 2022Learning Spatially Varying Pixel Exposures for Motion Deblurring14 Apr 2022
- 2022Differentiable Microscopy for Content and Task Aware Compressive Fluorescence Imaging28 Mar 2022
- 2022Differentiable Microscopy Designs an All Optical Phase Retrieval Microscope28 Mar 2022
6 more
- 2022Resource-Efficient Invariant Networks: Exponential Gains by Unrolled Optimization9 Mar 2022
- 2021Joint Optimization of Hadamard Sensing and Reconstruction in Compressed Sensing Fluorescence Microscopy17 May 2021
- 2021End-to-End Sequential Sampling and Reconstruction for MRI13 May 2021
- 2021Differentiable model-based adaptive optics for two-photon microscopy29 Apr 2021
- 2021Time-Multiplexed Coded Aperture Imaging: Learned Coded Aperture and Pixel Exposures for Compressive Imaging Systems6 Apr 2021
- 2021Adaptive Illumination based Depth Sensing using Deep Superpixel and Soft Sampling Approximation23 Mar 2021
- 2023On the use of deep learning for phase recoverycited by 20
- 2021Time-Multiplexed Coded Aperture Imaging: Learned Coded Aperture and Pixel Exposures for Compressive Imaging Systemscited by 15
- 2021End-to-End Sequential Sampling and Reconstruction for MRIcited by 13
- 2023Thin On-Sensor Nanophotonic Array Camerascited by 13
- 2022Learning Spatially Varying Pixel Exposures for Motion Deblurringcited by 12
- 2022Physics vs. Learned Priors: Rethinking Camera and Algorithm Design for Task-Specific Imagingcited by 6
- 2021Adaptive Illumination based Depth Sensing using Deep Superpixel and Soft Sampling Approximationcited by 2
- 2021Differentiable model-based adaptive optics for two-photon microscopycited by 2
- 2022Resource-Efficient Invariant Networks: Exponential Gains by Unrolled Optimizationcited by 2
- 2022LWGNet: Learned Wirtinger Gradients for Fourier Ptychographic Phase Retrievalcited by 2
- 2024Hybrid deep learning and physics-based neural network for programmable illumination computational microscopycited by 2
- 2021Joint Optimization of Hadamard Sensing and Reconstruction in Compressed Sensing Fluorescence Microscopycited by 1
12 most cited of 18 All 18 (JSON)
- 2025Direct Image Classification from Fourier Ptychographic Microscopy Measurements without Reconstruction8 May 2025
- 2024Batch-FPM: Random batch-update multi-parameter physical Fourier ptychography neural network25 Aug 2024
- 2024Latent Space Imaging9 Jul 2024
- 2024Integration of Programmable Diffraction with Digital Neural Networks15 Jun 2024
- 2024Hybrid deep learning and physics-based neural network for programmable illumination computational microscopy17 Jan 2024
- 2023Thin On-Sensor Nanophotonic Array Cameras5 Aug 2023
- 2023On the use of deep learning for phase recovery2 Aug 2023
- 2022LWGNet: Learned Wirtinger Gradients for Fourier Ptychographic Phase Retrieval8 Aug 2022
- 2022Physics vs. Learned Priors: Rethinking Camera and Algorithm Design for Task-Specific Imaging21 Apr 2022
- 2022Learning Spatially Varying Pixel Exposures for Motion Deblurring14 Apr 2022
- 2022Differentiable Microscopy for Content and Task Aware Compressive Fluorescence Imaging28 Mar 2022
- 2022Differentiable Microscopy Designs an All Optical Phase Retrieval Microscope28 Mar 2022
12 newest of 18 All 18 (JSON)