Physics-based Learned Design: Optimized Coded-Illumination for Quantitative Phase Imaging
Not on the map. Why?
Abstract (arXiv)
Coded-illumination can enable quantitative phase microscopy of transparent samples with minimal hardware requirements. Intensity images are captured with different source patterns and a non-linear phase retrieval optimization reconstructs the image. The non-linear nature of the processing makes optimizing the illumination pattern designs complicated. Traditional techniques for experimental design (e.g. condition number optimization, spectral analysis) consider only linear measurement formation models and linear reconstructions. Deep neural networks (DNNs) can efficiently represent the non-linear process and can be optimized over via training in an end-to-end framework. However, DNNs typically require a large amount of training examples and parameters to properly learn the phase retrieval process, without making use of the known physical models. Here, we aim to use both our knowledge of the physics and the power of machine learning together. We develop a new data-driven approach to optimizing coded-illumination patterns for a LED array microscope for a given phase reconstruction algorithm. Our method incorporates both the physics of the measurement scheme and the non-linearity of the reconstruction algorithm into the design problem. This enables efficient parameterization, which allows us to use only a small number of training examples to learn designs that generalize well in the experimental setting without retraining. We show experimental results for both a well-characterized phase target and mouse fibroblast cells using coded-illumination patterns optimized for a sparsity-based phase reconstruction algorithm. Our learned design results using 2 measurements demonstrate similar accuracy to Fourier Ptychography with 69 measurements.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Aug 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 5; 2023: 3; 2024: 4; 2025: 2.
18 papers.
Sort:
- 2023On the use of deep learning for phase recoverycited by 20
- 2021End-to-End Sequential Sampling and Reconstruction for MRIcited by 13
- 2024A Differentiable Wave Optics Model for End-to-End Computational Imaging System Optimizationcited by 6
- 2021Video Reconstruction from a Single Motion Blurred Image using Learned Dynamic Phase Codingcited by 5
- 2022Deep Optical Coding Design in Computational Imagingcited by 5
- 2021Physical model simulator-trained neural network for computational 3D phase imaging of multiple-scattering samplescited by 3
- 2021Adaptive Illumination based Depth Sensing using Deep Superpixel and Soft Sampling Approximationcited by 2
- 2022Resource-Efficient Invariant Networks: Exponential Gains by Unrolled Optimizationcited by 2
- 2024The Berkeley Single Cell Computational Microscopy (BSCCM) Datasetcited by 2
- 2022Differentiable Microscopy Designs an All Optical Phase Retrieval Microscopecited by 1
- 2022Differentiable Microscopy for Content and Task Aware Compressive Fluorescence Imagingcited by 1
- 2022From Hours to Seconds: Towards 100x Faster Quantitative Phase Imaging via Differentiable Microscopycited by 1
6 more
- 2024Integration of Programmable Diffraction with Digital Neural Networkscited by 1
- 2024Optimal OnTheFly Feedback Control of Event Sensorscited by 1
- 2025Direct Image Classification from Fourier Ptychographic Microscopy Measurements without Reconstructioncited by 1
- 2023CalibFPA: A Focal Plane Array Imaging System based on Online Deep-Learning Calibrationcited by 0
- 2023QuATON: Quantization Aware Training of Optical Neuronscited by 0
- 2025Distilling Knowledge for Designing Computational Imaging Systemscited by 0
- 2025Direct Image Classification from Fourier Ptychographic Microscopy Measurements without Reconstruction8 May 2025
- 2025Distilling Knowledge for Designing Computational Imaging Systems29 Jan 2025
- 2024A Differentiable Wave Optics Model for End-to-End Computational Imaging System Optimization13 Dec 2024
- 2024Optimal OnTheFly Feedback Control of Event Sensors23 Aug 2024
- 2024Integration of Programmable Diffraction with Digital Neural Networks15 Jun 2024
- 2024The Berkeley Single Cell Computational Microscopy (BSCCM) Dataset9 Feb 2024
- 2023QuATON: Quantization Aware Training of Optical Neurons4 Oct 2023
- 2023CalibFPA: A Focal Plane Array Imaging System based on Online Deep-Learning Calibration20 Sep 2023
- 2023On the use of deep learning for phase recovery2 Aug 2023
- 2022Deep Optical Coding Design in Computational Imaging27 Jun 2022
- 2022From Hours to Seconds: Towards 100x Faster Quantitative Phase Imaging via Differentiable Microscopy23 May 2022
- 2022Differentiable Microscopy for Content and Task Aware Compressive Fluorescence Imaging28 Mar 2022
6 more
- 2022Differentiable Microscopy Designs an All Optical Phase Retrieval Microscope28 Mar 2022
- 2022Resource-Efficient Invariant Networks: Exponential Gains by Unrolled Optimization9 Mar 2022
- 2021Video Reconstruction from a Single Motion Blurred Image using Learned Dynamic Phase Coding28 Dec 2021
- 2021End-to-End Sequential Sampling and Reconstruction for MRI13 May 2021
- 2021Physical model simulator-trained neural network for computational 3D phase imaging of multiple-scattering samples29 Mar 2021
- 2021Adaptive Illumination based Depth Sensing using Deep Superpixel and Soft Sampling Approximation23 Mar 2021
- 2023On the use of deep learning for phase recoverycited by 20
- 2021End-to-End Sequential Sampling and Reconstruction for MRIcited by 13
- 2024A Differentiable Wave Optics Model for End-to-End Computational Imaging System Optimizationcited by 6
- 2021Video Reconstruction from a Single Motion Blurred Image using Learned Dynamic Phase Codingcited by 5
- 2022Deep Optical Coding Design in Computational Imagingcited by 5
- 2021Physical model simulator-trained neural network for computational 3D phase imaging of multiple-scattering samplescited by 3
- 2021Adaptive Illumination based Depth Sensing using Deep Superpixel and Soft Sampling Approximationcited by 2
- 2022Resource-Efficient Invariant Networks: Exponential Gains by Unrolled Optimizationcited by 2
- 2024The Berkeley Single Cell Computational Microscopy (BSCCM) Datasetcited by 2
- 2022Differentiable Microscopy Designs an All Optical Phase Retrieval Microscopecited by 1
- 2022Differentiable Microscopy for Content and Task Aware Compressive Fluorescence Imagingcited by 1
- 2022From Hours to Seconds: Towards 100x Faster Quantitative Phase Imaging via Differentiable Microscopycited by 1
12 most cited of 18 All 18 (JSON)
- 2025Direct Image Classification from Fourier Ptychographic Microscopy Measurements without Reconstruction8 May 2025
- 2025Distilling Knowledge for Designing Computational Imaging Systems29 Jan 2025
- 2024A Differentiable Wave Optics Model for End-to-End Computational Imaging System Optimization13 Dec 2024
- 2024Optimal OnTheFly Feedback Control of Event Sensors23 Aug 2024
- 2024Integration of Programmable Diffraction with Digital Neural Networks15 Jun 2024
- 2024The Berkeley Single Cell Computational Microscopy (BSCCM) Dataset9 Feb 2024
- 2023QuATON: Quantization Aware Training of Optical Neurons4 Oct 2023
- 2023CalibFPA: A Focal Plane Array Imaging System based on Online Deep-Learning Calibration20 Sep 2023
- 2023On the use of deep learning for phase recovery2 Aug 2023
- 2022Deep Optical Coding Design in Computational Imaging27 Jun 2022
- 2022From Hours to Seconds: Towards 100x Faster Quantitative Phase Imaging via Differentiable Microscopy23 May 2022
- 2022Differentiable Microscopy for Content and Task Aware Compressive Fluorescence Imaging28 Mar 2022
12 newest of 18 All 18 (JSON)