Deep Learning Microscopy
Not on the map. Why?
Abstract (arXiv)
We demonstrate that a deep neural network can significantly improve optical microscopy, enhancing its spatial resolution over a large field-of-view and depth-of-field. After its training, the only input to this network is an image acquired using a regular optical microscope, without any changes to its design. We blindly tested this deep learning approach using various tissue samples that are imaged with low-resolution and wide-field systems, where the network rapidly outputs an image with remarkably better resolution, matching the performance of higher numerical aperture lenses, also significantly surpassing their limited field-of-view and depth-of-field. These results are transformative for various fields that use microscopy tools, including e.g., life sciences, where optical microscopy is considered as one of the most widely used and deployed techniques. Beyond such applications, our presented approach is broadly applicable to other imaging modalities, also spanning different parts of the electromagnetic spectrum, and can be used to design computational imagers that get better and better as they continue to image specimen and establish new transformations among different modes of imaging.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 May 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 2; 2023: 0; 2024: 2.
10 papers.
- 2022Self-supervised learning of hologram reconstruction using physics consistencycited by 14
- 2021Neural network-based image reconstruction in swept-source optical coherence tomography using undersampled spectral datacited by 6
- 2021Light Lies: Optical Adversarial Attackcited by 5
- 2021Deep-learning-driven Reliable Single-pixel Imaging with Uncertainty Approximationcited by 2
- 2022Physics-informed neural networks for diffraction tomographycited by 2
- 2021Acoustic Structure Inverse Design and Optimization Using Deep Learningcited by 1
- 2021Ten Quick Tips for Deep Learning in Biologycited by 1
- 2024Mathematical Algorithm Design for Deep Learning under Societal and Judicial Constraints: The Algorithmic Transparency Requirementcited by 1
- 2024Joint Segmentation and Image Reconstruction with Error Prediction in Photoacoustic Imaging using Deep Learningcited by 1
- 2021Variational framework for partially-measured physical system control: examples of vision neuroscience and optical random mediacited by 0
- 2024Joint Segmentation and Image Reconstruction with Error Prediction in Photoacoustic Imaging using Deep Learning2 Jul 2024
- 2024Mathematical Algorithm Design for Deep Learning under Societal and Judicial Constraints: The Algorithmic Transparency Requirement18 Jan 2024
- 2022Self-supervised learning of hologram reconstruction using physics consistency17 Sep 2022
- 2022Physics-informed neural networks for diffraction tomography28 Jul 2022
- 2021Variational framework for partially-measured physical system control: examples of vision neuroscience and optical random media25 Oct 2021
- 2021Deep-learning-driven Reliable Single-pixel Imaging with Uncertainty Approximation24 Jul 2021
- 2021Light Lies: Optical Adversarial Attack18 Jun 2021
- 2021Ten Quick Tips for Deep Learning in Biology29 May 2021
- 2021Neural network-based image reconstruction in swept-source optical coherence tomography using undersampled spectral data4 Mar 2021
- 2021Acoustic Structure Inverse Design and Optimization Using Deep Learning29 Jan 2021