Physics-Informed Deep Learning Model for Cross-Modality Super-Resolution in Fluorescence Microscopy
Not on the map. Why?
Abstract (arXiv)
Cross-modality image translation offers a route to super-resolution fluorescence microscopy from low-resolution images while reducing phototoxicity and instrumentation demands. However, purely data-driven models can produce visually plausible outputs that are inconsistent with optical image formation. Here, we propose a physics-informed generative adversarial network for confocal-to-STED image translation that incorporates microscope-specific point spread function information into the training objective. Simulated and experimentally measured PSFs were evaluated using a limited paired confocal-STED dataset of TOM20-labeled mitochondria in human primary M2 macrophages acquired across different experimental days. Performance was assessed using reference-based and non-reference-based image-quality metrics, together with complementary frequency- and distribution-sensitive analyses. The no-reference metrics probed physics-relevant image properties, including spatial-frequency content, contrast, and signal-to-noise behavior. PSF-guided models improved structural fidelity, reduced local deviations, and achieved closer agreement with STED references than non-PSF baselines, particularly in frequency-domain analyses. These results demonstrate that optical priors can improve the structural fidelity and physical plausibility of generative microscopy models for cross-modality super-resolution imaging.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 43 references that are in the map. First posted on arXiv 23 Jul 2026.
Builds on
9 of 43 references.
References · 9
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2020Deep Learning Techniques for Inverse Problems in Imagingcited by 291
- 2019On instabilities of deep learning in image reconstruction - Does AI come at a cost?cited by 212
- 2018Deep learning-based virtual histology staining using auto-fluorescence of label-free tissuecited by 70
- 2019Three-dimensional virtual refocusing of fluorescence microscopy images using deep learningcited by 11
- 2021Deep learning enables reference-free isotropic super-resolution for volumetric fluorescence microscopycited by 8
- 2025Multi-Marker Similarity enables reduced-reference and interpretable image quality assessment in optical microscopycited by 2
- 2025Lightweight CycleGAN Models for Cross-Modality Image Transformation and Experimental Quality Assessment in Fluorescence Microscopycited by 1
Built on by
Not cited yet.