mlsanityData to 14 Oct 2026

Physics-Informed Deep Learning Model for Cross-Modality Super-Resolution in Fluorescence Microscopy

arXiv 2607.21190 ↗First posted 23 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Cross-modality image translation offers a route to super-resolution fluorescence microscopy from low-resolution images while reducing phototoxicity and instrumentation demands. However, purely data-driven models can produce visually plausible outputs that are inconsistent with optical image formation. Here, we propose a physics-informed generative adversarial network for confocal-to-STED image translation that incorporates microscope-specific point spread function information into the training objective. Simulated and experimentally measured PSFs were evaluated using a limited paired confocal-STED dataset of TOM20-labeled mitochondria in human primary M2 macrophages acquired across different experimental days. Performance was assessed using reference-based and non-reference-based image-quality metrics, together with complementary frequency- and distribution-sensitive analyses. The no-reference metrics probed physics-relevant image properties, including spatial-frequency content, contrast, and signal-to-noise behavior. PSF-guided models improved structural fidelity, reduced local deviations, and achieved closer agreement with STED references than non-PSF baselines, particularly in frequency-domain analyses. These results demonstrate that optical priors can improve the structural fidelity and physical plausibility of generative microscopy models for cross-modality super-resolution imaging.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 43 references that are in the map. First posted on arXiv 23 Jul 2026.

Builds on

9 of 43 references.

References · 9

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  2. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
  3. 2020Deep Learning Techniques for Inverse Problems in Imagingcited by 291
  4. 2019On instabilities of deep learning in image reconstruction - Does AI come at a cost?cited by 212
  5. 2018Deep learning-based virtual histology staining using auto-fluorescence of label-free tissuecited by 70
  6. 2019Three-dimensional virtual refocusing of fluorescence microscopy images using deep learningcited by 11
  7. 2021Deep learning enables reference-free isotropic super-resolution for volumetric fluorescence microscopycited by 8
  8. 2025Multi-Marker Similarity enables reduced-reference and interpretable image quality assessment in optical microscopycited by 2
  9. 2025Lightweight CycleGAN Models for Cross-Modality Image Transformation and Experimental Quality Assessment in Fluorescence Microscopycited by 1

Built on by

Not cited yet.