Super-resolution of biomedical volumes with 2D supervision
Not on the map. Why?
Abstract (arXiv)
Volumetric biomedical microscopy has the potential to increase the diagnostic information extracted from clinical tissue specimens and improve the diagnostic accuracy of both human pathologists and computational pathology models. Unfortunately, barriers to integrating 3-dimensional (3D) volumetric microscopy into clinical medicine include long imaging times, poor depth / z-axis resolution, and an insufficient amount of high-quality volumetric data. Leveraging the abundance of high-resolution 2D microscopy data, we introduce masked slice diffusion for super-resolution (MSDSR), which exploits the inherent equivalence in the data-generating distribution across all spatial dimensions of biological specimens. This intrinsic characteristic allows for super-resolution models trained on high-resolution images from one plane (e.g., XY) to effectively generalize to others (XZ, YZ), overcoming the traditional dependency on orientation. We focus on the application of MSDSR to stimulated Raman histology (SRH), an optical imaging modality for biological specimen analysis and intraoperative diagnosis, characterized by its rapid acquisition of high-resolution 2D images but slow and costly optical z-sectioning. To evaluate MSDSR's efficacy, we introduce a new performance metric, SliceFID, and demonstrate MSDSR's superior performance over baseline models through extensive evaluations. Our findings reveal that MSDSR not only significantly enhances the quality and resolution of 3D volumetric data, but also addresses major obstacles hindering the broader application of 3D volumetric microscopy in clinical diagnostics and biomedical research.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 33 of its 63 references that are in the map. First posted on arXiv 15 Apr 2024.
Builds on
33 of 63 references.
References · 33
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022Generative Adversarial Networkscited by 5,603
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
- 2021Image Super-Resolution via Iterative Refinementcited by 1,506
- 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,218
21 more
- 2022Denoising Diffusion Restoration Modelscited by 951
- 2020Learning Continuous Image Representation with Local Implicit Image Functioncited by 550
- 2021Score-based diffusion models for accelerated MRIcited by 308
- 2023Implicit Diffusion Models for Continuous Super-Resolutioncited by 216
- 2022Solving 3D Inverse Problems using Pre-trained 2D Diffusion Modelscited by 130
- 2023Conditional Diffusion Models for Semantic 3D Brain MRI Synthesiscited by 85
- 2022MR Image Denoising and Super-Resolution Using Regularized Reverse Diffusioncited by 66
- 2023Improving 3D Imaging with Pre-Trained Perpendicular 2D Diffusion Modelscited by 53
- 2021An Arbitrary Scale Super-Resolution Approach for 3D MR Images via Implicit Neural Representationcited by 47
- 2020SAINT: Spatially Aware Interpolation NeTwork for Medical Slice Synthesiscited by 37
- 2023InverseSR: 3D Brain MRI Super-Resolution Using a Latent Diffusion Modelcited by 28
- 2019MRI Super-Resolution with Ensemble Learning and Complementary Priorscited by 27
- 2023Hierarchical discriminative learning improves visual representations of biomedical microscopycited by 12
- 2019Virtual Thin Slice: 3D Conditional GAN-based Super-resolution for CT Slice Intervalcited by 11
- 2020Deep Residual Dense U-Net for Resolution Enhancement in Accelerated MRI Acquisitioncited by 9
- 2022OpenSRH: optimizing brain tumor surgery using intraoperative stimulated Raman histologycited by 9
- 2023DiffuseIR:Diffusion Models For Isotropic Reconstruction of 3D Microscopic Imagescited by 9
- 2023Artificial-intelligence-based molecular classification of diffuse gliomas using rapid, label-free optical imagingcited by 7
- 2024A self-supervised framework for learning whole slide representationscited by 6
- 2024Step-Calibrated Diffusion for Biomedical Optical Image Restorationcited by 5
- 2020Unsupervised Super-Resolution: Creating High-Resolution Medical Images from Low-Resolution Anisotropic Examplescited by 3
Built on by
Citing papers per year: 2024: 1; 2025: 1; 2026: 1.
3 papers.
- 2026SkelEM: Training-Signal Decoupling of Skeleton and Diffusion for Self-supervised Axial Super-Resolution in Volume Microscopy29 Jun 2026
- 2025Intelligent Histology for Tumor Neurosurgery3 Jul 2025
- 2024From Diffusion to Resolution: Leveraging 2D Diffusion Models for 3D Super-Resolution Task25 Nov 2024