Conditioning 3D Diffusion Models with 2D Images: Towards Standardized OCT Volumes through En Face-Informed Super-Resolution
On the map: Diffusion models → Medical imaging and segmentation
Abstract (arXiv)
High anisotropy in volumetric medical images can lead to the inconsistent quantification of anatomical and pathological structures. Particularly in optical coherence tomography (OCT), slice spacing can substantially vary across and within datasets, studies, and clinical practices. We propose to standardize OCT volumes to less anisotropic volumes by conditioning 3D diffusion models with en face scanning laser ophthalmoscopy (SLO) imaging data, a 2D modality already commonly available in clinical practice. We trained and evaluated on data from the multicenter and multimodal MACUSTAR study. While upsampling the number of slices by a factor of 8, our method outperforms tricubic interpolation and diffusion models without en face conditioning in terms of perceptual similarity metrics. Qualitative results demonstrate improved coherence and structural similarity. Our approach allows for better informed generative decisions, potentially reducing hallucinations. We hope this work will provide the next step towards standardized high-quality volumetric imaging, enabling more consistent quantifications.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 15 of its 34 references that are in the map. First posted on arXiv 13 Oct 2024.
Builds on
15 of 34 references.
Closest ancestors · 1
Same direction, newest first
Other references · 14
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
- 2021Image Super-Resolution via Iterative Refinementcited by 1,506
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
- 2023Generative AI for Medical Imaging: extending the MONAI Frameworkcited by 68
- 2022GAMMA Challenge:Glaucoma grAding from Multi-Modality imAgescited by 45
Built on by
Citing papers per year: 2025: 1.
1 paper.
- 2025Deep Generative Models for Enhanced Vitreous OCT Imagingcited by 0
- 2025Deep Generative Models for Enhanced Vitreous OCT Imaging2 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2024Memory-efficient High-resolution OCT Volume Synthesis with Cascaded Amortized Latent Diffusion Models
- 2026Super-Resolution and Denoising of Corneal B-Scan OCT Imaging Using Diffusion Model Plug-and-Play Priors
- 2022Unsupervised Denoising of Retinal OCT with Diffusion Probabilistic Model
- 2025Super-Resolution Optical Coherence Tomography Using Diffusion Model-Based Plug-and-Play Priors
- 2023Content-Preserving Diffusion Model for Unsupervised AS-OCT image Despeckling
- 2026DualDiT: A Conditional Dual-Output Diffusion Transformer for Joint OCT Image and Segmentation Mask Generation
- 2025GARD: Gamma-based Anatomical Restoration and Denoising for Retinal OCT
- 2023Retinal OCT Synthesis with Denoising Diffusion Probabilistic Models for Layer Segmentation