Enhancing Retinal Vessel Segmentation Generalization via Layout-Aware Generative Modelling
Not on the map. Why?
Abstract (arXiv)
Generalization in medical segmentation models is challenging due to limited annotated datasets and imaging variability. To address this, we propose Retinal Layout-Aware Diffusion (RLAD), a novel diffusion-based framework for generating controllable layout-aware images. RLAD conditions image generation on multiple key layout components extracted from real images, ensuring high structural fidelity while enabling diversity in other components. Applied to retinal fundus imaging, we augmented the training datasets by synthesizing paired retinal images and vessel segmentations conditioned on extracted blood vessels from real images, while varying other layout components such as lesions and the optic disc. Experiments demonstrated that RLAD-generated data improved generalization in retinal vessel segmentation by up to 8.1%. Furthermore, we present REYIA, a comprehensive dataset comprising 586 manually segmented retinal images. To foster reproducibility and drive innovation, both our code and dataset will be made publicly accessible.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 36 of its 80 references that are in the map. First posted on arXiv 3 Mar 2025.
Builds on
36 of 80 references.
References · 36
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2023Visual Instruction Tuningcited by 7,869
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Classifier-Free Diffusion Guidancecited by 5,847
24 more
- 2022Generative Adversarial Networkscited by 5,627
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2022Video Diffusion Modelscited by 2,305
- 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,354
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
- 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,228
- 2020clDice -- A Novel Topology-Preserving Loss Function for Tubular Structure Segmentationcited by 294
- 2023Reconstructing the Mind's Eye: fMRI-to-Image with Contrastive Learning and Diffusion Priorscited by 160
- 2024Paint by Inpaint: Learning to Add Image Objects by Removing Them Firstcited by 39
- 2018Towards a glaucoma risk index based on simulated hemodynamics from fundus imagescited by 31
- 2020G1020: A Benchmark Retinal Fundus Image Dataset for Computer-Aided Glaucoma Detectioncited by 31
- 2023DLT: Conditioned layout generation with Joint Discrete-Continuous Diffusion Layout Transformercited by 20
- 2024Data Generation Using Large Language Models for Text Classification: An Empirical Case Studycited by 11
- 2022Cross-Field Transformer for Diabetic Retinopathy Grading on Two-field Fundus Imagescited by 9
- 2023Generation of Structurally Realistic Retinal Fundus Images with Diffusion Modelscited by 9
- 2024Disentangling representations of retinal images with generative modelscited by 8
- 2021Learning to Address Intra-segment Misclassification in Retinal Imagingcited by 6
- 2023LUNet: Deep Learning for the Segmentation of Arterioles and Venules in High Resolution Fundus Imagescited by 6
- 2022PVBM: A Python Vasculature Biomarker Toolbox Based On Retinal Blood Vessel Segmentationcited by 5
- 2023RVD: A Handheld Device-Based Fundus Video Dataset for Retinal Vessel Segmentationcited by 4
- 2024VascX Models: Model Ensembles for Retinal Vascular Analysis from Color Fundus Imagescited by 4
- 2022Lirot.ai: A Novel Platform for Crowd-Sourcing Retinal Image Segmentationscited by 2
- 2024TAP-VL: Text Layout-Aware Pre-training for Enriched Vision-Language Modelscited by 1
Built on by
Not cited yet.