Fundus to Fluorescein Angiography Video Generation as a Retinal Generative Foundation Model
Not on the map. Why?
Abstract (arXiv)
Fundus fluorescein angiography (FFA) is crucial for diagnosing and monitoring retinal vascular issues but is limited by its invasive nature and restricted accessibility compared to color fundus (CF) imaging. Existing methods that convert CF images to FFA are confined to static image generation, missing the dynamic lesional changes. We introduce Fundus2Video, an autoregressive generative adversarial network (GAN) model that generates dynamic FFA videos from single CF images. Fundus2Video excels in video generation, achieving an FVD of 1497.12 and a PSNR of 11.77. Clinical experts have validated the fidelity of the generated videos. Additionally, the model's generator demonstrates remarkable downstream transferability across ten external public datasets, including blood vessel segmentation, retinal disease diagnosis, systemic disease prediction, and multimodal retrieval, showcasing impressive zero-shot and few-shot capabilities. These findings position Fundus2Video as a powerful, non-invasive alternative to FFA exams and a versatile retinal generative foundation model that captures both static and temporal retinal features, enabling the representation of complex inter-modality relationships.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 13 of its 54 references that are in the map. First posted on arXiv 17 Oct 2024.
Builds on
13 of 54 references.
References · 13
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,179
- 2020Visual Transformers: Token-based Image Representation and Processing for Computer Visioncited by 334
- 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Textcited by 251
- 2024Medical SAM 2: Segment medical images as video via Segment Anything Model 2cited by 154
- 2024ConsistI2V: Enhancing Visual Consistency for Image-to-Video Generationcited by 132
- 2023Conditional Diffusion Models for Semantic 3D Brain MRI Synthesiscited by 86
- 2023SAM on Medical Images: A Comprehensive Study on Three Prompt Modescited by 82
- 2023A Foundation Language-Image Model of the Retina (FLAIR): Encoding Expert Knowledge in Text Supervisioncited by 78
- 2019Video Generation from Single Semantic Label Mapcited by 54
- 2023Adaptive Supervised PatchNCE Loss for Learning H&E-to-IHC Stain Translation with Inconsistent Groundtruth Image Pairscited by 38
- 2024EyeFound: A Multimodal Generalist Foundation Model for Ophthalmic Imagingcited by 18
Built on by
Citing papers per year: 2024: 1.
1 paper.