mlsanityData to 7 Oct 2026

Extrapolating Prospective Glaucoma Fundus Images through Diffusion Model in Irregular Longitudinal Sequences

arXiv 2410.21130 ↗First posted 28 Oct 2024cs.CVcited by 1

On the map: Diffusion models → Medical imaging and segmentation

Abstract (arXiv)

The utilization of longitudinal datasets for glaucoma progression prediction offers a compelling approach to support early therapeutic interventions. Predominant methodologies in this domain have primarily focused on the direct prediction of glaucoma stage labels from longitudinal datasets. However, such methods may not adequately encapsulate the nuanced developmental trajectory of the disease. To enhance the diagnostic acumen of medical practitioners, we propose a novel diffusion-based model to predict prospective images by extrapolating from existing longitudinal fundus images of patients. The methodology delineated in this study distinctively leverages sequences of images as inputs. Subsequently, a time-aligned mask is employed to select a specific year for image generation. During the training phase, the time-aligned mask resolves the issue of irregular temporal intervals in longitudinal image sequence sampling. Additionally, we utilize a strategy of randomly masking a frame in the sequence to establish the ground truth. This methodology aids the network in continuously acquiring knowledge regarding the internal relationships among the sequences throughout the learning phase. Moreover, the introduction of textual labels is instrumental in categorizing images generated within the sequence. The empirical findings from the conducted experiments indicate that our proposed model not only effectively generates longitudinal data but also significantly improves the precision of downstream classification tasks.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 25 of its 36 references that are in the map. First posted on arXiv 28 Oct 2024.

Builds on

25 of 36 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024KLDD: Kalman Filter based Linear Deformable Diffusion Model in Retinal Image Segmentation19 Sep
  2. 2022SADM: Sequence-Aware Diffusion Model for Longitudinal Medical Image Generation16 Dec

Other references · 23

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  5. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
  6. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  7. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  8. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  9. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  10. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
  11. 2022Diffusion Models in Vision: A Surveycited by 1,008
  12. 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 589
11 more
  1. 2023LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Modelscited by 349
  2. 2023I2VGen-XL: High-Quality Image-to-Video Synthesis via Cascaded Diffusion Modelscited by 343
  3. 2023VideoFusion: Decomposed Diffusion Models for High-Quality Video Generationcited by 330
  4. 2017VAE with a VampPriorcited by 247
  5. 2023SEINE: Short-to-Long Video Diffusion Model for Generative Transition and Predictioncited by 231
  6. 2023A Survey on Video Diffusion Modelscited by 203
  7. 2019Learning to synthesise the ageing brain without longitudinal datacited by 42
  8. 2023ControlStyle: Text-Driven Stylized Image Generation Using Diffusion Priorscited by 40
  9. 2023SGDiff: A Style Guided Diffusion Model for Fashion Synthesiscited by 20
  10. 2021Retrieve in Style: Unsupervised Facial Feature Transfer and Retrievalcited by 15
  11. 2021Learn-Explain-Reinforce: Counterfactual Reasoning and Its Guidance to Reinforce an Alzheimer's Disease Diagnosis Modelcited by 14

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Beyond Point Estimates for Glaucoma Visual Field Forecasting with Diffusion Models
  2. 2026Ordinal Diffusion Models for Color Fundus Images
  3. 2024Rethinking Diffusion-Based Image Generators for Fundus Fluorescein Angiography Synthesis on Limited Data
  4. 2024DiffuPT: Class Imbalance Mitigation for Glaucoma Detection via Diffusion Based Generation and Model Pretraining
  5. 2024Medical Video Generation for Disease Progression Simulation
  6. 2023Learning Enhancement From Degradation: A Diffusion Model For Fundus Image Enhancement
  7. 2023Generation of Structurally Realistic Retinal Fundus Images with Diffusion Models
  8. 2024A Framework for Evaluating Predictive Models Using Synthetic Image Covariates and Longitudinal Data