DISCOVER: 2-D Multiview Summarization of Optical Coherence Tomography Angiography for Automatic Diabetic Retinopathy Diagnosis
Not on the map. Why?
Abstract (arXiv)
Diabetic Retinopathy (DR), an ocular complication of diabetes, is a leading cause of blindness worldwide. Traditionally, DR is monitored using Color Fundus Photography (CFP), a widespread 2-D imaging modality. However, DR classifications based on CFP have poor predictive power, resulting in suboptimal DR management. Optical Coherence Tomography Angiography (OCTA) is a recent 3-D imaging modality offering enhanced structural and functional information (blood flow) with a wider field of view. This paper investigates automatic DR severity assessment using 3-D OCTA. A straightforward solution to this task is a 3-D neural network classifier. However, 3-D architectures have numerous parameters and typically require many training samples. A lighter solution consists in using 2-D neural network classifiers processing 2-D en-face (or frontal) projections and/or 2-D cross-sectional slices. Such an approach mimics the way ophthalmologists analyze OCTA acquisitions: 1) en-face flow maps are often used to detect avascular zones and neovascularization, and 2) cross-sectional slices are commonly analyzed to detect macular edemas, for instance. However, arbitrary data reduction or selection might result in information loss. Two complementary strategies are thus proposed to optimally summarize OCTA volumes with 2-D images: 1) a parametric en-face projection optimized through deep learning and 2) a cross-sectional slice selection process controlled through gradient-based attribution. The full summarization and DR classification pipeline is trained from end to end. The automatic 2-D summary can be displayed in a viewer or printed in a report to support the decision. We show that the proposed 2-D summarization and classification pipeline outperforms direct 3-D classification with the advantage of improved interpretability.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 23 of its 71 references that are in the map. First posted on arXiv 10 Jan 2024.
Builds on
23 of 71 references.
References · 23
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2022A ConvNet for the 2020scited by 3,579
- 2017Axiomatic Attribution for Deep Networkscited by 3,384
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
- 2013Visualizing and Understanding Convolutional Networkscited by 2,290
- 2017Learning Important Features Through Propagating Activation Differencescited by 1,458
- 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,135
- 2014Striving for Simplicity: The All Convolutional Netcited by 990
- 2017Can Spatiotemporal 3D CNNs Retrace the History of 2D CNNs and ImageNet?cited by 551
11 more
- 2015Evaluating the visualization of what a Deep Neural Network has learnedcited by 419
- 2016Deep image mining for diabetic retinopathy screeningcited by 25
- 2020ExplAIn: Explanatory Artificial Intelligence for Diabetic Retinopathy Diagnosiscited by 16
- 2022Self-Supervised 2D/3D Registration for X-Ray to CT Image Fusioncited by 12
- 2022Multimodal Information Fusion for Glaucoma and DR Classificationcited by 11
- 2019Transfer Learning for Automated OCTA Detection of Diabetic Retinopathycited by 8
- 2021Projective Skip-Connections for Segmentation Along a Subset of Dimensions in Retinal OCTcited by 8
- 2020Automated segmentation of retinal fluid volumes from structural and angiographic optical coherence tomography using deep learningcited by 6
- 2019Supervised machine learning based multi-task artificial intelligence classification of retinopathiescited by 5
- 2020VC-Net: Deep Volume-Composition Networks for Segmentation and Visualization of Highly Sparse and Noisy Image Datacited by 4
- 2018Metric-Driven Learning of Correspondence Weighting for 2-D/3-D Image Registrationcited by 3
Built on by
Citing papers per year: 2024: 3.
3 papers.
- 2024L-MAE: Longitudinal masked auto-encoder with time and severity-aware encoding for diabetic retinopathy progression predictioncited by 2
- 2024Masked Image Modelling for retinal OCT understandingcited by 2
- 2024Deep Learning-Based Detection of Referable Diabetic Retinopathy and Macular Edema Using Ultra-Widefield Fundus Imagingcited by 1
- 2024Deep Learning-Based Detection of Referable Diabetic Retinopathy and Macular Edema Using Ultra-Widefield Fundus Imaging19 Sep 2024
- 2024Masked Image Modelling for retinal OCT understanding23 May 2024
- 2024L-MAE: Longitudinal masked auto-encoder with time and severity-aware encoding for diabetic retinopathy progression prediction24 Mar 2024