Interpretable Retinal Disease Prediction Using Biology-Informed Heterogeneous Graph Representations
Not on the map. Why?
Abstract (arXiv)
Interpretability is crucial for utilizing machine learning models as clinical decision support tools for medical diagnostics. However, most state-of-the-art image classifiers based on neural networks are not interpretable. As a result, clinicians often resort to known biomarkers to guide diagnosis, although biomarker-based classification often suffers from drastic information loss compared to raw medical images. This work proposes a method that preserves the rich imaging information while simultaneously enhancing the interpretability of predictions for diabetic retinopathy staging from optical coherence tomography angiography (OCTA) images. The core contribution of our method is a novel biology-informed heterogeneous graph representation that models retinal vessel segments, intercapillary areas, and the foveal avascular zone (FAZ) in a human-interpretable way. This graph representation allows us to frame diabetic retinopathy staging as a graph-level classification task, which we solve using an established, efficient graph neural network architecture. We compare our method against established methods, including classical biomarker-based classifiers, convolutional neural networks (CNNs), and vision transformers in predicting the clinically assigned DR stage based on color fundus photography images. We find stage agreement rates of our method and alternative vision model based classifiers saturating at AUC-ROC values of 84%. Crucially, we use our biology-informed graph to provide explanations of great detail. Our approach surpasses existing methods in precisely localizing and identifying abnormal vessels and non-perfusion areas. Our approach sets the stage for the interpretable identification of patients who require special attention due to their traceable microvascular changes, only observable using the details of OCTA images.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 31 of its 75 references that are in the map. First posted on arXiv 23 Feb 2025.
Builds on
31 of 75 references.
References · 31
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2022A ConvNet for the 2020scited by 3,545
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,540
- 2015Learning Deep Features for Discriminative Localizationcited by 2,430
19 more
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
- 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,571
- 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,201
- 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,127
- 2019GNNExplainer: Generating Explanations for Graph Neural Networkscited by 735
- 2020Explainability in Graph Neural Networks: A Taxonomic Surveycited by 383
- 2020GraphLIME: Local Interpretable Model Explanations for Graph Neural Networkscited by 209
- 2021Explainable artificial intelligence (XAI) in deep learning-based medical image analysiscited by 147
- 2020Ground Truth Evaluation of Neural Network Explanations with CLEVR-XAIcited by 125
- 2022Evaluating Explainability for Graph Neural Networkscited by 85
- 2017Detecting Statistical Interactions from Neural Network Weightscited by 80
- 2020Model Interpretability through the Lens of Computational Complexitycited by 75
- 2020OCTA-500: A Retinal Dataset for Optical Coherence Tomography Angiography Studycited by 52
- 2018Using Attribution to Decode Dataset Bias in Neural Network Models for Chemistrycited by 25
- 2021Scalable Robust Graph and Feature Extraction for Arbitrary Vessel Networks in Large Volumetric Datasetscited by 17
- 2019Supervised machine learning based multi-task artificial intelligence classification of retinopathiescited by 5
- 2023DRAC: Diabetic Retinopathy Analysis Challenge with Ultra-Wide Optical Coherence Tomography Angiography Imagescited by 5
- 2023Self-pruning Graph Neural Network for Predicting Inflammatory Disease Activity in Multiple Sclerosis from Brain MR Imagescited by 2
Built on by
Citing papers per year: 2025: 3; 2026: 1.
4 papers.
- 2025Fine-tuning Vision Language Models with Graph-based Knowledge for Explainable Medical Image Analysiscited by 3
- 2025A Graph-Based Framework for Interpretable Whole Slide Image Analysiscited by 1
- 2025Synthetic Vasculature and Pathology Enhance Vision-Language Model Reasoningcited by 0
- 2026Representation learning from OCT imagescited by 0
- 2026Representation learning from OCT images4 May 2026
- 2025Synthetic Vasculature and Pathology Enhance Vision-Language Model Reasoning11 Dec 2025
- 2025A Graph-Based Framework for Interpretable Whole Slide Image Analysis14 Mar 2025
- 2025Fine-tuning Vision Language Models with Graph-based Knowledge for Explainable Medical Image Analysis12 Mar 2025