Explainable Diabetic Retinopathy Classification Using Vision Foundation Models
Not on the map. Why?
Abstract (arXiv)
Diabetic retinopathy (DR) is a major cause of preventable blindness, creating a need for accurate and trustworthy automated screening. This study investigates an explainable DR classification framework using vision foundation models and multiple transfer learning strategies. Three backbones, DINOv2, CLIP, and Vision Transformer (ViT), were evaluated using full fine-tuning, linear probing, and Low-Rank Adaptation (LoRA). Models were trained and internally evaluated on the ODIR dataset and externally evaluated on APTOS to assess generalization. DINOv2-LoRA achieved the highest internal AUROC of 0.758, while DINOv2 full fine-tuning and ViT full fine-tuning achieved the highest external AUROC of 0.920. Calibration was further assessed using reliability analysis after isotonic regression. For explainability, Grad-CAM and HiResCAM were evaluated against expert-annotated lesion masks from the IDRiD dataset using Dice, Intersection over Union (IoU), and Pointing Game metrics. The results demonstrate that foundation models, particularly DINOv2, can provide strong predictive performance, while LoRA offers a parameter-efficient alternative to full fine-tuning. Quantitative evaluation of explanation maps further supports the assessment of whether model attention corresponds to clinically relevant retinal lesions.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 25 references that are in the map. First posted on arXiv 28 Aug 2026.
Builds on
17 of 25 references.
References · 17
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2020Quantifying Attention Flow in Transformerscited by 775
- 2019Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networkscited by 582
- 2019A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAIcited by 404
- 2017Explainable Artificial Intelligence: Understanding, Visualizing and Interpreting Deep Learning Modelscited by 206
- 2020Eigen-CAM: Class Activation Map using Principal Componentscited by 189
5 more
- 2020Use HiResCAM instead of Grad-CAM for faithful explanations of convolutional neural networkscited by 79
- 2023Using explainable AI to investigate electrocardiogram changes during healthy aging -- from expert features to raw signalscited by 7
- 2025Benchmarking ECG FMs: A Reality Check Across Clinical Taskscited by 7
- 2024Explainable machine learning for neoplasms diagnosis via electrocardiograms: an externally validated studycited by 4
- 2026A Multimodal Deep Learning Framework for Predicting ICU Deterioration: Integrating ECG Waveforms with Clinical Data and Clinician Benchmarkingcited by 1
Built on by
Not cited yet.