mlsanityData to 7 Oct 2026

Detecting Severity of Diabetic Retinopathy from Fundus Images: A Transformer Network-based Review

arXiv 2301.00973 ↗First posted 3 Jan 2023cs.CV cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Diabetic Retinopathy (DR) is considered one of the significant concerns worldwide, primarily due to its impact on causing vision loss among most people with diabetes. The severity of DR is typically comprehended manually by ophthalmologists from fundus photography-based retina images. This paper deals with an automated understanding of the severity stages of DR. In the literature, researchers have focused on this automation using traditional machine learning-based algorithms and convolutional architectures. However, the past works hardly focused on essential parts of the retinal image to improve the model performance. In this study, we adopt and fine-tune transformer-based learning models to capture the crucial features of retinal images for a more nuanced understanding of DR severity. Additionally, we explore the effectiveness of image transformers to infer the degree of DR severity from fundus photographs. For experiments, we utilized the publicly available APTOS-2019 blindness detection dataset, where the performances of the transformer-based models were quite encouraging.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 24 of its 62 references that are in the map. First posted on arXiv 3 Jan 2023.

Builds on

24 of 62 references.

References · 24

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  5. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  6. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  7. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  8. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  9. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
  10. 2017Squeeze-and-Excitation Networkscited by 4,763
  11. 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
  12. 2021Zero-Shot Text-to-Image Generationcited by 4,276
12 more
  1. 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
  2. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
  3. 2021Going deeper with Image Transformerscited by 759
  4. 2019Mish: A Self Regularized Non-Monotonic Activation Functioncited by 141
  5. 2020Metrics for Multi-Class Classification: an Overviewcited by 140
  6. 2017Grader variability and the importance of reference standards for evaluating machine learning models for diabetic retinopathycited by 42
  7. 2017Zoom-in-Net: Deep Mining Lesions for Diabetic Retinopathy Detectioncited by 28
  8. 2018Deep Learning based Computer-Aided Diagnosis Systems for Diabetic Retinopathy: A Surveycited by 19
  9. 2022SSiT: Saliency-guided Self-supervised Image Transformer for Diabetic Retinopathy Gradingcited by 9
  10. 2021Search Algorithms for Automated Hyper-Parameter Tuningcited by 8
  11. 2020Deep Learning Approach to Diabetic Retinopathy Detectioncited by 7
  12. 2019Multidimensional Contrast Limited Adaptive Histogram Equalizationcited by 4

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 0; 2025: 1.

2 papers.