mlsanityData to 14 Oct 2026

An Explainable Transformer Model for Alzheimer's Disease Detection Using Retinal Imaging

arXiv 2507.04259 ↗First posted 6 Jul 2025cs.LG cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Alzheimer's disease (AD) is a neurodegenerative disorder that affects millions worldwide. In the absence of effective treatment options, early diagnosis is crucial for initiating management strategies to delay disease onset and slow down its progression. In this study, we propose Retformer, a novel transformer-based architecture for detecting AD using retinal imaging modalities, leveraging the power of transformers and explainable artificial intelligence. The Retformer model is trained on datasets of different modalities of retinal images from patients with AD and age-matched healthy controls, enabling it to learn complex patterns and relationships between image features and disease diagnosis. To provide insights into the decision-making process of our model, we employ the Gradient-weighted Class Activation Mapping algorithm to visualize the feature importance maps, highlighting the regions of the retinal images that contribute most significantly to the classification outcome. These findings are compared to existing clinical studies on detecting AD using retinal biomarkers, allowing us to identify the most important features for AD detection in each imaging modality. The Retformer model outperforms a variety of benchmark algorithms across different performance metrics by margins of up to 11.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 21 of its 73 references that are in the map. First posted on arXiv 6 Jul 2025.

Builds on

21 of 73 references.

References · 21

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  5. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  6. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  7. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  8. 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
  9. 2020GLU Variants Improve Transformercited by 1,804
  10. 2023GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpointscited by 1,346
  11. 2021Medical Transformer: Gated Axial-Attention for Medical Image Segmentationcited by 320
  12. 2022Transformers in Medical Imaging: A Surveycited by 245
9 more
  1. 2022On The Computational Complexity of Self-Attentioncited by 139
  2. 2022Three things everyone should know about Vision Transformerscited by 90
  3. 2021TransMed: Transformers Advance Multi-modal Medical Image Classificationcited by 86
  4. 2023A Foundation Language-Image Model of the Retina (FLAIR): Encoding Expert Knowledge in Text Supervisioncited by 78
  5. 2022When Shift Operation Meets Vision Transformer: An Extremely Simple Alternative to Attention Mechanismcited by 30
  6. 2024RET-CLIP: A Retinal Image Foundation Model Pre-trained with Clinical Diagnostic Reportscited by 30
  7. 2021BERTHop: An Effective Vision-and-Language Model for Chest X-ray Disease Diagnosiscited by 20
  8. 2023Explainability of Vision Transformers: A Comprehensive Review and New Perspectivescited by 12
  9. 2025Temperature-Driven Robust Disease Detection in Brain and Gastrointestinal Disorders via Context-Aware Adaptive Knowledge Distillationcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.