# Benchmarking Ophthalmology Foundation Models for Clinically Significant Age Macular Degeneration Detection

arXiv: https://arxiv.org/abs/2505.05291 · HTML: https://mlsanity.com/paper/2505.05291/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 10 of its 38 references that are in the map.
- First posted on arXiv 8 May 2025.

## Builds on (most cited first, 10 of 10)

- [An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale](https://mlsanity.com/paper/2010.11929/) (2020)
- [DINOv2: Learning Robust Visual Features without Supervision](https://mlsanity.com/paper/2304.07193/) (2023)
- [Masked Autoencoders Are Scalable Vision Learners](https://mlsanity.com/paper/2111.06377/) (2021)
- [Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization](https://mlsanity.com/paper/1610.02391/) (2016)
- [iBOT: Image BERT Pre-Training with Online Tokenizer](https://mlsanity.com/paper/2111.07832/) (2021)
- [Mugs: A Multi-Granular Self-Supervised Learning Framework](https://mlsanity.com/paper/2203.14415/) (2022)
- [DeepSeeNet: A deep learning model for automated classification of patient-based age-related macular degeneration severity from color fundus photographs](https://mlsanity.com/paper/1811.07492/) (2018)
- [EyeFound: A Multimodal Generalist Foundation Model for Ophthalmic Imaging](https://mlsanity.com/paper/2405.11338/) (2024)
- [GONet: A Generalizable Deep Learning Model for Glaucoma Detection](https://mlsanity.com/paper/2502.19514/) (2025)
- [HYAMD High-Resolution Fundus Image Dataset for age related macular degeneration (AMD) Diagnosis](https://mlsanity.com/paper/2505.04230/) (2025)

## Abstract (arXiv)

Self-supervised learning (SSL) has enabled Vision Transformers (ViTs) to learn robust representations from large-scale natural image datasets, enhancing their generalization across domains. In retinal imaging, foundation models pretrained on either natural or ophthalmic data have shown promise, but the benefits of in-domain pretraining remain uncertain. To investigate this, we benchmark six SSL-pretrained ViTs on seven digital fundus image (DFI) datasets totaling 70,000 expert-annotated images for the task of moderate-to-late age-related macular degeneration (AMD) identification. Our results show that iBOT pretrained on natural images achieves the highest out-of-distribution generalization, with AUROCs of 0.80-0.97, outperforming domain-specific models, which achieved AUROCs of 0.78-0.96 and a baseline ViT-L with no pretraining, which achieved AUROCs of 0.68-0.91. These findings highlight the value of foundation models in improving AMD identification and challenge the assumption that in-domain pretraining is necessary. Furthermore, we release BRAMD, an open-access dataset (n=587) of DFIs with AMD labels from Brazil.