Clinician-Friendly Foundation Models for Ophthalmic Image Diagnostics without Fine-Tuning or Technical Barriers
Not on the map. Why?
Abstract (arXiv)
Artificial intelligence (AI) shows remarkable potential in medical imaging diagnostics, yet most current models require retraining when applied across different clinical settings, limiting their scalability. We developed GlobeReady, a deployment-oriented platform powered by the RetiGlobe foun- dation model and local feature augmentation. RetiGlobe was pretrained in two stages: 1) self-supervised learning using DINOv2 on 38 million synthetic ophthalmic images, and 2) contrastive learning using CLIP on 475,845 real image-text pairs spanning diverse ethnicities, imaging devices, and geographic regions worldwide. We evaluate GlobeReady on 488,448 ophthalmic images, including color fundus photographs (CFPs) and optical coherence tomography scans, from multi-centres in China, Singapore, Vietnam and the UK. Prospective testing included usability assessment with 31 ophthalmologists. Exploratory analyses evaluated domain generalisability, Bayesian uncertainty quantification, out-of-distribution (OOD) detection, and feature-based case retrieval.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 24 of its 71 references that are in the map. First posted on arXiv 22 Apr 2025.
Builds on
24 of 71 references.
References · 24
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
- 2019REFUGE Challenge: A Unified Framework for Evaluating Automated Methods for Glaucoma Assessment from Fundus Photographscited by 228
- 2023Query Rewriting for Retrieval-Augmented Large Language Modelscited by 213
12 more
- 2023BiomedGPT: A Generalist Vision-Language Foundation Model for Diverse Biomedical Taskscited by 201
- 2020DeepOpht: Medical Report Generation for Retinal Images via Deep Models and Visual Explanationcited by 43
- 2018OCTID: Optical Coherence Tomography Image Databasecited by 36
- 2023AIROGS: Artificial Intelligence for RObust Glaucoma Screening Challengecited by 35
- 2020G1020: A Benchmark Retinal Fundus Image Dataset for Computer-Aided Glaucoma Detectioncited by 31
- 2023OCTDL: Optical Coherence Tomography Dataset for Image-Based Deep Learning Methodscited by 28
- 2023VisionFM: a Multi-Modal Multi-Task Vision Foundation Model for Generalist Ophthalmic Artificial Intelligencecited by 25
- 2020Visualization of Supervised and Self-Supervised Neural Networks via Attribution Guided Factorizationcited by 23
- 2023Uncertainty-inspired Open Set Learning for Retinal Anomaly Identificationcited by 18
- 2024Enhancing Diagnostic Accuracy in Rare and Common Fundus Diseases with a Knowledge-Rich Vision-Language Modelcited by 12
- 2021Deep Triplet Hashing Network for Case-based Medical Image Retrievalcited by 8
- 2025FundusGAN: A Hierarchical Feature-Aware Generative Framework for High-Fidelity Fundus Image Generationcited by 2
Built on by
Citing papers per year: 2025: 1.
1 paper.