AIROGS: Artificial Intelligence for RObust Glaucoma Screening Challenge
Not on the map. Why?
Abstract (arXiv)
The early detection of glaucoma is essential in preventing visual impairment. Artificial intelligence (AI) can be used to analyze color fundus photographs (CFPs) in a cost-effective manner, making glaucoma screening more accessible. While AI models for glaucoma screening from CFPs have shown promising results in laboratory settings, their performance decreases significantly in real-world scenarios due to the presence of out-of-distribution and low-quality images. To address this issue, we propose the Artificial Intelligence for Robust Glaucoma Screening (AIROGS) challenge. This challenge includes a large dataset of around 113,000 images from about 60,000 patients and 500 different screening centers, and encourages the development of algorithms that are robust to ungradable and unexpected input data. We evaluated solutions from 14 teams in this paper, and found that the best teams performed similarly to a set of 20 expert ophthalmologists and optometrists. The highest-scoring team achieved an area under the receiver operating characteristic curve of 0.99 (95% CI: 0.98-0.99) for detecting ungradable images on-the-fly. Additionally, many of the algorithms showed robust performance when tested on three other publicly available datasets. These results demonstrate the feasibility of robust AI-enabled glaucoma screening.
Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). Builds on 42 of its 98 references that are in the map. First posted on arXiv 3 Feb 2023.
Builds on
42 of 98 references.
References · 42
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2017Squeeze-and-Excitation Networkscited by 4,763
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
30 more
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,827
- 2022A ConvNet for the 2020scited by 3,545
- 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,261
- 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,509
- 2020Sharpness-Aware Minimization for Efficiently Improving Generalizationcited by 1,404
- 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,304
- 2020Energy-based Out-of-distribution Detectioncited by 1,296
- 2018Unified Perceptual Parsing for Scene Understandingcited by 1,265
- 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,218
- 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,127
- 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 954
- 2017Focal Loss for Dense Object Detectioncited by 749
- 2018AutoAugment: Learning Augmentation Policies from Datacited by 728
- 2021ReAct: Out-of-distribution Detection With Rectified Activationscited by 486
- 2021Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysiscited by 418
- 2021Open-Set Recognition: a Good Closed-Set Classifier is All You Need?cited by 351
- 2019REFUGE Challenge: A Unified Framework for Evaluating Automated Methods for Glaucoma Assessment from Fundus Photographscited by 226
- 2021TrivialAugment: Tuning-free Yet State-of-the-Art Data Augmentationcited by 225
- 2020Medical Image Segmentation Using Deep Learning: A Surveycited by 163
- 2021Revisiting ResNets: Improved Training and Scaling Strategiescited by 158
- 2021An Image is Worth 16x16 Words, What is a Video Worth?cited by 87
- 2022GAMMA Challenge:Glaucoma grAding from Multi-Modality imAgescited by 45
- 2019One-Class Convolutional Neural Networkcited by 37
- 2022REFUGE2 Challenge: A Treasure Trove for Multi-Dimension Analysis and Evaluation in Glaucoma Screeningcited by 37
- 2018Towards a glaucoma risk index based on simulated hemodynamics from fundus imagescited by 31
- 2021Single Layer Predictive Normalized Maximum Likelihood for Out-of-Distribution Detectioncited by 23
- 2019Evaluation of an AI system for the automated detection of glaucoma from stereoscopic optic disc photographs: the European Optic Disc Assessment Studycited by 2
- 2022Computer Aided Diagnosis and Out-of-Distribution Detection in Glaucoma Screening Using Color Fundus Photographycited by 1
- 2022Deep Dirichlet uncertainty for unsupervised out-of-distribution detection of eye fundus photographs in glaucoma screeningcited by 1
Built on by
Citing papers per year: 2023: 4; 2024: 14; 2025: 14; 2026: 3.
35 papers.
Sort:
By area:
- 2024OmniMedVQA: A New Large-Scale Comprehensive Evaluation Benchmark for Medical LVLMcited by 182
- 2023On the Challenges and Perspectives of Foundation Models for Medical Image Analysiscited by 135
- 2025Baichuan-Omni-1.5 Technical Reportcited by 107
- 2023A Foundation Language-Image Model of the Retina (FLAIR): Encoding Expert Knowledge in Text Supervisioncited by 78
- 2024VisionUnite: A Vision-Language Foundation Model for Ophthalmology Enhanced with Clinical Knowledgecited by 19
- 2024Enhancing Diagnostic Accuracy in Rare and Common Fundus Diseases with a Knowledge-Rich Vision-Language Modelcited by 12
- 2024Training a high-performance retinal foundation model with half-the-data and 400 times less computecited by 9
- 2024Advancing Medical Image Segmentation with Mini-Net: A Lightweight Solution Tailored for Efficient Segmentation of Medical Imagescited by 9
- 2023Systematic comparison of semi-supervised and self-supervised learning for medical image classificationcited by 8
- 2025A Pragmatic Note on Evaluating Generative Models with Fr'echet Inception Distance for Retinal Image Synthesiscited by 8
- 2024Mask of truth: model sensitivity to unexpected regions of medical imagescited by 6
- 2025RetinaLogos: Fine-Grained Synthesis of High-Resolution Retinal Images Through Captionscited by 5
23 more
- 2023SynFundus-1M: A High-quality Million-scale Synthetic fundus images Dataset with Fifteen Types of Annotationcited by 4
- 2024Region Guided Attention Network for Retinal Vessel Segmentationcited by 4
- 2024Exploring the Transferability of a Foundation Model for Fundus Images: Application to Hypertensive Retinopathycited by 2
- 2024Evaluating Self-Supervised Learning in Medical Imaging: A Benchmark for Robustness, Generalizability, and Multi-Domain Impactcited by 2
- 2025Predicting Diabetic Macular Edema Treatment Responses Using OCT: Dataset and Methods of APTOS Competitioncited by 2
- 2025Boosting Medical Visual Understanding From Multi-Granular Language Learningcited by 2
- 2024DiffuPT: Class Imbalance Mitigation for Glaucoma Detection via Diffusion Based Generation and Model Pretrainingcited by 1
- 2024Exploring Compositional Generalization of Multimodal LLMs for Medical Imagingcited by 1
- 2025Enhancing Fundus Image-based Glaucoma Screening via Dynamic Global-Local Feature Integrationcited by 1
- 2025Clinician-Friendly Foundation Models for Ophthalmic Image Diagnostics without Fine-Tuning or Technical Barrierscited by 1
- 2025BioVessel-Net and RetinaMix: Unsupervised Retinal Vessel Segmentation from OCTA Imagescited by 1
- 2025Forging a Dynamic Memory: Retrieval-Guided Continual Learning for Generalist Medical Foundation Modelscited by 1
- 2025Native Intelligence Emerges from Large-Scale Clinical Practice: A Retinal Foundation Model with Deployment Efficiencycited by 1
- 2024Compute-Efficient Medical Image Classification with Softmax-Free Transformers and Sequence Normalizationcited by 0
- 2024Adenocarcinoma Segmentation Using Pre-trained Swin-UNet with Parallel Cross-Attention for Multi-Domain Imagingcited by 0
- 2024AI-Driven Approaches for Glaucoma Detection -- A Comprehensive Reviewcited by 0
- 2025Deep Learning for Ophthalmology: The State-of-the-Art and Future Trendscited by 0
- 2025Is Uncertainty Quantification a Viable Alternative to Learned Deferral?cited by 0
- 2025Automated Multi-label Classification of Eleven Retinal Diseases: A Benchmark of Modern Architectures and a Meta-Ensemble on a Large Synthetic Datasetcited by 0
- 2025Two-Stage Decoupling Framework for Variable-Length Glaucoma Prognosiscited by 0
- 2026M-IDoL: Information Decomposition for Modality-Specific and Diverse Representation Learning in Medical Foundation Modelcited by 0
- 2026Fundus Image-based Glaucoma Screening via Retinal Knowledge-Oriented Dynamic Multi-Level Feature Integrationcited by 0
- 2026EyeVQA: Benchmarking Ophthalmic Vision-Language Models from Recognition to Spatial Groundingcited by 0
- 2026EyeVQA: Benchmarking Ophthalmic Vision-Language Models from Recognition to Spatial Grounding26 Sep 2026
- 2026Fundus Image-based Glaucoma Screening via Retinal Knowledge-Oriented Dynamic Multi-Level Feature Integration14 Apr 2026
- 2026M-IDoL: Information Decomposition for Modality-Specific and Diverse Representation Learning in Medical Foundation Model10 Apr 2026
- 2025Native Intelligence Emerges from Large-Scale Clinical Practice: A Retinal Foundation Model with Deployment Efficiency16 Dec 2025
- 2025Forging a Dynamic Memory: Retrieval-Guided Continual Learning for Generalist Medical Foundation Models15 Dec 2025
- 2025Boosting Medical Visual Understanding From Multi-Granular Language Learning20 Nov 2025
- 2025BioVessel-Net and RetinaMix: Unsupervised Retinal Vessel Segmentation from OCTA Images28 Sep 2025
- 2025Two-Stage Decoupling Framework for Variable-Length Glaucoma Prognosis15 Sep 2025
- 2025Automated Multi-label Classification of Eleven Retinal Diseases: A Benchmark of Modern Architectures and a Meta-Ensemble on a Large Synthetic Dataset21 Aug 2025
- 2025Is Uncertainty Quantification a Viable Alternative to Learned Deferral?4 Aug 2025
- 2025RetinaLogos: Fine-Grained Synthesis of High-Resolution Retinal Images Through Captions19 May 2025
- 2025Predicting Diabetic Macular Edema Treatment Responses Using OCT: Dataset and Methods of APTOS Competition9 May 2025
23 more
- 2025Clinician-Friendly Foundation Models for Ophthalmic Image Diagnostics without Fine-Tuning or Technical Barriers22 Apr 2025
- 2025Enhancing Fundus Image-based Glaucoma Screening via Dynamic Global-Local Feature Integration1 Apr 2025
- 2025A Pragmatic Note on Evaluating Generative Models with Fr'echet Inception Distance for Retinal Image Synthesis24 Feb 2025
- 2025Baichuan-Omni-1.5 Technical Report26 Jan 2025
- 2025Deep Learning for Ophthalmology: The State-of-the-Art and Future Trends7 Jan 2025
- 2024Exploring Compositional Generalization of Multimodal LLMs for Medical Imaging28 Dec 2024
- 2024Evaluating Self-Supervised Learning in Medical Imaging: A Benchmark for Robustness, Generalizability, and Multi-Domain Impact26 Dec 2024
- 2024Mask of truth: model sensitivity to unexpected regions of medical images5 Dec 2024
- 2024DiffuPT: Class Imbalance Mitigation for Glaucoma Detection via Diffusion Based Generation and Model Pretraining4 Dec 2024
- 2024AI-Driven Approaches for Glaucoma Detection -- A Comprehensive Review21 Oct 2024
- 2024Adenocarcinoma Segmentation Using Pre-trained Swin-UNet with Parallel Cross-Attention for Multi-Domain Imaging23 Sep 2024
- 2024VisionUnite: A Vision-Language Foundation Model for Ophthalmology Enhanced with Clinical Knowledge5 Aug 2024
- 2024Region Guided Attention Network for Retinal Vessel Segmentation22 Jul 2024
- 2024Enhancing Diagnostic Accuracy in Rare and Common Fundus Diseases with a Knowledge-Rich Vision-Language Model13 Jun 2024
- 2024Compute-Efficient Medical Image Classification with Softmax-Free Transformers and Sequence Normalization3 Jun 2024
- 2024Advancing Medical Image Segmentation with Mini-Net: A Lightweight Solution Tailored for Efficient Segmentation of Medical Images27 May 2024
- 2024Training a high-performance retinal foundation model with half-the-data and 400 times less compute30 Apr 2024
- 2024OmniMedVQA: A New Large-Scale Comprehensive Evaluation Benchmark for Medical LVLM14 Feb 2024
- 2024Exploring the Transferability of a Foundation Model for Fundus Images: Application to Hypertensive Retinopathy27 Jan 2024
- 2023SynFundus-1M: A High-quality Million-scale Synthetic fundus images Dataset with Fifteen Types of Annotation1 Dec 2023
- 2023A Foundation Language-Image Model of the Retina (FLAIR): Encoding Expert Knowledge in Text Supervision15 Aug 2023
- 2023Systematic comparison of semi-supervised and self-supervised learning for medical image classification18 Jul 2023
- 2023On the Challenges and Perspectives of Foundation Models for Medical Image Analysis9 Jun 2023
- 2024OmniMedVQA: A New Large-Scale Comprehensive Evaluation Benchmark for Medical LVLMcited by 182
- 2023A Foundation Language-Image Model of the Retina (FLAIR): Encoding Expert Knowledge in Text Supervisioncited by 78
- 2024VisionUnite: A Vision-Language Foundation Model for Ophthalmology Enhanced with Clinical Knowledgecited by 19
- 2024Enhancing Diagnostic Accuracy in Rare and Common Fundus Diseases with a Knowledge-Rich Vision-Language Modelcited by 12
- 2024Exploring Compositional Generalization of Multimodal LLMs for Medical Imagingcited by 1
- 2025Forging a Dynamic Memory: Retrieval-Guided Continual Learning for Generalist Medical Foundation Modelscited by 1
- 2026EyeVQA: Benchmarking Ophthalmic Vision-Language Models from Recognition to Spatial Groundingcited by 0
- 2026EyeVQA: Benchmarking Ophthalmic Vision-Language Models from Recognition to Spatial Grounding26 Sep 2026
- 2025Forging a Dynamic Memory: Retrieval-Guided Continual Learning for Generalist Medical Foundation Models15 Dec 2025
- 2024Exploring Compositional Generalization of Multimodal LLMs for Medical Imaging28 Dec 2024
- 2024VisionUnite: A Vision-Language Foundation Model for Ophthalmology Enhanced with Clinical Knowledge5 Aug 2024
- 2024Enhancing Diagnostic Accuracy in Rare and Common Fundus Diseases with a Knowledge-Rich Vision-Language Model13 Jun 2024
- 2024OmniMedVQA: A New Large-Scale Comprehensive Evaluation Benchmark for Medical LVLM14 Feb 2024
- 2023A Foundation Language-Image Model of the Retina (FLAIR): Encoding Expert Knowledge in Text Supervision15 Aug 2023
- 2023On the Challenges and Perspectives of Foundation Models for Medical Image Analysiscited by 135
- 2025Baichuan-Omni-1.5 Technical Reportcited by 107
- 2024Training a high-performance retinal foundation model with half-the-data and 400 times less computecited by 9
- 2024Advancing Medical Image Segmentation with Mini-Net: A Lightweight Solution Tailored for Efficient Segmentation of Medical Imagescited by 9
- 2023Systematic comparison of semi-supervised and self-supervised learning for medical image classificationcited by 8
- 2025A Pragmatic Note on Evaluating Generative Models with Fr'echet Inception Distance for Retinal Image Synthesiscited by 8
- 2024Mask of truth: model sensitivity to unexpected regions of medical imagescited by 6
- 2025RetinaLogos: Fine-Grained Synthesis of High-Resolution Retinal Images Through Captionscited by 5
- 2023SynFundus-1M: A High-quality Million-scale Synthetic fundus images Dataset with Fifteen Types of Annotationcited by 4
- 2024Region Guided Attention Network for Retinal Vessel Segmentationcited by 4
- 2024Exploring the Transferability of a Foundation Model for Fundus Images: Application to Hypertensive Retinopathycited by 2
- 2024Evaluating Self-Supervised Learning in Medical Imaging: A Benchmark for Robustness, Generalizability, and Multi-Domain Impactcited by 2
12 most cited of 26 All 26 (JSON)
- 2026Fundus Image-based Glaucoma Screening via Retinal Knowledge-Oriented Dynamic Multi-Level Feature Integration14 Apr 2026
- 2025Native Intelligence Emerges from Large-Scale Clinical Practice: A Retinal Foundation Model with Deployment Efficiency16 Dec 2025
- 2025Boosting Medical Visual Understanding From Multi-Granular Language Learning20 Nov 2025
- 2025BioVessel-Net and RetinaMix: Unsupervised Retinal Vessel Segmentation from OCTA Images28 Sep 2025
- 2025Two-Stage Decoupling Framework for Variable-Length Glaucoma Prognosis15 Sep 2025
- 2025Automated Multi-label Classification of Eleven Retinal Diseases: A Benchmark of Modern Architectures and a Meta-Ensemble on a Large Synthetic Dataset21 Aug 2025
- 2025Is Uncertainty Quantification a Viable Alternative to Learned Deferral?4 Aug 2025
- 2025RetinaLogos: Fine-Grained Synthesis of High-Resolution Retinal Images Through Captions19 May 2025
- 2025Predicting Diabetic Macular Edema Treatment Responses Using OCT: Dataset and Methods of APTOS Competition9 May 2025
- 2025Clinician-Friendly Foundation Models for Ophthalmic Image Diagnostics without Fine-Tuning or Technical Barriers22 Apr 2025
- 2025Enhancing Fundus Image-based Glaucoma Screening via Dynamic Global-Local Feature Integration1 Apr 2025
- 2025A Pragmatic Note on Evaluating Generative Models with Fr'echet Inception Distance for Retinal Image Synthesis24 Feb 2025
12 newest of 26 All 26 (JSON)