Multi-Label Retinal Disease Classification using Transformers
Not on the map. Why?
Abstract (arXiv)
Early detection of retinal diseases is one of the most important means of preventing partial or permanent blindness in patients. In this research, a novel multi-label classification system is proposed for the detection of multiple retinal diseases, using fundus images collected from a variety of sources. First, a new multi-label retinal disease dataset, the MuReD dataset, is constructed, using a number of publicly available datasets for fundus disease classification. Next, a sequence of post-processing steps is applied to ensure the quality of the image data and the range of diseases, present in the dataset. For the first time in fundus multi-label disease classification, a transformer-based model optimized through extensive experimentation is used for image analysis and decision making. Numerous experiments are performed to optimize the configuration of the proposed system. It is shown that the approach performs better than state-of-the-art works on the same task by 7.9% and 8.1% in terms of AUC score for disease detection and disease classification, respectively. The obtained results further support the potential applications of transformer-based architectures in the medical imaging field.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 20 of its 76 references that are in the map. First posted on arXiv 5 Jul 2022.
Builds on
20 of 76 references.
References · 20
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2016Wide Residual Networkscited by 3,057
- 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
- 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,540
- 2015Learning Deep Features for Discriminative Localizationcited by 2,430
- 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,304
8 more
- 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,127
- 2017Focal Loss for Dense Object Detectioncited by 749
- 2018Albumentations: fast and flexible image augmentationscited by 558
- 2020Asymmetric Loss For Multi-Label Classificationcited by 379
- 2019Billion-scale semi-supervised learning for image classificationcited by 232
- 2020General Multi-label Image Classification with Transformerscited by 126
- 2022PolyLoss: A Polynomial Expansion Perspective of Classification Loss Functionscited by 62
- 2017HPSLPred: An Ensemble Multi-label Classifier for Human Protein Subcellular Location Prediction with Imbalanced Sourcecited by 1
Built on by
Citing papers per year: 2023: 2; 2024: 8; 2025: 6; 2026: 2.
18 papers.
Sort:
By area:
- 2024VisionUnite: A Vision-Language Foundation Model for Ophthalmology Enhanced with Clinical Knowledgecited by 19
- 2024Deep Learning for Multi-Label Learning: A Comprehensive Surveycited by 18
- 2024CoBooM: Codebook Guided Bootstrapping for Medical Image Representation Learningcited by 2
- 2024Automatic Differential Diagnosis using Transformer-Based Multi-Label Sequence Classificationcited by 2
- 2025Boosting Medical Visual Understanding From Multi-Granular Language Learningcited by 2
- 2024Adaptive Multiscale Retinal Diagnosis: A Hybrid Trio-Model Approach for Comprehensive Fundus Multi-Disease Detection Leveraging Transfer Learning and Siamese Networkscited by 1
- 2024Exploring Compositional Generalization of Multimodal LLMs for Medical Imagingcited by 1
- 2025Retinal Fundus Multi-Disease Image Classification using Hybrid CNN-Transformer-Ensemble Architecturescited by 1
- 2025GlaBoost: A Multimodal Structured Framework for Glaucoma Risk Stratificationcited by 1
- 2025PSScreen: Partially Supervised Multiple Retinal Disease Screeningcited by 1
- 2023PMP-Swin: Multi-Scale Patch Message Passing Swin Transformer for Retinal Disease Classificationcited by 0
- 2023ECAMP: Entity-centered Context-aware Medical Vision Language Pre-trainingcited by 0
6 more
- 2024Explainable AI: Comparative Analysis of Normal and Dilated ResNet Models for Fundus Disease Classificationcited by 0
- 2024Trends, Challenges, and Future Directions in Deep Learning for Glaucoma: A Systematic Reviewcited by 0
- 2025Information Bottleneck-based Causal Attention for Multi-label Medical Image Recognitioncited by 0
- 2025PSScreen V2: Partially Supervised Multiple Retinal Disease Screeningcited by 0
- 2026Quasi-multimodal-based pathophysiological feature learning for retinal disease diagnosiscited by 0
- 2026MAPLE: Multi-Path Adaptive Propagation with Level-Aware Embeddings for Hierarchical Multi-Label Image Classificationcited by 0
- 2026MAPLE: Multi-Path Adaptive Propagation with Level-Aware Embeddings for Hierarchical Multi-Label Image Classification31 Mar 2026
- 2026Quasi-multimodal-based pathophysiological feature learning for retinal disease diagnosis3 Feb 2026
- 2025Boosting Medical Visual Understanding From Multi-Granular Language Learning20 Nov 2025
- 2025PSScreen V2: Partially Supervised Multiple Retinal Disease Screening26 Oct 2025
- 2025PSScreen: Partially Supervised Multiple Retinal Disease Screening14 Aug 2025
- 2025Information Bottleneck-based Causal Attention for Multi-label Medical Image Recognition11 Aug 2025
- 2025GlaBoost: A Multimodal Structured Framework for Glaucoma Risk Stratification3 Aug 2025
- 2025Retinal Fundus Multi-Disease Image Classification using Hybrid CNN-Transformer-Ensemble Architectures27 Mar 2025
- 2024Exploring Compositional Generalization of Multimodal LLMs for Medical Imaging28 Dec 2024
- 2024Trends, Challenges, and Future Directions in Deep Learning for Glaucoma: A Systematic Review7 Nov 2024
- 2024Automatic Differential Diagnosis using Transformer-Based Multi-Label Sequence Classification28 Aug 2024
- 2024CoBooM: Codebook Guided Bootstrapping for Medical Image Representation Learning8 Aug 2024
6 more
- 2024VisionUnite: A Vision-Language Foundation Model for Ophthalmology Enhanced with Clinical Knowledge5 Aug 2024
- 2024Explainable AI: Comparative Analysis of Normal and Dilated ResNet Models for Fundus Disease Classification7 Jul 2024
- 2024Adaptive Multiscale Retinal Diagnosis: A Hybrid Trio-Model Approach for Comprehensive Fundus Multi-Disease Detection Leveraging Transfer Learning and Siamese Networks28 May 2024
- 2024Deep Learning for Multi-Label Learning: A Comprehensive Survey29 Jan 2024
- 2023ECAMP: Entity-centered Context-aware Medical Vision Language Pre-training20 Dec 2023
- 2023PMP-Swin: Multi-Scale Patch Message Passing Swin Transformer for Retinal Disease Classification20 Nov 2023
- 2024Deep Learning for Multi-Label Learning: A Comprehensive Surveycited by 18
- 2024CoBooM: Codebook Guided Bootstrapping for Medical Image Representation Learningcited by 2
- 2024Automatic Differential Diagnosis using Transformer-Based Multi-Label Sequence Classificationcited by 2
- 2025Boosting Medical Visual Understanding From Multi-Granular Language Learningcited by 2
- 2024Adaptive Multiscale Retinal Diagnosis: A Hybrid Trio-Model Approach for Comprehensive Fundus Multi-Disease Detection Leveraging Transfer Learning and Siamese Networkscited by 1
- 2025Retinal Fundus Multi-Disease Image Classification using Hybrid CNN-Transformer-Ensemble Architecturescited by 1
- 2025GlaBoost: A Multimodal Structured Framework for Glaucoma Risk Stratificationcited by 1
- 2025PSScreen: Partially Supervised Multiple Retinal Disease Screeningcited by 1
- 2023PMP-Swin: Multi-Scale Patch Message Passing Swin Transformer for Retinal Disease Classificationcited by 0
- 2024Explainable AI: Comparative Analysis of Normal and Dilated ResNet Models for Fundus Disease Classificationcited by 0
- 2024Trends, Challenges, and Future Directions in Deep Learning for Glaucoma: A Systematic Reviewcited by 0
- 2025Information Bottleneck-based Causal Attention for Multi-label Medical Image Recognitioncited by 0
12 most cited of 15 All 15 (JSON)
- 2026MAPLE: Multi-Path Adaptive Propagation with Level-Aware Embeddings for Hierarchical Multi-Label Image Classification31 Mar 2026
- 2026Quasi-multimodal-based pathophysiological feature learning for retinal disease diagnosis3 Feb 2026
- 2025Boosting Medical Visual Understanding From Multi-Granular Language Learning20 Nov 2025
- 2025PSScreen V2: Partially Supervised Multiple Retinal Disease Screening26 Oct 2025
- 2025PSScreen: Partially Supervised Multiple Retinal Disease Screening14 Aug 2025
- 2025Information Bottleneck-based Causal Attention for Multi-label Medical Image Recognition11 Aug 2025
- 2025GlaBoost: A Multimodal Structured Framework for Glaucoma Risk Stratification3 Aug 2025
- 2025Retinal Fundus Multi-Disease Image Classification using Hybrid CNN-Transformer-Ensemble Architectures27 Mar 2025
- 2024Trends, Challenges, and Future Directions in Deep Learning for Glaucoma: A Systematic Review7 Nov 2024
- 2024Automatic Differential Diagnosis using Transformer-Based Multi-Label Sequence Classification28 Aug 2024
- 2024CoBooM: Codebook Guided Bootstrapping for Medical Image Representation Learning8 Aug 2024
- 2024Explainable AI: Comparative Analysis of Normal and Dilated ResNet Models for Fundus Disease Classification7 Jul 2024
12 newest of 15 All 15 (JSON)