Disentangling Co-Occurring Retinal Pathologies with Saliency-Guided Sparse Expert Routing
On the map: Mixture-of-experts → Medical and biomedical MoE
Abstract (arXiv)
Retinal fundus images frequently exhibit multiple co-occurring pathologies, yet standard deep learning classifiers apply static, identical computation to every image regardless of the underlying disease distribution. We propose a novel architecture that resolves this via sparse conditional computation, pairing a Guided Context Gating (GCG) spatial attention front-end with a sparsely-routed Mixture-of-Experts (MoE) block operating over feature tokens. Crucially, this routing yields an interpretable, data-driven decomposition. Expert allocation is significantly disease-dependent (p < 0.001), with the healthy Normal state and morphologically distinct pathologies (e.g., ERM, AMD) isolating to dedicated experts. On a five-class, patient-disjoint 5-fold cross-validation benchmark, our model achieves 0.912 +/- 0.008 macro AUC and 0.653 +/- 0.014 macro F1. Furthermore, Grad-CAM++ and post-MoE t-SNE visualizations confirm that expert routing aligns with localized lesions and geometrically maps co-occurring cases between their constituent clusters, positioning sparse MoE as an interpretable approach to multi-disease retinal screening.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical and biomedical MoE, one of 12 directions in Mixture-of-experts. Builds on 18 of its 22 references that are in the map. First posted on arXiv 10 Aug 2026.
Builds on
18 of 22 references.
References · 18
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2017Squeeze-and-Excitation Networkscited by 4,763
- 2022A ConvNet for the 2020scited by 3,545
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
- 2018CBAM: Convolutional Block Attention Modulecited by 2,463
- 2017Non-local Neural Networkscited by 2,290
- 2020GLU Variants Improve Transformercited by 1,724
- 2019Root Mean Square Layer Normalizationcited by 1,425
- 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 936
- 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 834
6 more
- 2021Scaling Vision with Sparse Mixture of Expertscited by 740
- 2019GCNet: Non-local Networks Meet Squeeze-Excitation Networks and Beyondcited by 331
- 2021A Benchmark of Ocular Disease Intelligent Recognition: One Shot for Multi-disease Detectioncited by 34
- 2024Guided Context Gating: Learning to leverage salient lesions in retinal fundus imagescited by 7
- 2022Discriminative Kernel Convolution Network for Multi-Label Ophthalmic Disease Detection on Imbalanced Fundus Image Datasetcited by 6
- 2025Ordinal Label-Distribution Learning with Constrained Asymmetric Priors for Imbalanced Retinal Gradingcited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023A Foundation Language-Image Model of the Retina (FLAIR): Encoding Expert Knowledge in Text Supervision
- 2026FOCUS: Benchmarking Retinal Model Generalization from Foundation Vision Encoders to Multimodal LLMs
- 2025Interpretable Few-Shot Retinal Disease Diagnosis with Concept-Guided Prompting of Vision-Language Models
- 2025Fine-tuning Vision Language Models with Graph-based Knowledge for Explainable Medical Image Analysis
- 2025Single Domain Generalization in Diabetic Retinopathy: A Neuro-Symbolic Learning Approach
- 2025RetinaLogos: Fine-Grained Synthesis of High-Resolution Retinal Images Through Captions
- 2024Exploring the Transferability of a Foundation Model for Fundus Images: Application to Hypertensive Retinopathy
- 2025TWLR: Text-Guided Weakly-Supervised Lesion Localization and Severity Regression for Explainable Diabetic Retinopathy Grading