mlsanityData to 7 Oct 2026

Disentangling Co-Occurring Retinal Pathologies with Saliency-Guided Sparse Expert Routing

arXiv 2608.09752 ↗First posted 10 Aug 2026cs.CV cs.LG eess.IVcited by 0

On the map: Mixture-of-experts → Medical and biomedical MoE

Abstract (arXiv)

Retinal fundus images frequently exhibit multiple co-occurring pathologies, yet standard deep learning classifiers apply static, identical computation to every image regardless of the underlying disease distribution. We propose a novel architecture that resolves this via sparse conditional computation, pairing a Guided Context Gating (GCG) spatial attention front-end with a sparsely-routed Mixture-of-Experts (MoE) block operating over feature tokens. Crucially, this routing yields an interpretable, data-driven decomposition. Expert allocation is significantly disease-dependent (p < 0.001), with the healthy Normal state and morphologically distinct pathologies (e.g., ERM, AMD) isolating to dedicated experts. On a five-class, patient-disjoint 5-fold cross-validation benchmark, our model achieves 0.912 +/- 0.008 macro AUC and 0.653 +/- 0.014 macro F1. Furthermore, Grad-CAM++ and post-MoE t-SNE visualizations confirm that expert routing aligns with localized lesions and geometrically maps co-occurring cases between their constituent clusters, positioning sparse MoE as an interpretable approach to multi-disease retinal screening.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical and biomedical MoE, one of 12 directions in Mixture-of-experts. Builds on 18 of its 22 references that are in the map. First posted on arXiv 10 Aug 2026.

Builds on

18 of 22 references.

References · 18

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2017Squeeze-and-Excitation Networkscited by 4,763
  4. 2022A ConvNet for the 2020scited by 3,545
  5. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  6. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
  7. 2018CBAM: Convolutional Block Attention Modulecited by 2,463
  8. 2017Non-local Neural Networkscited by 2,290
  9. 2020GLU Variants Improve Transformercited by 1,724
  10. 2019Root Mean Square Layer Normalizationcited by 1,425
  11. 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 936
  12. 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 834
6 more
  1. 2021Scaling Vision with Sparse Mixture of Expertscited by 740
  2. 2019GCNet: Non-local Networks Meet Squeeze-Excitation Networks and Beyondcited by 331
  3. 2021A Benchmark of Ocular Disease Intelligent Recognition: One Shot for Multi-disease Detectioncited by 34
  4. 2024Guided Context Gating: Learning to leverage salient lesions in retinal fundus imagescited by 7
  5. 2022Discriminative Kernel Convolution Network for Multi-Label Ophthalmic Disease Detection on Imbalanced Fundus Image Datasetcited by 6
  6. 2025Ordinal Label-Distribution Learning with Constrained Asymmetric Priors for Imbalanced Retinal Gradingcited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023A Foundation Language-Image Model of the Retina (FLAIR): Encoding Expert Knowledge in Text Supervision
  2. 2026FOCUS: Benchmarking Retinal Model Generalization from Foundation Vision Encoders to Multimodal LLMs
  3. 2025Interpretable Few-Shot Retinal Disease Diagnosis with Concept-Guided Prompting of Vision-Language Models
  4. 2025Fine-tuning Vision Language Models with Graph-based Knowledge for Explainable Medical Image Analysis
  5. 2025Single Domain Generalization in Diabetic Retinopathy: A Neuro-Symbolic Learning Approach
  6. 2025RetinaLogos: Fine-Grained Synthesis of High-Resolution Retinal Images Through Captions
  7. 2024Exploring the Transferability of a Foundation Model for Fundus Images: Application to Hypertensive Retinopathy
  8. 2025TWLR: Text-Guided Weakly-Supervised Lesion Localization and Severity Regression for Explainable Diabetic Retinopathy Grading