HierarchiRetina: A Diabetic Retinopathy Screening and Grading Cascade with Heterogeneous Mixture-of-Experts Lesion Segmentation
On the map: Mixture-of-experts → Medical and biomedical MoE
Abstract (arXiv)
Clinical screening for diabetic retinopathy proceeds in stages, yet most automated systems grade fundus images with a single black-box network. Three gaps remain: (i) lesions differ widely in size and contrast, but segmenters typically apply the same blocks to all; (ii) ungradable images are usually excluded or treated as an extra class, and lesion-aware graders seldom test whether lesions drive the grade; (iii) staged systems often report each stage only on the images reaching it, leaving propagated errors unmeasured. HierarchiRetina, a screening, segmentation and grading cascade with inspectable stage outputs, addresses each gap. First, HSMoE-AUNet is a U-Net whose skip, bottleneck and decoder blocks are sparse mixtures of heterogeneous experts, with lesion-matched types, counts and losses; SwinHRUNetPP, a dual-encoder vessel segmenter, uses a field-of-view-restricted loss. Second, LG-DRG separates gradability from ordinal severity and lets lesion masks query the image through gated cross-attention. Third, an end-to-end evaluation counts screening misses as errors and traces each error to its stage. Pooled Dice ranged from 0.184 (microaneurysms) to 0.579 (exudates); vessel Dice was 0.731. On 58,689 held-out images from six datasets, end-to-end quadratic weighted kappa was 0.804, with referral sensitivity 0.832 at specificity 0.947, and the screening gate caused 66% of errors. In ablations, the grade ignored the masks, even with the cross-attention gate started open. On all 4,105 official DDR test images, six-class accuracy was 85.6%, above the best published six-class result we found (83.8%). Staged screening systems should be evaluated end-to-end, with stage attribution and mask ablation, before clinical deployment.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Medical and biomedical MoE, one of 12 directions in Mixture-of-experts. Builds on 16 of its 35 references that are in the map. First posted on arXiv 13 Oct 2026.
Builds on
16 of 35 references.
References · 16
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2017Squeeze-and-Excitation Networkscited by 4,789
- 2022A ConvNet for the 2020scited by 3,579
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
- 2018CBAM: Convolutional Block Attention Modulecited by 2,477
- 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,435
- 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,228
- 2023ConvNeXt V2: Co-designing and Scaling ConvNets with Masked Autoencoderscited by 712
- 2020clDice -- A Novel Topology-Preserving Loss Function for Tubular Structure Segmentationcited by 294
- 2018A Novel Focal Tversky loss function with improved Attention U-Net for lesion segmentationcited by 172
- 2021Deep Neural Networks for Rank-Consistent Ordinal Regression Based On Conditional Probabilitiescited by 59
4 more
- 2020A Benchmark for Studying Diabetic Retinopathy: Segmentation, Grading, and Transferabilitycited by 49
- 2017Grader variability and the importance of reference standards for evaluating machine learning models for diabetic retinopathycited by 44
- 2024MAPLES-DR: MESSIDOR Anatomical and Pathological Labels for Explainable Screening of Diabetic Retinopathycited by 5
- 2025Integrating Non-Linear Radon Transformation for Diabetic Retinopathy Gradingcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024TP-DRSeg: Improving Diabetic Retinopathy Lesion Segmentation with Explicit Text-Prompts Assisted SAM
- 2024Adversarial Vessel-Unveiling Semi-Supervised Segmentation for Retinopathy of Prematurity Diagnosis
- 2026Retina-RAG: Retrieval-Augmented Vision-Language Modeling for Joint Retinal Diagnosis and Clinical Report Generation
- 2026From Pixels to Explanations: Interpretable Diabetic Retinopathy Grading with CNN-Transformer Ensembles, Visual Explainability and Vision-Language Models
- 2024CLIP-DR: Textual Knowledge-Guided Diabetic Retinopathy Grading with Ranking-aware Prompting
- 2026Benchmarking Convolutional, Transformer, Hybrid, and Vision Language Models for Multi Disease Retinal Screening
- 2025TWLR: Text-Guided Weakly-Supervised Lesion Localization and Severity Regression for Explainable Diabetic Retinopathy Grading
- 2026Disentangling Co-Occurring Retinal Pathologies with Saliency-Guided Sparse Expert Routing