MoEMambaMIL: Structure-Aware Selective State Space Modeling for Whole-Slide Image Analysis
On the map: Mixture-of-experts → Medical and biomedical MoE
Abstract (arXiv)
Whole-slide image (WSI) analysis is challenging due to the gigapixel scale of slides and their inherent hierarchical multi-resolution structure. Existing multiple instance learning (MIL) approaches often model WSIs as unordered collections of patches, which limits their ability to capture structured dependencies between global tissue organization and local cellular patterns. Although recent State Space Models (SSMs) enable efficient modeling of long sequences, how to structure WSI tokens to fully exploit their spatial hierarchy remains an open problem.We propose MoEMambaMIL, a structure-aware SSM framework for WSI analysis that integrates region-nested selective scanning with mixture-of-experts (MoE) modeling. Leveraging multi-resolution preprocessing, MoEMambaMIL organizes patch tokens into region-aware sequences that preserve spatial containment across resolutions. On top of this structured sequence, we decouple resolution-aware encoding and region-adaptive contextual modeling via a combination of static, resolution-specific experts and dynamic sparse experts with learned routing. This design enables efficient long-sequence modeling while promoting expert specialization across heterogeneous diagnostic patterns. Experiments demonstrate that MoEMambaMIL achieves the best performance across 9 downstream tasks.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical and biomedical MoE, one of 12 directions in Mixture-of-experts. Builds on 14 of its 21 references that are in the map. First posted on arXiv 6 Mar 2026.
Builds on
14 of 21 references.
References · 14
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
- 2018Attention-based Deep Multiple Instance Learningcited by 1,077
- 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,051
- 2024VMamba: Visual State Space Modelcited by 955
- 2021Scaling Vision with Sparse Mixture of Expertscited by 740
- 2020Data Efficient and Weakly Supervised Computational Pathology on Whole Slide Imagescited by 738
- 2021TransMIL: Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classificationcited by 549
- 2020Dual-stream Multiple Instance Learning Network for Whole Slide Image Classification with Self-supervised Contrastive Learningcited by 473
- 2022Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learningcited by 357
- 2024MambaMIL: Enhancing Long Sequence Modeling with Sequence Reordering in Computational Pathologycited by 87
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026ReconMIL: Synergizing Latent Space Reconstruction with Bi-Stream Mamba for Whole Slide Image Analysis
- 2026KHiM-Mamba: Injecting Pathology Knowledge into Mamba via Hidden-State Modulation for Whole Slide Image Analysis
- 2025MambaMIL+: Modeling Long-Term Contextual Patterns for Gigapixel Whole Slide Image
- 2026Geometry-Aware State Space Model: A New Paradigm for Whole-Slide Image Representation
- 2025PathRWKV: Enhancing Whole Slide Image Inference with Asymmetric Recurrent Modeling
- 2024MamMIL: Multiple Instance Learning for Whole Slide Images with State Space Models
- 2025SemaMIL: Semantic-Aware Multiple Instance Learning with Retrieval-Guided State Space Modeling for Whole Slide Images
- 2026MambaBack: Bridging Local Features and Global Contexts in Whole Slide Image Analysis