mlsanityData to 7 Oct 2026

MoEMambaMIL: Structure-Aware Selective State Space Modeling for Whole-Slide Image Analysis

arXiv 2603.06378 ↗First posted 6 Mar 2026cs.CVcited by 0

On the map: Mixture-of-experts → Medical and biomedical MoE

also in 1 more
Abstract (arXiv)

Whole-slide image (WSI) analysis is challenging due to the gigapixel scale of slides and their inherent hierarchical multi-resolution structure. Existing multiple instance learning (MIL) approaches often model WSIs as unordered collections of patches, which limits their ability to capture structured dependencies between global tissue organization and local cellular patterns. Although recent State Space Models (SSMs) enable efficient modeling of long sequences, how to structure WSI tokens to fully exploit their spatial hierarchy remains an open problem.We propose MoEMambaMIL, a structure-aware SSM framework for WSI analysis that integrates region-nested selective scanning with mixture-of-experts (MoE) modeling. Leveraging multi-resolution preprocessing, MoEMambaMIL organizes patch tokens into region-aware sequences that preserve spatial containment across resolutions. On top of this structured sequence, we decouple resolution-aware encoding and region-adaptive contextual modeling via a combination of static, resolution-specific experts and dynamic sparse experts with learned routing. This design enables efficient long-sequence modeling while promoting expert specialization across heterogeneous diagnostic patterns. Experiments demonstrate that MoEMambaMIL achieves the best performance across 9 downstream tasks.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical and biomedical MoE, one of 12 directions in Mixture-of-experts. Builds on 14 of its 21 references that are in the map. First posted on arXiv 6 Mar 2026.

Builds on

14 of 21 references.

References · 14

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  3. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  4. 2018Attention-based Deep Multiple Instance Learningcited by 1,077
  5. 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,051
  6. 2024VMamba: Visual State Space Modelcited by 955
  7. 2021Scaling Vision with Sparse Mixture of Expertscited by 740
  8. 2020Data Efficient and Weakly Supervised Computational Pathology on Whole Slide Imagescited by 738
  9. 2021TransMIL: Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classificationcited by 549
  10. 2020Dual-stream Multiple Instance Learning Network for Whole Slide Image Classification with Self-supervised Contrastive Learningcited by 473
  11. 2022Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learningcited by 357
  12. 2024MambaMIL: Enhancing Long Sequence Modeling with Sequence Reordering in Computational Pathologycited by 87
2 more
  1. 2024MoVA: Adapting Mixture of Vision Experts to Multimodal Contextcited by 82
  2. 2023GraphMETRO: Mitigating Complex Graph Distribution Shifts via Mixture of Aligned Expertscited by 19

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026ReconMIL: Synergizing Latent Space Reconstruction with Bi-Stream Mamba for Whole Slide Image Analysis
  2. 2026KHiM-Mamba: Injecting Pathology Knowledge into Mamba via Hidden-State Modulation for Whole Slide Image Analysis
  3. 2025MambaMIL+: Modeling Long-Term Contextual Patterns for Gigapixel Whole Slide Image
  4. 2026Geometry-Aware State Space Model: A New Paradigm for Whole-Slide Image Representation
  5. 2025PathRWKV: Enhancing Whole Slide Image Inference with Asymmetric Recurrent Modeling
  6. 2024MamMIL: Multiple Instance Learning for Whole Slide Images with State Space Models
  7. 2025SemaMIL: Semantic-Aware Multiple Instance Learning with Retrieval-Guided State Space Modeling for Whole Slide Images
  8. 2026MambaBack: Bridging Local Features and Global Contexts in Whole Slide Image Analysis