mlsanityData to 7 Oct 2026

Medical and biomedical MoE

139 papers1 this weekHigh confidence in this grouping: the papers form one clear topicHigh confidence in this grouping: the papers form one clear topic · About

Keywords: medical, clinical, framework, segmentation, mixture-of-experts

Key facts. Medical and biomedical MoE: 139 papers on arXiv since 2018 (data through 7 Oct 2026). 7 of its 139 mapped papers (5%) cite “M4oE: A Foundation Model for Medical Multimodal Image Segmentation with Mixture of Experts” (2024, arXiv 2405.09446). 6 of its 139 mapped papers (4%) cite “Med-MoE: Mixture of Domain-Specific Experts for Lightweight Medical Vision-Language Models” (2024, arXiv 2404.10237). 4 new papers 17 Sep–7 Oct.

What’s new

17 Sep – 7 Oct 2026

  1. This week · 1
  2. Anchor-driven Multi-modal Multi-scale Expert Selection for Survival Prediction
  3. Earlier · 3
  4. Homogeneous Semantic Alignment and Hierarchical Expert Routing for Radiology Report Generation
  5. Role-Guided MOE for Encoder-Level Pathology Representation Learning in WSI Classification
  6. EEG-Fusion: Failure-Informed Source-Free Expert Routing for Robust Motor Imagery EEG Decoding

Foundations

Most cited by papers here

  1. M4oE: A Foundation Model for Medical Multimodal Image Segmentation with Mixture of Experts2024cited by 7 here
  2. Med-MoE: Mixture of Domain-Specific Experts for Lightweight Medical Vision-Language Models2024cited by 6 here
  3. When MOE Meets LLMs: Parameter Efficient Fine-tuning for Multi-task Medical Applications2023cited by 4 here
  4. SAM-Med3D-MoE: Towards a Non-Forgetting Segment Anything Model via Mixture of Experts for 3D Medical Image Segmentation2024cited by 3 here
  5. MedMoE: Modality-Specialized Mixture of Experts for Medical Vision-Language Understanding2025cited by 3 here

Lineage

The papers this direction builds on, oldest first.

Each paper on the line cites the one before.

  1. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 35 here
  2. 2020GShard: Scaling Giant Models with Conditional Computation and Automatic Shardingcited by 11 here
  3. 2021Scaling Vision with Sparse Mixture of Expertscited by 14 here
  4. 2022ST-MoE: Designing Stable and Transferable Sparse Expert Modelscited by 4 here
  5. 2022Multimodal Contrastive Learning with LIMoE: the Language-Image Mixture of Expertscited by 5 here
  6. 2023Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction Tuningcited by 6 here
  7. 2023When MOE Meets LLMs: Parameter Efficient Fine-tuning for Multi-task Medical Applicationscited by 4 here
  8. 2024MixLoRA: Enhancing Large Language Models Fine-Tuning with LoRA-based Mixture of Expertscited by 3 here
  9. 2024A Survey on Mixture of Experts in Large Language Modelscited by 4 here
  10. 2025A Comprehensive Survey of Mixture-of-Experts: Algorithms, Theory, and Applicationscited by 5 here
14 more it builds on, not in this chain
  1. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 29 here
  2. 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 6 here
  3. 2022Mixture-of-Experts with Expert Choice Routingcited by 5 here
  4. 2023From Sparse to Soft Mixtures of Expertscited by 4 here
  5. 2023LoRAMoE: Alleviate World Knowledge Forgetting in Large Language Models via MoE-Style Plugincited by 3 here
  6. 2023Mixture of Cluster-conditional LoRA Experts for Vision-language Instruction Tuningcited by 5 here
  7. 2024Mixtral of Expertscited by 6 here
  8. 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 12 here
  9. 2024MoE-LLaVA: Mixture of Experts for Large Vision-Language Modelscited by 6 here
  10. 2024FuseMoE: Mixture-of-Experts Transformers for Fleximodal Fusioncited by 3 here
  11. 2024Med-MoE: Mixture of Domain-Specific Experts for Lightweight Medical Vision-Language Modelscited by 6 here
  12. 2024M4oE: A Foundation Model for Medical Multimodal Image Segmentation with Mixture of Expertscited by 7 here
  13. 2024Flex-MoE: Modeling Arbitrary Modality Combination via the Flexible Mixture-of-Expertscited by 6 here
  14. 2025I2MoE: Interpretable Multimodal Interaction-aware Mixture-of-Expertscited by 5 here

The 24 most cited of 144.

Browse

30 of 139, ranked 6–35

  1. 6Mixture-of-Shape-Experts (MoSE): End-to-End Shape Dictionary Framework to Prompt SAM for Generalizable Medical Segmentation20252
  2. 7SegMoTE: Token-Level Mixture of Experts for Medical Image Segmentation20261
  3. 8Sparse Mixture-of-Experts for Non-Uniform Noise Reduction in MRI Images20251
  4. 9BrainNet-MoE: Brain-Inspired Mixture-of-Experts Learning for Neurological Disease Identification20251
  5. 10MoRE-Brain: Routed Mixture of Experts for Interpretable and Generalizable Cross-Subject fMRI Visual Decoding20251
  6. 11REN: Anatomically-Informed Mixture-of-Experts for Interstitial Lung Disease Diagnosis20251
  7. 12Multimodal Clinical Trial Outcome Prediction with Large Language Models20241
  8. 13M4: Multi-Proxy Multi-Gate Mixture of Experts Network for Multiple Instance Learning in Histopathology Image Analysis20241
  9. 14Uni-Med: A Unified Medical Generalist Foundation Model For Multi-Task Learning Via Connector-MoE20241
  10. 15Learning to Adapt Clinical Sequences with Residual Mixture of Experts20221
All 30
  1. 16Patcher: Patch Transformers with Mixture of Experts for Precise Medical Image Segmentation20221
  2. 17MambaFormer: Token-Level Guided Routing Mixture-of-Experts for Accurate and Efficient Clinical Assistance20260
  3. 18Varying-coefficient mixture of experts model for dynamic heterogeneous populations: application to mouse cortical development20260
  4. 19Towards Specialized Generalists: A Multi-Task MoE-LoRA Framework for Domain-Specific LLM Adaptation20260
  5. 20MMPG: MoE-based Adaptive Multi-Perspective Graph Fusion for Protein Representation Learning20260
  6. 21Domain-Expert-Guided Hybrid Mixture-of-Experts for Medical AI: Integrating Data-Driven Learning with Clinical Priors20260
  7. 22BrainStack: Neuro-MoE with Functionally Guided Expert Routing for EEG-Based Language Decoding20260
  8. 23MoLF: Mixture-of-Latent-Flow for Pan-Cancer Spatial Gene Expression Prediction from Histology20260
  9. 24Multimodal Mixture-of-Experts with Retrieval Augmentation for Protein Active Site Identification20260
  10. 25RANGER: Sparsely-Gated Mixture-of-Experts with Adaptive Retrieval Re-ranking for Pathology Report Generation20260
  11. 26ECG-MoE: Mixture-of-Expert Electrocardiogram Foundation Model20260
  12. 27MoEMambaMIL: Structure-Aware Selective State Space Modeling for Whole-Slide Image Analysis20260
  13. 28HMAR: Hierarchical Modality-Aware Expert and Dynamic Routing Medical Image Retrieval Architecture20260
  14. 29SpecMoE: Spectral Mixture-of-Experts Foundation Model for Cross-Species EEG Decoding20260
  15. 30Sparse Spectral LoRA: Routed Experts for Medical VLMs20260
  16. 31M3D-BFS: a Multi-stage Dynamic Fusion Strategy for Sample-Adaptive Multi-Modal Brain Network Analysis20260
  17. 32Region-Graph Optimal Transport Routing for Mixture-of-Experts Whole-Slide Image Classification20260
  18. 33M-IDoL: Information Decomposition for Modality-Specific and Diverse Representation Learning in Medical Foundation Model20260
  19. 34Adapting 2D Multi-Modal Large Language Model for 3D CT Image Analysis20260
  20. 35TriFit: Trimodal Fusion with Protein Dynamics for Mutation Fitness Prediction20260