mlsanityData to 7 Oct 2026

Domain-Expert-Guided Hybrid Mixture-of-Experts for Medical AI: Integrating Data-Driven Learning with Clinical Priors

arXiv 2601.17977 ↗First posted 25 Jan 2026cs.CVcited by 0

On the map: Mixture-of-experts → Medical and biomedical MoE

Abstract (arXiv)

Mixture-of-Experts (MoE) models increase representational capacity with modest computational cost, but their effectiveness in specialized domains such as medicine is limited by small datasets. In contrast, clinical practice offers rich expert knowledge, such as physician gaze patterns and diagnostic heuristics, that models cannot reliably learn from limited data. Combining data-driven experts, which capture novel patterns, with domain-expert-guided experts, which encode accumulated clinical insights, provides complementary strengths for robust and clinically meaningful learning. To this end, we propose Domain-Knowledge-Guided Hybrid MoE (DKGH-MoE), a plug-and-play and interpretable module that unifies data-driven learning with domain expertise. DKGH-MoE integrates a data-driven MoE to extract novel features from raw imaging data, and a domain-expert-guided MoE incorporates clinical priors, specifically clinician eye-gaze cues, to emphasize regions of high diagnostic relevance. By integrating domain expert insights with data-driven features, DKGH-MoE improves both performance and interpretability.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical and biomedical MoE, one of 12 directions in Mixture-of-experts. Builds on 10 of its 13 references that are in the map. First posted on arXiv 25 Jan 2026.

Builds on

10 of 13 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024M4oE: A Foundation Model for Medical Multimodal Image Segmentation with Mixture of Experts15 May

Other references · 9

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020GShard: Scaling Giant Models with Conditional Computation and Automatic Shardingcited by 1,601
  3. 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 890
  4. 2021Domain Adaptation for Medical Image Analysis: A Surveycited by 351
  5. 2024A Survey on Mixture of Experts in Large Language Modelscited by 233
  6. 2022Eye-gaze-guided Vision Transformer for Rectifying Shortcut Learningcited by 20
  7. 2024Eye-gaze Guided Multi-modal Alignment for Medical Representation Learningcited by 16
  8. 2024Low-Rank Mixture-of-Experts for Continual Medical Image Segmentationcited by 16
  9. 2021Medical Knowledge-Guided Deep Learning for Imbalanced Medical Image Classificationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Med-MoE: Mixture of Domain-Specific Experts for Lightweight Medical Vision-Language Models
  2. 2026Hierarchical MoE for Multi-Modal ILD Diagnosis
  3. 2025MoE-Health: A Mixture of Experts Framework for Robust Multimodal Healthcare Prediction
  4. 2026MoPET: Parameter-Efficient Mixture-of-Experts for Unified Medical Image Classification
  5. 2026Generalist-Specialist Mixture-of-Experts for Rare Pathology Detection in Multimodal Imaging
  6. 2026ConceptM3oE: Concept-Guided Multimodal Mixture of Experts for Interpretable Computational Pathology
  7. 2024Mixture of Multicenter Experts in Multimodal AI for Debiased Radiotherapy Target Delineation
  8. 2022Learning to Adapt Clinical Sequences with Residual Mixture of Experts