COME: Dual Structure-Semantic Learning with Collaborative MoE for Universal Lesion Detection Across Heterogeneous Ultrasound Datasets
On the map: Mixture-of-experts → Medical and biomedical MoE
Abstract (arXiv)
Conventional single-dataset training often fails with new data distributions, especially in ultrasound (US) image analysis due to limited data, acoustic shadows, and speckle noise. Therefore, constructing a universal framework for multi-heterogeneous US datasets is imperative. However, a key challenge arises: how to effectively mitigate inter-dataset interference while preserving dataset-specific discriminative features for robust downstream task? Previous approaches utilize either a single source-specific decoder or a domain adaptation strategy, but these methods experienced a decline in performance when applied to other domains. Considering this, we propose a Universal Collaborative Mixture of Heterogeneous Source-Specific Experts (COME). Specifically, COME establishes dual structure-semantic shared experts that create a universal representation space and then collaborate with source-specific experts to extract discriminative features through providing complementary features. This design enables robust generalization by leveraging cross-datasets experience distributions and providing universal US priors for small-batch or unseen data scenarios. Extensive experiments under three evaluation modes (single-dataset, intra-organ, and inter-organ integration datasets) demonstrate COME's superiority, achieving significant mean AP improvements over state-of-the-art methods. Our project is available at: https://universalcome.github.io/UniversalCOME/.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Medical and biomedical MoE, one of 12 directions in Mixture-of-experts. Builds on 31 of its 52 references that are in the map. First posted on arXiv 13 Aug 2025.
Builds on
31 of 52 references.
References · 31
- 2023Segment Anythingcited by 8,234
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,319
- 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 867
- 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 520
- 2024YOLOv10: Real-Time End-to-End Object Detectioncited by 515
- 2022Tutel: Adaptive Mixture-of-Experts at Scalecited by 201
- 2024Boosting Continual Learning of Vision-Language Models via Mixture-of-Experts Adapterscited by 199
- 2023RAPHAEL: Text-to-Image Generation via Large Mixture of Diffusion Pathscited by 142
- 2023Foundation Model for Endoscopy Video Analysis via Large-scale Self-supervised Pre-traincited by 75
- 2024Adapting Visual-Language Models for Generalizable Anomaly Detection in Medical Imagescited by 69
- 2023USFM: A Universal Ultrasound Foundation Model Generalized to Tasks and Organs towards Label Efficient Image Analysiscited by 68
19 more
- 2023LVM-Med: Learning Large-Scale Self-Supervised Vision Models for Medical Imaging via Second-order Graph Matchingcited by 60
- 2024MedCLIP-SAMv2: Towards Universal Text-Driven Medical Image Segmentationcited by 39
- 2024One for All: Toward Unified Foundation Models for Earth Visioncited by 34
- 2022A New Dataset and A Baseline Model for Breast Lesion Detection in Ultrasound Videoscited by 32
- 2023DaTaSeg: Taming a Universal Multi-Dataset Multi-Task Segmentation Modelcited by 31
- 2024HyperMoE: Towards Better Mixture of Experts via Transferring Among Expertscited by 26
- 2023MAPSeg: Unified Unsupervised Domain Adaptation for Heterogeneous Medical Image Segmentation Based on 3D Masked Autoencoding and Pseudo-Labelingcited by 25
- 2024General surgery vision transformer: A video pre-trained foundation model for general surgerycited by 25
- 2024Exploring the Potential of Large Foundation Models for Open-Vocabulary HOI Detectioncited by 25
- 2024UltraSam: A Foundation Model for Ultrasound using Large Open-Access Segmentation Datasetscited by 24
- 2023DAMEX: Dataset-aware Mixture-of-Experts for visual understanding of mixture-of-datasetscited by 23
- 2024Ultrasound Report Generation with Cross-Modality Feature Alignment via Unsupervised Guidancecited by 17
- 2023PathoDuet: Foundation Models for Pathological Slide Analysis of H&E and IHC Stainscited by 14
- 2024Constructing and Exploring Intermediate Domains in Mixed Domain Semi-supervised Medical Image Segmentationcited by 14
- 2023Versatile Medical Image Segmentation Learned from Multi-Source Datasets via Model Self-Disambiguationcited by 12
- 2025Ultrasound Image-to-Video Synthesis via Latent Dynamic Diffusion Modelscited by 12
- 2024MedUniSeg: 2D and 3D Medical Image Segmentation via a Prompt-driven Universal Modelcited by 7
- 2024Uni2Det: Unified and Universal Framework for Prompt-Guided Multi-dataset 3D Detectioncited by 3
- 2024CerberusDet: Unified Multi-Dataset Object Detectioncited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Ultrasound-CLIP: Semantic-Aware Contrastive Pre-training for Ultrasound Image-Text Understanding
- 2025Adapting Vision-Language Foundation Model for Next Generation Medical Ultrasound Image Analysis
- 2025UniUltra: Interactive Parameter-Efficient SAM2 for Universal Ultrasound Segmentation
- 2026Understanding Task Aggregation for Generalizable Ultrasound Foundation Models
- 2025UMind-VL: A Generalist Ultrasound Vision-Language Model for Unified Grounded Perception and Comprehensive Interpretation
- 2025EchoVLM: Dynamic Mixture-of-Experts Vision-Language Model for Universal Ultrasound Intelligence
- 2025SEMC: Structure-Enhanced Mixture-of-Experts Contrastive Learning for Ultrasound Standard Plane Recognition
- 2025U2-BENCH: Benchmarking Large Vision-Language Models on Ultrasound Understanding