mlsanityData to 7 Oct 2026

SonoCLIP: Mask-Guided Region-Aware Vision-Language Pretraining for Fetal Ultrasound Analysis

arXiv 2606.29586 ↗First posted 28 Jun 2026cs.CV cs.AIcited by 0

On the map: Multimodal LLMs / vision-language models → Medical vision-language models

Abstract (arXiv)

Vision-language foundation models have shown strong potential in medical image analysis. Although foundation models for ultrasound imaging have recently emerged, the domain remains particularly challenging due to severe speckle noise, acquisition variability, and subtle anatomical boundaries, leading to high inter-observer variability. Existing CLIP-based models rely primarily on global image-text alignment, limiting their sensitivity to clinically decisive local structures. We propose SonoCLIP, the first million-scale region-controllable fetal ultrasound vision-language foundation model that integrates segmentation masks as mask-channel visual prompts within the vision encoder, enabling joint global-local contrastive representation learning. To support scalable region-text alignment, we introduce a sigmoid-based pairwise contrastive loss that improves stability under large-scale supervision. We further curate a 1.44M-image multimodal fetal ultrasound dataset spanning 24 standard planes for large-scale pretraining. Extensive cross-center evaluations demonstrate that SonoCLIP achieves superior zero-shot transfer performance under both global and mask-guided inference, establishing a controllable and clinically oriented foundation model for fetal ultrasound analysis. Our code and data are available at https://github.com/Harrison-one/SonoCLIP.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 9 of its 21 references that are in the map. First posted on arXiv 28 Jun 2026.

Builds on

9 of 21 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024UniMed-CLIP: Towards a Unified Image-Text Pretraining Paradigm for Diverse Medical Imaging Modalities13 Dec

Other references · 8

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  3. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  4. 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 506
  5. 2023Alpha-CLIP: A CLIP Model Focusing on Wherever You Wantcited by 150
  6. 2024A Comprehensive Survey of Foundation Models in Medicinecited by 56
  7. 2024A Multimodal Vision Foundation Model for Clinical Dermatologycited by 49
  8. 2025FetalCLIP: A Visual-Language Foundation Model for Fetal Ultrasound Image Analysiscited by 21

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026FADA: Accessible fetal ultrasound interpretation and annotation with a selectively distilled unified vision-language model
  2. 2025Advancing Fetal Ultrasound Image Quality Assessment in Low-Resource Settings
  3. 2025Adapting Vision-Language Foundation Model for Next Generation Medical Ultrasound Image Analysis
  4. 2025FETAL-GAUGE: A Benchmark for Assessing Vision-Language Models in Fetal Ultrasound
  5. 2026Ultrasound Vision-Language Alignment via Contrastive Learning
  6. 2025U2-BENCH: Benchmarking Large Vision-Language Models on Ultrasound Understanding
  7. 2025UMind-VL: A Generalist Ultrasound Vision-Language Model for Unified Grounded Perception and Comprehensive Interpretation
  8. 2026Ultrasound-CLIP: Semantic-Aware Contrastive Pre-training for Ultrasound Image-Text Understanding