A Fully Open and Generalizable Foundation Model for Ultrasound Clinical Applications
Not on the map. Why?
Abstract (arXiv)
Artificial intelligence (AI) that can effectively learn ultrasound representations by integrating multi-source data holds significant promise for advancing clinical care. However, the scarcity of large labeled datasets in real-world clinical environments and the limited generalizability of task-specific models have hindered the development of generalizable clinical AI models for ultrasound applications. In this study, we present EchoCare, a novel ultrasound foundation model for generalist clinical use, developed via self-supervised learning on our curated, publicly available, large-scale dataset EchoCareData. EchoCareData comprises 4.5 million ultrasound images, sourced from over 23 countries across 5 continents and acquired via a diverse range of distinct imaging devices, thus encompassing global cohorts that are multi-center, multi-device, and multi-ethnic. Unlike prior studies that adopt off-the-shelf vision foundation model architectures, we introduce a hierarchical classifier into EchoCare to enable joint learning of pixel-level and representation-level features, capturing both global anatomical contexts and local ultrasound characteristics. With minimal training, EchoCare outperforms state-of-the-art comparison models across 10 representative ultrasound benchmarks of varying diagnostic difficulties, spanning disease diagnosis, lesion segmentation, organ detection, landmark prediction, quantitative regression, imaging enhancement and report generation. The code and pretrained model are publicly released, rendering EchoCare accessible for fine-tuning and local adaptation, supporting extensibility to additional applications. EchoCare provides a fully open and generalizable foundation model to boost the development of AI technologies for diverse clinical ultrasound applications.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 14 of its 32 references that are in the map. First posted on arXiv 15 Sep 2025.
Builds on
14 of 32 references.
References · 14
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,319
- 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,153
- 2022Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Imagescited by 830
- 2019EnlightenGAN: Deep Light Enhancement without Paired Supervisioncited by 466
- 2019Deep Learning for Segmentation using an Open Large-Scale Dataset in 2D Echocardiographycited by 244
- 2023USFM: A Universal Ultrasound Foundation Model Generalized to Tasks and Organs towards Label Efficient Image Analysiscited by 68
- 2024A Multimodal Vision Foundation Model for Clinical Dermatologycited by 50
- 2024UltraSam: A Foundation Model for Ultrasound using Large Open-Access Segmentation Datasetscited by 24
- 2024Ultrasound Report Generation with Cross-Modality Feature Alignment via Unsupervised Guidancecited by 17
2 more
Built on by
Citing papers per year: 2025: 1; 2026: 9.
10 papers.
- 2026Pretext Matters: An Empirical Study of SSL Methods in Medical Imagingcited by 3
- 2025UMind-VL: A Generalist Ultrasound Vision-Language Model for Unified Grounded Perception and Comprehensive Interpretationcited by 2
- 2026US-JEPA: A Joint Embedding Predictive Architecture for Ultrasoundcited by 2
- 2026Ultrasound Vision-Language Alignment via Contrastive Learningcited by 0
- 2026Synergistic Foundation Models for Semi-Supervised Fetal Cardiac Ultrasound Analysis: SAM-Med2D Boundary Refinement and DINOv3 Semantic Enhancementcited by 0
- 2026Towards Real-World Ultrasound Understanding: Large Vision-Language Models from Multi-Image Examinations with Long-Form Reportscited by 0
- 2026Cross-Modal Ultrasound-MRI Learning for Fetal Brain Ventricular Volumetry and Abnormality Screeningcited by 0
- 2026UltraBench 2: Towards Robust Evaluation of Vision Foundation Models on Ultrasoundcited by 0
- 2026Med-RADIO: Reducing All Medical Domains Into One via Multi-Teacher Distillationcited by 0
- 2026WASP: Weakly Aligned Spatiotemporal Pairs for Fetal Brain MRI-Ultrasound Learningcited by 0
- 2026WASP: Weakly Aligned Spatiotemporal Pairs for Fetal Brain MRI-Ultrasound Learning3 Oct 2026
- 2026Med-RADIO: Reducing All Medical Domains Into One via Multi-Teacher Distillation29 Sep 2026
- 2026UltraBench 2: Towards Robust Evaluation of Vision Foundation Models on Ultrasound23 Sep 2026
- 2026Cross-Modal Ultrasound-MRI Learning for Fetal Brain Ventricular Volumetry and Abnormality Screening14 Aug 2026
- 2026Towards Real-World Ultrasound Understanding: Large Vision-Language Models from Multi-Image Examinations with Long-Form Reports2 Jul 2026
- 2026Synergistic Foundation Models for Semi-Supervised Fetal Cardiac Ultrasound Analysis: SAM-Med2D Boundary Refinement and DINOv3 Semantic Enhancement19 May 2026
- 2026Ultrasound Vision-Language Alignment via Contrastive Learning4 May 2026
- 2026Pretext Matters: An Empirical Study of SSL Methods in Medical Imaging23 Mar 2026
- 2026US-JEPA: A Joint Embedding Predictive Architecture for Ultrasound22 Feb 2026
- 2025UMind-VL: A Generalist Ultrasound Vision-Language Model for Unified Grounded Perception and Comprehensive Interpretation27 Nov 2025