Unified Ultrasound Intelligence Toward an End-to-End Agentic System
Not on the map. Why?
Abstract (arXiv)
Clinical ultrasound analysis demands models that generalize across heterogeneous organs, views, and devices, while supporting interpretable workflow-level analysis. Existing methods often rely on task-wise adaptation, and joint learning may be unstable due to cross-task interference, making it hard to deliver workflow-level outputs in practice. To address these challenges, we present USTri, a tri-stage ultrasound intelligence pipeline for unified multi-organ, multi-task analysis. Stage I trains a universal generalist USGen on different domains to learn broad, transferable priors that are robust to device and protocol variability. To better handle domain shifts and reach task-aligned performance while preserving ultrasound shared knowledge, Stage II builds USpec by keeping USGen frozen and finetuning dataset-specific heads. Stage III introduces USAgent, which mimics clinician workflows by orchestrating USpec specialists for multi-step inference and deterministic structured reports. On the FMCUIA validation set, our model achieves the best overall performance across 4 task types and 27 datasets, outperforming state-of-the-art methods. Moreover, qualitative results show that USAgent produces clinically structured reports with high accuracy and interpretability. Our study suggests a scalable path to ultrasound intelligence that generalizes across heterogeneous ultrasound tasks and supports consistent end-to-end clinical workflows. The code is publicly available at: https://github.com/MacDunno/USTri.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 17 references that are in the map. First posted on arXiv 18 Apr 2026.
Builds on
10 of 17 references.
References · 10
- 2023Segment Anythingcited by 8,234
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
- 2019Which Tasks Should Be Learned Together in Multi-task Learning?cited by 375
- 2020Multi-Task Learning with Deep Neural Networks: A Surveycited by 375
- 2023Segment Anything in Medical Imagescited by 227
- 2023On the Challenges and Perspectives of Foundation Models for Medical Image Analysiscited by 135
- 2023USFM: A Universal Ultrasound Foundation Model Generalized to Tasks and Organs towards Label Efficient Image Analysiscited by 68
- 2025TinyUSFM: Towards Compact and Efficient Ultrasound Foundation Modelscited by 4
- 2026Baseline Method of the Foundation Model Challenge for Ultrasound Image Analysiscited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Understanding Task Aggregation for Generalizable Ultrasound Foundation Models
- 2026Echo-α: Large Agentic Multimodal Reasoning Model for Ultrasound Interpretation
- 2026US-VLA: An Ultrasound Vision-Language-Action Model for Embodied Abdomina
- 2025UMind-VL: A Generalist Ultrasound Vision-Language Model for Unified Grounded Perception and Comprehensive Interpretation
- 2025U2-BENCH: Benchmarking Large Vision-Language Models on Ultrasound Understanding
- 2026EchoAgent: Towards Reliable Echocardiography Interpretation with "Eyes","Hands" and "Minds"
- 2025EchoVLM: Dynamic Mixture-of-Experts Vision-Language Model for Universal Ultrasound Intelligence
- 2025COME: Dual Structure-Semantic Learning with Collaborative MoE for Universal Lesion Detection Across Heterogeneous Ultrasound Datasets