Towards Reliable Fetal Ultrasound Interpretation with Multi-Agent Collaboration
Not on the map. Why?
Abstract (arXiv)
Automated fetal ultrasound interpretation requires a workflow from visual perception, including plane recognition and anatomical segmentation, to clinical understanding, including biometric measurement and diagnostic reporting. However, the prevailing "one-task, one-model" paradigm limits systematic integration of evidence across this multi-step process. Although multimodal large language models (MLLMs) show promising visual understanding, their limited domain-specific grounding and hallucination risks restrict reliability in fetal ultrasound analysis. To address these limitations, we propose FetUSAgents, a tool-augmented multi-agent system for comprehensive fetal ultrasound interpretation, supporting visual question answering (VQA), report generation, image captioning, and video summarization. FetUSAgents coordinates task-specific visual tools through collaborative LLM agents and decomposes clinical queries into subtasks that progress from anatomical recognition to quantitative measurement. We further introduce Dual-Path Evidence Arbitration (DPEA), which integrates LLM-based deliberative reasoning with structured computational evidence from specialized visual tools. A retrieval-enhanced evidence bank consolidates intermediate findings to support traceable and clinically grounded conclusions. In addition, we construct FetUS-VQA, a dedicated VQA benchmark for fetal ultrasound, comprising 1,892 images and 3,205 question-answer pairs across 10 clinical tasks. Extensive out-of-distribution experiments show that FetUSAgents outperforms general and medical MLLMs, exceeding the strongest baseline by more than 25 percent in VQA accuracy. These results suggest a scalable route toward evidence-driven clinical assistants for prenatal imaging. Code is available.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 56 references that are in the map. First posted on arXiv 25 May 2026.
Builds on
21 of 56 references.
References · 21
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
- 2018Unified Perceptual Parsing for Scene Understandingcited by 1,271
- 2023MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoningcited by 316
- 2024HuatuoGPT-Vision, Towards Injecting Medical Visual Knowledge into Multimodal LLMs at Scalecited by 200
- 2024MDAgents: An Adaptive Collaboration of LLMs for Medical Decision-Makingcited by 163
- 2023Almanac: Retrieval-Augmented Language Models for Clinical Medicinecited by 123
- 2016SonoNet: Real-Time Detection and Localisation of Fetal Standard Scan Planes in Freehand Ultrasoundcited by 71
- 2023USFM: A Universal Ultrasound Foundation Model Generalized to Tasks and Organs towards Label Efficient Image Analysiscited by 68
- 2023Beyond Adapting SAM: Towards End-to-End Ultrasound Image Segmentation via Auto Promptingcited by 40
- 2022A Review on Deep-Learning Algorithms for Fetal Ultrasound-Image Analysiscited by 29
- 2025CT-Agent: A Multimodal-LLM Agent for 3D CT Radiology Question Answeringcited by 21
9 more
- 2021AutoFB: Automating Fetal Biometry Estimation from Standard Ultrasound Planescited by 14
- 2022BiometryNet: Landmark-based Fetal Biometry Estimation from Standard Ultrasound Planescited by 9
- 2026MedSAM-Agent: Empowering Interactive Medical Image Segmentation with Multi-turn Agentic Reinforcement Learningcited by 8
- 2026Meissa: Multi-modal Medical Agentic Intelligencecited by 6
- 20263DMedAgent: Unified Perception-to-Understanding for 3D Medical Analysiscited by 5
- 2024Generative Diffusion Model Bootstraps Zero-shot Classification of Fetal Ultrasound Images In Underrepresented African Populationscited by 3
- 2024Segmenting Fetal Head with Efficient Fine-tuning Strategies in Low-resource Settings: an empirical study with U-Netcited by 2
- 2025Advancing Fetal Ultrasound Image Quality Assessment in Low-Resource Settingscited by 2
- 2026HeartAgent: An Autonomous Agent System for Explainable Differential Diagnosis in Cardiologycited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026FetalAgents: A Multi-Agent System for Fetal Ultrasound Image and Video Analysis
- 2025Epistemic-aware Vision-Language Foundation Model for Fetal Ultrasound Interpretation
- 2025FETAL-GAUGE: A Benchmark for Assessing Vision-Language Models in Fetal Ultrasound
- 2026UltrasoundAgents: Hierarchical Multi-Agent Evidence-Chain Reasoning for Breast Ultrasound Diagnosis
- 2026Echo-α: Large Agentic Multimodal Reasoning Model for Ultrasound Interpretation
- 2025FetalCLIP: A Visual-Language Foundation Model for Fetal Ultrasound Image Analysis
- 2025U2-BENCH: Benchmarking Large Vision-Language Models on Ultrasound Understanding
- 2026UltraG-Bench: A Multi-task Benchmark for assessing Large Vision-Language Models on Pixel-level Evidence Grounding in Ultrasound