mlsanityData to 7 Oct 2026

Towards Real-World Ultrasound Understanding: Large Vision-Language Models from Multi-Image Examinations with Long-Form Reports

arXiv 2607.01908 ↗First posted 2 Jul 2026cs.CVcited by 0

On the map: Multimodal LLMs / vision-language models → Medical vision-language models

Abstract (arXiv)

Large vision-language models (LVLMs) have achieved strong performance across many medical imaging tasks, yet their application to ultrasound remains limited due to its inherent complexity and variability. In this work, we revisit what is truly needed to enable real-world ultrasound understanding. Instead of introducing complex architectures or elaborate training strategies, we show that data scale and clinically faithful data alignment are the key factors. We construct a large-scale dataset of 1.5M real-world ultrasound examinations, containing 17.7M images, multi-organ coverage, and paired uncurated clinical reports. Crucially, we organize the data at the examination level, aligning multiple images with their corresponding reports to reflect real clinical workflows. We then fine-tune a standard LVLM using low-rank adaptation (LoRA) on this dataset without task-specific modifications. Surprisingly, this simple recipe already leads to strong performance across diverse ultrasound understanding tasks, outperforming prior methods designed with more complex pipelines. Beyond these results, we present model and data scaling analyses that provide insights into the role of scale in ultrasound LVLMs.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 20 of its 25 references that are in the map. First posted on arXiv 2 Jul 2026.

Builds on

20 of 25 references.

Closest ancestors · 8

Same direction, newest first

  1. 2025UMind-VL: A Generalist Ultrasound Vision-Language Model for Unified Grounded Perception and Comprehensive Interpretation27 Nov
  2. 2025EchoVLM: Dynamic Mixture-of-Experts Vision-Language Model for Universal Ultrasound Intelligence18 Sep
  3. 2025Multimodal Large Language Models for Medical Report Generation via Customized Prompt Tuning18 Jun
  4. 2025HAIBU-ReMUD: Reasoning Multimodal Ultrasound Dataset and Model Bridging to General Specific Domains9 Jun
  5. 2025Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoning8 Jun
  6. 2025HealthGPT: A Medical Large Vision-Language Model for Unifying Comprehension and Generation via Heterogeneous Knowledge Adaptation14 Feb
  7. 2024HuatuoGPT-Vision, Towards Injecting Medical Visual Knowledge into Multimodal LLMs at Scale27 Jun
  8. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Day1 Jun

Other references · 12

  1. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  2. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  3. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  4. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
  5. 2023Med-Flamingo: a Multimodal Medical Few-shot Learnercited by 387
  6. 2025Kimi-VL Technical Reportcited by 381
  7. 2023R2GenGPT: Radiology Report Generation with Frozen LLMscited by 111
  8. 2023USFM: A Universal Ultrasound Foundation Model Generalized to Tasks and Organs towards Label Efficient Image Analysiscited by 64
  9. 2026MedGemma 1.5 Technical Reportcited by 43
  10. 2025FetalCLIP: A Visual-Language Foundation Model for Fetal Ultrasound Image Analysiscited by 21
  11. 2025A Fully Open and Generalizable Foundation Model for Ultrasound Clinical Applicationscited by 9
  12. 2026Ultrasound-CLIP: Semantic-Aware Contrastive Pre-training for Ultrasound Image-Text Understandingcited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025U2-BENCH: Benchmarking Large Vision-Language Models on Ultrasound Understanding
  2. 2026Look-Closer-Then-Diagnose: Confidence-Aware Ultrasound VQA via Active Zooming
  3. 2026Ultrasound Vision-Language Alignment via Contrastive Learning
  4. 2025Adapting Vision-Language Foundation Model for Next Generation Medical Ultrasound Image Analysis
  5. 2025Ultrasound Report Generation with Multimodal Large Language Models for Standardized Texts
  6. 2026UltraG-Bench: A Multi-task Benchmark for assessing Large Vision-Language Models on Pixel-level Evidence Grounding in Ultrasound
  7. 2025Grounding DINO-US-SAM: Text-Prompted Multi-Organ Segmentation in Ultrasound with LoRA-Tuned Vision-Language Models
  8. 2025Dolphin v1.0 Technical Report