mlsanityData to 7 Oct 2026

Epistemic-aware Vision-Language Foundation Model for Fetal Ultrasound Interpretation

arXiv 2510.12953 ↗First posted 14 Oct 2025cs.CV cs.AI cs.IRcited by 1

On the map: Multimodal LLMs / vision-language models → Medical vision-language models

Abstract (arXiv)

Recent medical vision-language models have shown promise on tasks such as VQA, report generation, and anomaly detection. However, most are adapted to structured adult imaging and underperform in fetal ultrasound, which poses challenges of multi-view image reasoning, numerous diseases, and image diversity. To bridge this gap, we introduce FetalMind, a medical AI system tailored to fetal ultrasound for both report generation and diagnosis. Guided by clinical workflow, we propose Salient Epistemic Disentanglement (SED), which injects an expert-curated bipartite graph into the model to decouple view-disease associations and to steer preference selection along clinically faithful steps via reinforcement learning. This design mitigates variability across diseases and heterogeneity across views, reducing learning bottlenecks while aligning the model's inference with obstetric practice. To train FetalMind at scale, we curate FetalSigma-1M dataset, the first large-scale fetal ultrasound report corpus, comprising 20K reports from twelve medical centers, addressing the scarcity of domain data. Extensive experiments show that FetalMind outperforms open- and closed-source baselines across all gestational stages, achieving +14% average gains and +61.2% higher accuracy on critical conditions while remaining efficient, stable, and scalable. Project Page: https://hexiao0275.github.io/FetalMind.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Medical vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 28 of its 45 references that are in the map. First posted on arXiv 14 Oct 2025.

Builds on

28 of 45 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025HealthGPT: A Medical Large Vision-Language Model for Unifying Comprehension and Generation via Heterogeneous Knowledge Adaptation14 Feb
  2. 2024Interpretable Bilingual Multimodal Large Language Model for Diverse Biomedical Tasks24 Oct
  3. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Day1 Jun
  4. 2023BiomedGPT: A Generalist Vision-Language Foundation Model for Diverse Biomedical Tasks26 May

Other references · 24

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2022Training language models to follow instructions with human feedbackcited by 15,712
  4. 2017Proximal Policy Optimization Algorithmscited by 14,441
  5. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  6. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  7. 2025Qwen2.5-VL Technical Reportcited by 5,418
  8. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  9. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  10. 2023ConvNeXt V2: Co-designing and Scaling ConvNets with Masked Autoencoderscited by 703
  11. 2023Aligning Large Multimodal Models with Factually Augmented RLHFcited by 703
  12. 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 571
12 more
  1. 2023OpenFlamingo: An Open-Source Framework for Training Large Autoregressive Vision-Language Modelscited by 560
  2. 2023RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedbackcited by 404
  3. 2024Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine Translationcited by 390
  4. 2023Med-Flamingo: a Multimodal Medical Few-shot Learnercited by 387
  5. 2023Beyond Hallucinations: Enhancing LVLMs through Hallucination-Aware Direct Preference Optimizationcited by 223
  6. 2022Medical Image Segmentation Review: The success of U-Netcited by 190
  7. 2024Locate Anything on Earth: Advancing Open-Vocabulary Object Detection for Remote Sensing Communitycited by 50
  8. 2024MIA-DPO: Multi-Image Augmented Direct Preference Optimization For Large Vision-Language Modelscited by 34
  9. 2022A Review on Deep-Learning Algorithms for Fetal Ultrasound-Image Analysiscited by 29
  10. 2025FetalCLIP: A Visual-Language Foundation Model for Fetal Ultrasound Image Analysiscited by 21
  11. 2025Evaluating MLLMs with Multimodal Multi-image Reasoning Benchmarkcited by 20
  12. 2025Benchmarking GPT-5 for biomedical natural language processingcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Towards Reliable Fetal Ultrasound Interpretation with Multi-Agent Collaboration
  2. 2025FETAL-GAUGE: A Benchmark for Assessing Vision-Language Models in Fetal Ultrasound
  3. 2026FetalAgents: A Multi-Agent System for Fetal Ultrasound Image and Video Analysis
  4. 2026Echo-α: Large Agentic Multimodal Reasoning Model for Ultrasound Interpretation
  5. 2026Look-Closer-Then-Diagnose: Confidence-Aware Ultrasound VQA via Active Zooming
  6. 2025EchoVLM: Dynamic Mixture-of-Experts Vision-Language Model for Universal Ultrasound Intelligence
  7. 2025U2-BENCH: Benchmarking Large Vision-Language Models on Ultrasound Understanding
  8. 2025Toward a Vision-Language Foundation Model for Medical Data: Multimodal Dataset and Benchmarks for Vietnamese PET/CT Report Generation