Echo-α: Large Agentic Multimodal Reasoning Model for Ultrasound Interpretation
On the map: LLM reasoning → Clinical and biomedical applications
also in 2 more
Abstract (arXiv)
Ultrasound interpretation requires both precise lesion localization and holistic clinical reasoning, yet existing methods typically excel at only one of these capabilities: specialized detectors offer strong localization but limited reasoning, whereas multimodal large language models (MLLMs) provide flexible reasoning but weak grounding in specialized medical domains. We present Echo-α, an agentic multimodal reasoning model for ultrasound interpretation that unifies these strengths within an invoke-and-reason framework. Echo-α is trained to coordinate organ-specific detector outputs, integrate them with global visual context, and convert the resulting evidence into grounded diagnostic decisions beyond detector-only inference. This behavior is established through a nine-task supervised curriculum and then refined by sequential reinforcement learning under different reward trade-offs, yielding Echo-α-Grounding for lesion anchoring and Echo-α-Diagnosis for final diagnosis. On multi-center renal and breast ultrasound benchmarks, Echo-α outperforms competitive baselines on both grounding and diagnosis. In particular, on cross-center test sets, Echo-α-Grounding attains 56.73%/43.78% [email protected] and Echo- α-Diagnosis reaches 74.90%/49.20% overall accuracy on renal/breast ultrasound. These results suggest that agentic multimodal reasoning can turn specialized detectors into verifiable clinical evidence, offering a practical route toward ultrasound AI systems that are more accurate, interpretable, and transferable. The repository is at https://github.com/MiliLab/Echo-Alpha.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 24 of its 30 references that are in the map. First posted on arXiv 30 Apr 2026.
Builds on
24 of 30 references.
Closest ancestors · 1
Same direction, newest first
- 2025Med-R1: Reinforcement Learning for Generalizable Medical Reasoning in Vision-Language Models18 Mar
Other references · 23
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,091
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,247
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,840
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,117
- 2025Qwen3-VL Technical Reportcited by 2,663
- 2022Large Language Models Encode Clinical Knowledgecited by 1,817
- 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,522
- 2025DINOv3cited by 1,355
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,296
- 2015Generation and Comprehension of Unambiguous Object Descriptionscited by 898
- 2019Distance-IoU Loss: Faster and Better Learning for Bounding Box Regressioncited by 455
- 2024YOLOv11: An Overview of the Key Architectural Enhancementscited by 420
11 more
- 2025YOLOv12: Attention-Centric Real-Time Object Detectorscited by 302
- 2023Med-HALT: Medical Domain Hallucination Test for Large Language Modelscited by 156
- 2021UTNet: A Hybrid Transformer Architecture for Medical Image Segmentationcited by 116
- 2023ChatCAD: Interactive Computer-Aided Diagnosis on Medical Image using Large Language Modelscited by 116
- 2023SurgicalSAM: Efficient Class Promptable Surgical Instrument Segmentationcited by 103
- 2025RF-DETR: Neural Architecture Search for Real-Time Detection Transformerscited by 73
- 2024LW-DETR: A Transformer Replacement to YOLO for Real-Time Detectioncited by 36
- 2023ChatCAD+: Towards a Universal and Reliable Interactive CAD using LLMscited by 35
- 2025Perceptual-Evidence Anchored Reinforced Learning for Multimodal Reasoningcited by 20
- 2025RadAgents: Multimodal Agentic Reasoning for Chest X-ray Interpretation with Radiologist-like Workflowscited by 8
- 2025EchoVLM: Dynamic Mixture-of-Experts Vision-Language Model for Universal Ultrasound Intelligencecited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026EchoAgent: Towards Reliable Echocardiography Interpretation with "Eyes","Hands" and "Minds"
- 2025U2-BENCH: Benchmarking Large Vision-Language Models on Ultrasound Understanding
- 2026Towards Reliable Fetal Ultrasound Interpretation with Multi-Agent Collaboration
- 2026Look-Closer-Then-Diagnose: Confidence-Aware Ultrasound VQA via Active Zooming
- 2026Evidence-Based Actor-Verifier Reasoning for Echocardiographic Agents
- 2025EchoAgent: Guideline-Centric Reasoning Agent for Echocardiography Measurement and Interpretation
- 2025Echo-CoPilot: A Multiple-Perspective Agentic Framework for Reliable Echocardiography Interpretation
- 2026Unified Ultrasound Intelligence Toward an End-to-End Agentic System