mlsanityData to 14 Oct 2026

US-VLA: An Ultrasound Vision-Language-Action Model for Embodied Abdomina

arXiv 2608.16074 ↗First posted 17 Aug 2026cs.RO cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Artificial intelligence-assisted ultrasound scanning enhances diagnostic reliability and efficiency by providing real-time guidance for standardized image acquisition and reducing operator dependence. However, existing reinforcement learning and learning-assisted ultrasound scanning methods typically rely on carefully designed reward functions or extensive interaction data, which limits their generalization ability and stability across different devices, patient populations, and complex clinical scenarios. To address these challenges, we propose an ultrasound vision-language-action model (US-VLA) for automated ultrasound scanning that explicitly encodes clinical semantic goals and generates sequential probe manipulation actions under real-time ultrasound feedback. In particular, we first design an ultrasound-aware expert fusion module to jointly integrate ultrasound observations with auxiliary contextual information, enabling semantic ultrasound feedback to effectively guide the scanning process. Then, we construct US-VLA-Data, a real-world dataset covering liver and kidney examinations, which includes five clinically defined standard planes and comprises 320 expert scanning trajectories with approximately 80,000 synchronized timesteps. Extensive experiments demonstrate that US-VLA achieves competitive performance in ultrasound probe manipulation tasks, indicating its effectiveness and promising generalization within the evaluated abdominal ultrasound setting. The source code is available at https://github.com/VMVLab/US-VLA.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 46 references that are in the map. First posted on arXiv 17 Aug 2026.

Builds on

27 of 46 references.

References · 27

  1. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  2. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  3. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  4. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  5. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  6. 20243D-VLA: A 3D Vision-Language-Action Generative World Modelcited by 328
  7. 2025HybridVLA: Collaborative Diffusion and Autoregression in a Unified Vision-Language-Action Modelcited by 181
  8. 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Modelcited by 145
  9. 2025ChatVLA: Unified Multimodal Understanding and Robot Control with Vision-Language-Action Modelcited by 113
  10. 2025ForceVLA: Enhancing VLA Models with a Force-aware MoE for Contact-rich Manipulationcited by 91
  11. 2025PD-VLA: Accelerating Vision-Language-Action Model Integrated with Action Chunking via Parallel Decodingcited by 88
  12. 2025VLA-Cache: Efficient Vision-Language-Action Manipulation via Adaptive Token Cachingcited by 86
15 more
  1. 2025ReconVLA: Reconstructive Vision-Language-Action Model as Effective Robot Perceivercited by 81
  2. 2023USFM: A Universal Ultrasound Foundation Model Generalized to Tasks and Organs towards Label Efficient Image Analysiscited by 68
  3. 2025OmniVTLA: Vision-Tactile-Language-Action Models with Semantic-Aligned Tactile Sensingcited by 38
  4. 2024RoboNurse-VLA: Robotic Scrub Nurse System based on Vision-Language-Action Modelcited by 29
  5. 2026ForceVLA2: Unleashing Hybrid Force-Position Control with Force Awareness for Contact-Rich Manipulationcited by 22
  6. 2026Recurrent-Depth VLA: Implicit Test-Time Compute Scaling of Vision-Language-Action Models via Latent Iterative Reasoningcited by 18
  7. 2026FAVLA: A Force-Adaptive Fast-Slow VLA model for Contact-Rich Robotic Manipulationcited by 15
  8. 2026CRAFT: Adapting VLA Models to Contact-rich Manipulation via Force-aware Curriculum Fine-tuningcited by 8
  9. 2023DopUS-Net: Quality-Aware Robotic Ultrasound Imaging based on Doppler Signalcited by 5
  10. 2024Imitation Learning for Robotic Assisted Ultrasound Examination of Deep Venous Thrombosis using Kernelized Movement Primitivescited by 3
  11. 2025SEMC: Structure-Enhanced Mixture-of-Experts Contrastive Learning for Ultrasound Standard Plane Recognitioncited by 3
  12. 2024An Anatomy-Aware Shared Control Approach for Assisted Teleoperation of Lung Ultrasound Examinationscited by 2
  13. 2024A Unified Interaction Control Framework for Safe Robotic Ultrasound Scanning with Human-Intention-Aware Compliancecited by 2
  14. 2025UltraDP: Generalizable Carotid Ultrasound Scanning with Force-Aware Diffusion Policycited by 2
  15. 2026Towards Next-Generation Healthcare: A Survey of Medical Embodied AI for Perception, Decision-Making, and Actioncited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026ForceU-VLA: A Force-Aware Vision-Language-Action Model for Embodied Ultrasound Scanning
  2. 2025Comprehensive Review of Reinforcement Learning for Medical Ultrasound Imaging
  3. 2026Scanning While Imagining: A Scene-Graph World Model for Robotic Ultrasound Navigation
  4. 2024Autonomous Path Planning for Intercostal Robotic Ultrasound Imaging Using Reinforcement Learning
  5. 2026Unified Ultrasound Intelligence Toward an End-to-End Agentic System
  6. 2025EchoVLM: Dynamic Mixture-of-Experts Vision-Language Model for Universal Ultrasound Intelligence
  7. 2026SonoWorld: Towards Interactive Pose-Controllable Ultrasound World Models
  8. 2026UltraWorld: Learning Interactive Ultrasound World Models from Untracked Clinical Videos with Acoustic Sampling Map