Action-Conditioned World Model for Goal Plane Probe Guidance in Robotic Ultrasound
On the map: World models → Medical and surgical world models
Abstract (arXiv)
We present an action-conditioned world model framework for goal plane probe guidance in robotic ultrasound, with a focus on neck ultrasound scanning. Autonomous ultrasound tasks often require large numbers of probe-motion trajectories for training, but collecting high-quality demonstrations is labor-intensive and explicit simulators are difficult to build because ultrasound appearance depends on contact, tissue deformation, and view-dependent acoustic artifacts. We address this problem with a two-stage model-based learning pipeline. First, a latent conditional diffusion world model predicts future ultrasound observations from recent context frames, probe motions and temporal offset. Second, a goal-conditioned temporal transformer predicts ordered probe motions and is fine-tuned using rewards from the frozen world model. Experiments on the self-collected dataset show that the world model preserves action-dependent anatomical structure on target-directed scans. In real-world closed loop experiments, the framework achieves success rates of 70.0% for carotid guidance and 65.0% for thyroid guidance. These results demonstrate the potential of learned ultrasound dynamics for training goal-directed robotic probe navigation.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Medical and surgical world models, one of 11 directions in World models. Builds on 4 of its 19 references that are in the map. First posted on arXiv 24 Jul 2026.
Builds on
4 of 19 references.
References · 4
- 2018Visual Foresight: Model-Based Deep Reinforcement Learning for Vision-Based Robotic Controlcited by 230
- 2020Learning Cross-Domain Correspondence for Control with Dynamics Cycle-Consistencycited by 43
- 2026RAG-RUSS: A Retrieval-Augmented Robotic Ultrasound for Autonomous Carotid Examinationcited by 2
- 2026From Scanning Guidelines to Action: A Robotic Ultrasound Agent with LLM-Based Reasoningcited by 1
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026UltraWorld: Learning Interactive Ultrasound World Models from Untracked Clinical Videos with Acoustic Sampling Map
- 2025UltraDP: Generalizable Carotid Ultrasound Scanning with Force-Aware Diffusion Policy
- 2025EchoWorld: Learning Motion-Aware World Models for Echocardiography Probe Guidance
- 2021Learning Robotic Ultrasound Scanning Skills via Human Demonstrations and Guided Explorations
- 2026DAISS: Phase-Aware Imitation Learning for Dual-Arm Robotic Ultrasound-Guided Interventions ↗
- 2026DreamReg: Belief-Driven World Model for 2D-3D Ultrasound Registration
- 2025SonoGym: High Performance Simulation for Challenging Surgical Tasks with Robotic Ultrasound
- 2024Goal-conditioned reinforcement learning for ultrasound navigation guidance