mlsanityData to 7 Oct 2026

UltraWorld: Learning Interactive Ultrasound World Models from Untracked Clinical Videos with Acoustic Sampling Map

arXiv 2610.09785 ↗First posted 7 Oct 2026cs.CV cs.ROcited by 0

On the map: World models → Medical and surgical world models

Abstract (arXiv)

World models can enable autonomous ultrasound scanning by predicting the outcomes of probe motions from local observations. Learning this action--observation relationship typically relies on synchronized video--pose pairs, which are costly to collect at scale and largely unavailable in routine clinical recordings. Reliable action following further requires modeling ultrasound's cross-sectional sampling geometry. We present UltraWorld, a self-distillation recipe that transfers priors from clinical ultrasound videos into interactive world models without real action annotations. Starting from clinical videos, we adapt a video foundation model into an ultrasound generator conditioned on reference images and anatomical masks. Anatomical masks sampled along programmable trajectories through 3D anatomy provide spatial guidance for synthesizing action--video pairs. We then use these synthetic pairs to self-distill the generator into a world model that predicts future observations from local observations and actions, without requiring anatomical masks or other 3D assets at inference time. To further improve action following, we introduce the Acoustic Sampling Map (AsMap), which represents probe poses and imaging settings as pixel-wise 3D sampling positions, beam directions, and depths. Experiments demonstrate improved prediction fidelity and action following. Across nine simulated closed-loop local planning episodes, UltraWorld reduces the mean final distance to the goal and orientation error by 29% and 38%, respectively, compared with visual servoing. Project Page: https://ultraworld-project.github.io/.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical and surgical world models, one of 11 directions in World models. Builds on 3 of its 46 references that are in the map. First posted on arXiv 7 Oct 2026.

Builds on

3 of 46 references.

References · 3

  1. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  2. 2023GTA: A Geometry-Aware Attention Mechanism for Multi-View Transformerscited by 75
  3. 2026dWorldEval: Scalable Robotic Policy Evaluation via Discrete Diffusion World Modelcited by 11

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Scanning While Imagining: A Scene-Graph World Model for Robotic Ultrasound Navigation
  2. 2026Action-Conditioned World Model for Goal Plane Probe Guidance in Robotic Ultrasound
  3. 2025EchoWorld: Learning Motion-Aware World Models for Echocardiography Probe Guidance
  4. 2026DreamReg: Belief-Driven World Model for 2D-3D Ultrasound Registration
  5. 2025UltrasODM: A Dual Stream Optical Flow Mamba Network for 3D Freehand Ultrasound Reconstruction
  6. 2024Structure-aware World Model for Probe Guidance via Large-scale Self-supervised Pre-train
  7. 2026Ultrasound Operator Guidance Using World Modeling and Retrieval Based Action Planning
  8. 2026ForceU-VLA: A Force-Aware Vision-Language-Action Model for Embodied Ultrasound Scanning