mlsanityData to 7 Oct 2026

DreamReg: Belief-Driven World Model for 2D-3D Ultrasound Registration

arXiv 2606.18825 ↗First posted 17 Jun 2026cs.CVcited by 4

On the map: World models → Medical and surgical world models

Abstract (arXiv)

Ultrasound (US) is widely used for surgical navigation, yet real-time registration between intraoperative 2D slices and preoperative 3D volumes remains challenging due to partial observability, speckle noise, and the action-dependent US acquisition. Existing methods are one-shot or short-horizon, making it hard for them to gather evidence over time or capture how surgeons adjust probe motion based on on-screen feedback. We propose DreamReg, a belief-driven world-model framework that formulates 2D-3D registration as belief updating over rigid transformations. DreamReg maintains a latent belief state that summarizes past observations and poses information, and continuously refines the transformation through learned dynamics as new slices arrive. During training, DreamReg is exposed to probe-motion trajectories that mimic clinical scanning behavior and learns to update its belief by conditioning pose refinement on the current US observation. During inference, DreamReg refines registration via internal imagination: it rolls out the learned world model to simulate candidate probe motions and their predicted observations, and integrates these imagined outcomes to converge to an accurate rigid transformation. Experiments on CAMUS and u-RegPro datasets demonstrate improved robustness and competitive registration accuracy for real-time guidance compared with state-of-the-art methods.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Medical and surgical world models, one of 11 directions in World models. Builds on 15 of its 32 references that are in the map. First posted on arXiv 17 Jun 2026.

Builds on

15 of 32 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026EHRWorld: A Patient-Centric Medical World Model for Long-Horizon Clinical Trajectories3 Feb
  2. 2025Medical World Model: Generative Simulation of Tumor Evolution for Treatment Planning2 Jun

Other references · 13

  1. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
  2. 2018World Modelscited by 1,444
  3. 2020Mastering Atari with Discrete World Modelscited by 990
  4. 2022DayDreamer: World Models for Physical Robot Learningcited by 372
  5. 2019Deep Learning for Segmentation using an Open Large-Scale Dataset in 2D Echocardiographycited by 243
  6. 2022Recurrent Memory Transformercited by 197
  7. 2025GWM: Towards Scalable Gaussian World Models for Robotic Manipulationcited by 37
  8. 2017Slice-to-volume medical image registration: a surveycited by 21
  9. 2021End-to-end Ultrasound Frame to Volume Registrationcited by 13
  10. 2022Global Multi-modal 2D/3D Registration via Local Descriptors Learningcited by 13
  11. 2024Epicardium Prompt-guided Real-time Cardiac Ultrasound Frame-to-volume Registrationcited by 7
  12. 2024Rigid Single-Slice-in-Volume registration via rotation-equivariant 2D/3D feature matchingcited by 4
1 more
  1. 2023Identifying visible tissue in intraoperative ultrasound: a method and applicationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026UltraWorld: Learning Interactive Ultrasound World Models from Untracked Clinical Videos with Acoustic Sampling Map
  2. 2026Ultrasound Operator Guidance Using World Modeling and Retrieval Based Action Planning
  3. 2026Action-Conditioned World Model for Goal Plane Probe Guidance in Robotic Ultrasound
  4. 2024Structure-aware World Model for Probe Guidance via Large-scale Self-supervised Pre-train
  5. 2025EchoWorld: Learning Motion-Aware World Models for Echocardiography Probe Guidance
  6. 2026SurgVista: Long-Horizon Surgical World Modeling with Plausible Instrument-Tissue Dynamics
  7. 2026DAISS: Phase-Aware Imitation Learning for Dual-Arm Robotic Ultrasound-Guided Interventions ↗
  8. 2025SonoGym: High Performance Simulation for Challenging Surgical Tasks with Robotic Ultrasound