DreamReg: Belief-Driven World Model for 2D-3D Ultrasound Registration
On the map: World models → Medical and surgical world models
Abstract (arXiv)
Ultrasound (US) is widely used for surgical navigation, yet real-time registration between intraoperative 2D slices and preoperative 3D volumes remains challenging due to partial observability, speckle noise, and the action-dependent US acquisition. Existing methods are one-shot or short-horizon, making it hard for them to gather evidence over time or capture how surgeons adjust probe motion based on on-screen feedback. We propose DreamReg, a belief-driven world-model framework that formulates 2D-3D registration as belief updating over rigid transformations. DreamReg maintains a latent belief state that summarizes past observations and poses information, and continuously refines the transformation through learned dynamics as new slices arrive. During training, DreamReg is exposed to probe-motion trajectories that mimic clinical scanning behavior and learns to update its belief by conditioning pose refinement on the current US observation. During inference, DreamReg refines registration via internal imagination: it rolls out the learned world model to simulate candidate probe motions and their predicted observations, and integrates these imagined outcomes to converge to an accurate rigid transformation. Experiments on CAMUS and u-RegPro datasets demonstrate improved robustness and competitive registration accuracy for real-time guidance compared with state-of-the-art methods.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Medical and surgical world models, one of 11 directions in World models. Builds on 15 of its 32 references that are in the map. First posted on arXiv 17 Jun 2026.
Builds on
15 of 32 references.
Closest ancestors · 2
Same direction, newest first
- 2026EHRWorld: A Patient-Centric Medical World Model for Long-Horizon Clinical Trajectories3 Feb
- 2025Medical World Model: Generative Simulation of Tumor Evolution for Treatment Planning2 Jun
Other references · 13
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
- 2018World Modelscited by 1,444
- 2020Mastering Atari with Discrete World Modelscited by 990
- 2022DayDreamer: World Models for Physical Robot Learningcited by 372
- 2019Deep Learning for Segmentation using an Open Large-Scale Dataset in 2D Echocardiographycited by 243
- 2022Recurrent Memory Transformercited by 197
- 2025GWM: Towards Scalable Gaussian World Models for Robotic Manipulationcited by 37
- 2017Slice-to-volume medical image registration: a surveycited by 21
- 2021End-to-end Ultrasound Frame to Volume Registrationcited by 13
- 2022Global Multi-modal 2D/3D Registration via Local Descriptors Learningcited by 13
- 2024Epicardium Prompt-guided Real-time Cardiac Ultrasound Frame-to-volume Registrationcited by 7
- 2024Rigid Single-Slice-in-Volume registration via rotation-equivariant 2D/3D feature matchingcited by 4
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Medical world models in healthcare: foundations, applications, and challenges for trustworthy clinical translationcited by 3
- 2026AuricularWorld: Hierarchical Action-Guided World Modeling for Fine-Grained Auricular Structure Segmentation from CT Scanscited by 0
- 2026SCoPE-Reg: Efficient Rigid Ultrasound Slice-to-Volume Registration via State-Space Correlation and Closed-Form Pose Estimationcited by 0
- 2026Scanning While Imagining: A Scene-Graph World Model for Robotic Ultrasound Navigationcited by 0
- 2026Scanning While Imagining: A Scene-Graph World Model for Robotic Ultrasound Navigation26 Sep 2026
- 2026SCoPE-Reg: Efficient Rigid Ultrasound Slice-to-Volume Registration via State-Space Correlation and Closed-Form Pose Estimation28 Aug 2026
- 2026AuricularWorld: Hierarchical Action-Guided World Modeling for Fine-Grained Auricular Structure Segmentation from CT Scans30 Jul 2026
- 2026Medical world models in healthcare: foundations, applications, and challenges for trustworthy clinical translation28 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026UltraWorld: Learning Interactive Ultrasound World Models from Untracked Clinical Videos with Acoustic Sampling Map
- 2026Ultrasound Operator Guidance Using World Modeling and Retrieval Based Action Planning
- 2026Action-Conditioned World Model for Goal Plane Probe Guidance in Robotic Ultrasound
- 2024Structure-aware World Model for Probe Guidance via Large-scale Self-supervised Pre-train
- 2025EchoWorld: Learning Motion-Aware World Models for Echocardiography Probe Guidance
- 2026SurgVista: Long-Horizon Surgical World Modeling with Plausible Instrument-Tissue Dynamics
- 2026DAISS: Phase-Aware Imitation Learning for Dual-Arm Robotic Ultrasound-Guided Interventions ↗
- 2025SonoGym: High Performance Simulation for Challenging Surgical Tasks with Robotic Ultrasound