SurgVista: Long-Horizon Surgical World Modeling with Plausible Instrument-Tissue Dynamics
On the map: World models → Medical and surgical world models
Abstract (arXiv)
Scaling robot policy learning for autonomous surgery is challenging, as expert demonstrations are expensive and in vivo exploration poses substantial safety risks. Surgical world models address this by generating realistic, action-conditioned future frames from an initial observation, but existing methods exhibit two persistent failure modes: spatial interaction incoherence, where visible instrument contact fails to induce spatially consistent tissue deformation, and temporal fidelity collapse, where prediction errors compound across autoregressive rollouts and progressively corrupt visual quality. We present SurgVista, a surgical world model that mitigates both failures through two training recipes. Deformation Consistency Regularization extracts scene-point trajectories from training videos and enforces cross-frame coherence through latent contrastive learning, strengthening physically consistent instrument-tissue dynamics. Drift Adaptation Training mitigates long-horizon drift by perturbing conditioning frames with online prediction residuals and photometric augmentations calibrated to long-horizon drift statistics, sustaining visual fidelity over extended rollouts. To enable rigorous evaluation, we further introduce SurgWorld-Bench, featuring diverse procedure types, long-range rollouts, and decoupled metrics for instrument-motion accuracy and tissue-response fidelity. Extensive experiments show that SurgVista consistently outperforms state-of-the-art methods across visual quality, temporal consistency, and interaction fidelity, with gains widening as the prediction horizon grows.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Medical and surgical world models, one of 11 directions in World models. Builds on 36 of its 40 references that are in the map. First posted on arXiv 18 Jun 2026.
Builds on
36 of 40 references.
Closest ancestors · 3
Same direction, newest first
- 2026SAW: Toward a Surgical Action World Model via Controllable and Scalable Video Generation13 Mar
- 2025Medical World Model: Generative Simulation of Tumor Evolution for Treatment Planning2 Jun
- 2025Towards Suturing World Models: Learning Predictive Models for Robotic Surgical Tasks16 Mar
Other references · 33
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
- 2018World Modelscited by 1,513
- 2023Mastering Diverse Domains through World Modelscited by 1,253
- 2024Genie: Generative Interactive Environmentscited by 747
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
21 more
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
- 2022MONAI: An open-source framework for deep learning in healthcarecited by 448
- 2022TAP-Vid: A Benchmark for Tracking Any Point in a Videocited by 263
- 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Textcited by 251
- 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generationcited by 192
- 2025Matrix-game 2.0: An open-source real-time and streaming interactive world modelcited by 186
- 2025History-Guided Video Diffusioncited by 171
- 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modelingcited by 170
- 2025HunyuanVideo 1.5 Technical Reportcited by 160
- 2025Frame Context Packing and Drift Prevention in Next-Frame-Prediction Video Diffusion Modelscited by 143
- 2024CoTracker3: Simpler and Better Point Tracking by Pseudo-Labelling Real Videoscited by 128
- 2019Generalization in Generation: A closer look at Exposure Biascited by 123
- 2023Elucidating the Exposure Bias in Diffusion Modelscited by 101
- 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memorycited by 100
- 2025Stable Video Infinity: Infinite-Length Video Generation with Error Recyclingcited by 73
- 2024Pixel-Wise Recognition for Holistic Surgical Scene Understandingcited by 49
- 2025Wan-Move: Motion-controllable Video Generation via Latent Trajectory Guidancecited by 45
- 2023CholecTrack20: A Multi-Perspective Tracking Dataset for Surgical Toolscited by 17
- 2024General-purpose foundation models for increased autonomy in robot-assisted surgerycited by 15
- 2024SurgSora: Object-Aware Diffusion Model for Controllable Surgical Video Generationcited by 15
- 2025HieraSurg: Hierarchy-Aware Diffusion Model for Surgical Video Generationcited by 8
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Surg-UniWorld: A Unified Surgical World Model with Multimodal Control Experts
- 2026SurgCast: Action-Conditioned Future Skeletons for Controllable Surgical World Models
- 2026SurgWMBench: A Vision-Based Benchmark for World-Modeling Surgical Instrument Motion Planning
- 2026SurgVIL: Scaling Surgical Robot Imitation Learning with Open-source Surgical Videos
- 2026Towards Surgical World-Action Modeling: A Preliminary Joint Visual-Trajectory Forecasting for Surgical Motion Planning
- 2025Cosmos-Surg-dVRK: World Foundation Model-based Automated Online Evaluation of Surgical Robot Policy Learning
- 2025SurgiPose: Estimating Surgical Tool Kinematics from Monocular Video for Surgical Robot Learning
- 2025How Far Are Surgeons from Surgical World Models? A Pilot Study on Zero-shot Surgical Video Generation with Expert Assessment