mlsanityData to 14 Oct 2026

Surgical Video Generation From Diffusion to World Models: A Survey

arXiv 2608.26214 ↗First posted 26 Aug 2026cs.CVcited by 0

On the map: World models → Medical and surgical world models

Abstract (arXiv)

Surgical video data provides the primary training resource for models of intraoperative perception, surgical workflow understanding, and robotic decision-making. However, clinical data acquisition remains constrained by privacy, cost, and class imbalance. Surgical video generation has emerged as a transformative approach to addressing data scarcity and as a foundation for surgical simulation, training, and robotic policy learning. The field has developed rapidly without a clear conceptual framework. This survey organizes the 2024-2026 literature into three categories: unconditional generation, conditional generation, and world modeling generation, revealing a fundamental shift in how the task is defined from synthesizing visually plausible frames to modeling the causal dynamics of surgical scenes. We examine the persistent gap between pixel-level fidelity and clinical plausibility, and identify generalization, physical realism, controllability, and interpretability as bottlenecks. We further summarize experimental results of representative methods on public datasets to provide a quantitative reference for the field. This survey provides a structured overview of the current state and open challenges, offering a reference for researchers working at the intersection of intelligent perception, multi-modal fusion, generative AI, and surgical data science.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Medical and surgical world models, one of 11 directions in World models. Builds on 14 of its 19 references that are in the map. First posted on arXiv 26 Aug 2026.

Builds on

14 of 19 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026SWoMo: Neuro-Symbolic World Model for Cataract Surgery Simulation15 May
  2. 2025How Far Are Surgeons from Surgical World Models? A Pilot Study on Zero-shot Surgical Video Generation with Expert Assessment3 Nov

Other references · 12

  1. 2022Video Diffusion Modelscited by 2,305
  2. 2020Surgical Data Science -- from Concepts toward Clinical Translationcited by 105
  3. 2024Endora: Video Generation Models as Endoscopy Simulatorscited by 55
  4. 2024SurgSora: Object-Aware Diffusion Model for Controllable Surgical Video Generationcited by 15
  5. 2024VISAGE: Video Synthesis using Action Graphs for Surgerycited by 11
  6. 2025Ophora: A Large-Scale Data-Driven Text-Guided Ophthalmic Surgical Video Generation Modelcited by 10
  7. 2025Large-scale Self-supervised Video Foundation Model for Intelligent Surgerycited by 10
  8. 2024Gradient Harmonization in Unsupervised Domain Adaptationcited by 9
  9. 2024Interactive Generation of Laparoscopic Videos with Diffusion Modelscited by 8
  10. 2025HieraSurg: Hierarchy-Aware Diffusion Model for Surgical Video Generationcited by 8
  11. 2025SG2VID: Scene Graphs Enable Fine-Grained Control for Video Synthesiscited by 4
  12. 2025Unsupervised Robust Domain Adaptation: Paradigm, Theory and Algorithmcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026SAW: Toward a Surgical Action World Model via Controllable and Scalable Video Generation
  2. 2025Towards Suturing World Models: Learning Predictive Models for Robotic Surgical Tasks
  3. 2025Surgical Vision World Model
  4. 2026Surgical WAM: A World-Action Model for Data-Efficient Surgical Robot Learning
  5. 2024SurGen: Text-Guided Diffusion Model for Surgical Video Generation
  6. 2026NVIDIA Cosmos-H-Dreams: Real-Time Generative Physics Simulation for Surgical Robotics
  7. 2026SurgWMBench: A Vision-Based Benchmark for World-Modeling Surgical Instrument Motion Planning
  8. 2025Cosmos-H-Surgical: Learning Surgical Robot Policies from Videos via World Modeling