mlsanityData to 7 Oct 2026

SurGen: Text-Guided Diffusion Model for Surgical Video Generation

arXiv 2408.14028 ↗First posted 26 Aug 2024cs.CV cs.AI cs.CLcited by 19

On the map: Diffusion models → Medical imaging and segmentation

Abstract (arXiv)

Diffusion-based video generation models have made significant strides, producing outputs with improved visual fidelity, temporal coherence, and user control. These advancements hold great promise for improving surgical education by enabling more realistic, diverse, and interactive simulation environments. In this study, we introduce SurGen, a text-guided diffusion model tailored for surgical video synthesis. SurGen produces videos with the highest resolution and longest duration among existing surgical video generation models. We validate the visual and temporal quality of the outputs using standard image and video generation metrics. Additionally, we assess their alignment to the corresponding text prompts through a deep learning classifier trained on surgical data. Our results demonstrate the potential of diffusion models to serve as valuable educational tools for surgical trainees.

Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 32 of its 40 references that are in the map. First posted on arXiv 26 Aug 2024.

Builds on

32 of 40 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024Interactive Generation of Laparoscopic Videos with Diffusion Models23 Apr
  2. 2024Synthesizing CTA Image Data for Type-B Aortic Dissection using Stable Diffusion Models10 Feb
  3. 2022Adapting Pretrained Vision-Language Foundational Models to Medical Imaging Domains9 Oct

Other references · 29

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  7. 2022Scalable Diffusion Models with Transformerscited by 5,931
  8. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  9. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  10. 2017The Kinetics Human Action Video Datasetcited by 1,894
  11. 2021ViViT: A Video Vision Transformercited by 1,610
  12. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
17 more
  1. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
  2. 2023Language Model Beats Diffusion -- Tokenizer is Key to Visual Generationcited by 633
  3. 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 618
  4. 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 450
  5. 2016EndoNet: A Deep Architecture for Recognition Tasks on Laparoscopic Videoscited by 366
  6. 2023DriveDreamer: Towards Real-world-driven World Models for Autonomous Drivingcited by 258
  7. 2023Adapted Large Language Models Can Outperform Medical Experts in Clinical Text Summarizationcited by 244
  8. 2017Learning Spatio-Temporal Features with 3D Residual Networks for Action Recognitioncited by 178
  9. 2021DriveGAN: Towards a Controllable High-Quality Neural Simulationcited by 125
  10. 2023VDT: General-purpose Video Diffusion Transformers via Mask Modelingcited by 102
  11. 2024CT2Rep: Automated Radiology Report Generation for 3D Medical Imagingcited by 96
  12. 2024Endora: Video Generation Models as Endoscopy Simulatorscited by 53
  13. 2024A Survey on Long Video Generation: Challenges, Methods, and Prospectscited by 40
  14. 2023Style-Aware Radiology Report Generation with RadGraph and Few-Shot Promptingcited by 28
  15. 2023Navigating the Synthetic Realm: Harnessing Diffusion-based Models for Laparoscopic Text-to-Image Generationcited by 7
  16. 2024A Generalist Model for Diverse Text-Guided Medical Image Synthesiscited by 6
  17. 2024Surgical Text-to-Image Generationcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 11; 2026: 5.

19 papers.

Sort:

By area:

  1. 2024SurgSora: Object-Aware Diffusion Model for Controllable Surgical Video Generationcited by 12
  2. 2025Cosmos-H-Surgical: Learning Surgical Robot Policies from Videos via World Modelingcited by 10
  3. 2025MedGen: Unlocking Medical Video Generation by Scaling Granularly-annotated Medical Videoscited by 9
  4. 2025Surgical Scene Understanding in the Era of Foundation AI Models: A Comprehensive Reviewcited by 8
  5. 2025Surgical Vision World Modelcited by 8
  6. 2025Ophora: A Large-Scale Data-Driven Text-Guided Ophthalmic Surgical Video Generation Modelcited by 8
  7. 2025SG2VID: Scene Graphs Enable Fine-Grained Control for Video Synthesiscited by 4
  8. 2025SurGrID: Controllable Surgical Simulation via Scene Graph to Image Diffusioncited by 3
  9. 2026From Articulated Kinematics to Routed Visual Control for Action-Conditioned Surgical Video Generationcited by 3
  10. 2024Artificial Intelligence for Biomedical Video Generationcited by 2
  11. 2025From Preferences to Prejudice: The Role of Alignment Tuning in Shaping Social Bias in Video Diffusion Modelscited by 2
  12. 2024Realistic Surgical Simulation from Monocular Videoscited by 1
7 more
  1. 2025Mission Balance: Generating Under-represented Class Samples using Video Diffusion Modelscited by 1
  2. 2025Mitigating Surgical Data Imbalance with Dual-Prediction Video Diffusion Modelcited by 1
  3. 2025Multi-scale Temporal Prediction via Incremental Generation and Multi-agent Collaborationcited by 0
  4. 2026Real-Time Visual Obstruction Detection in Surgical Augmented Realitycited by 0
  5. 2026Surg-UniWorld: A Unified Surgical World Model with Multimodal Control Expertscited by 0
  6. 2026Towards Surgical World-Action Modeling: A Preliminary Joint Visual-Trajectory Forecasting for Surgical Motion Planningcited by 0
  7. 2026Beyond Masks and Trajectories: Flow-Guided Latent Action Injection for Stable Surgical Video Generationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Surgical Video Generation From Diffusion to World Models: A Survey
  2. 2025HieraSurg: Hierarchy-Aware Diffusion Model for Surgical Video Generation
  3. 2026SAW: Toward a Surgical Action World Model via Controllable and Scalable Video Generation
  4. 2022Imagen Video: High Definition Video Generation with Diffusion Models
  5. 2024SurgicaL-CD: Generating Surgical Images via Unpaired Image Translation with Latent Consistency Diffusion Models
  6. 2025Towards Application Aligned Synthetic Surgical Image Synthesis
  7. 2024Video Diffusion Models: A Survey
  8. 2025How Far Are Surgeons from Surgical World Models? A Pilot Study on Zero-shot Surgical Video Generation with Expert Assessment