Hierarchical Curriculum Learning for Surgical Video Generation: Focusing on Bilateral Axillo-Breast Approach Robotic Thyroidectomy Datasets
On the map: Diffusion models → Medical imaging and segmentation also fits: Video generation
Abstract (arXiv)
High-fidelity surgical video generation is increasingly important for surgical education, simulation, and downstream AI training, as conventional simulation pipelines are limited by cost, realism, and scenario diversity. Adapting generic text-to-video diffusion models to surgical procedures remains difficult, however, due to complex anatomical structures, intricate tool-tissue interactions, the inherently hierarchical nature of surgical workflows, and the scarcity of curated training data outside a few well-studied procedures. We propose a surgical video generation framework that combines hierarchical procedural annotation with curriculum transfer learning. Surgical procedures are decomposed into three levels (phase, task, and action) and a pretrained text-to-video diffusion model is progressively adapted from coarse to fine-grained surgical context, supported by a dynamic sampling strategy that handles variable-resolution and variable-length surgical clips. We instantiate the framework on Bilateral Axillo-Breast Approach robotic thyroidectomy, a procedure for which no curated benchmark currently exists. Relative to the preceding task-level model, the final action-level model reduces FVD by 20.1% and FID by 15.7%, and a matched-budget ablation indicates that these gains arise from the curriculum design rather than from additional training. A user study with six clinicians rates visual realism highly while highlighting remaining gaps in anatomical accuracy and clinical reliability. The proposed framework offers a step toward AI-driven surgical simulation in procedures where curated data are scarce.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 32 of its 53 references that are in the map. First posted on arXiv 13 Oct 2026.
Builds on
32 of 53 references.
Closest ancestors · 3
Same direction, newest first
- 2024SurgSora: Object-Aware Diffusion Model for Controllable Surgical Video Generation18 Dec
- 2024Optical Flow Representation Alignment Mamba Diffusion Model for Medical Video Generation3 Nov
- 2024SurGen: Text-Guided Diffusion Model for Surgical Video Generation26 Aug
Other references · 29
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2022Video Diffusion Modelscited by 2,305
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
17 more
- 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 455
- 2021Rendezvous: Attention Mechanisms for the Recognition of Surgical Action Triplets in Endoscopic Videoscited by 141
- 2023ARTboldsymbol·V: Auto-Regressive Text-to-Video Generation with Diffusion Modelscited by 76
- 2024Endora: Video Generation Models as Endoscopy Simulatorscited by 55
- 2024HecVL: Hierarchical Video-Language Pretraining for Zero-shot Surgical Phase Recognitioncited by 42
- 2024Procedure-Aware Surgical Video-language Pretraining with Hierarchical Knowledge Augmentationcited by 39
- 2024Deform3DGS: Flexible Deformation for Fast Surgical Scene Reconstruction with Gaussian Splattingcited by 38
- 2022FloLPIPS: A Bespoke Video Quality Metric for Frame Interpoationcited by 37
- 2021ACPL: Anti-curriculum Pseudo-labelling for Semi-supervised Medical Image Classificationcited by 35
- 2024Video Diffusion Models: A Surveycited by 30
- 2024EndoGaussian: Real-time Gaussian Splatting for Dynamic Endoscopic Scene Reconstructioncited by 22
- 2024VISAGE: Video Synthesis using Action Graphs for Surgerycited by 11
- 2025Ophora: A Large-Scale Data-Driven Text-Guided Ophthalmic Surgical Video Generation Modelcited by 10
- 2018SurReal: enhancing Surgical simulation Realism using style transfercited by 4
- 2024MeshBrush: Painting the Anatomical Mesh with Neural Stylization for Endoscopycited by 2
- 2024Realistic Surgical Simulation from Monocular Videoscited by 2
- 2023See Through the Fog: Curriculum Learning with Progressive Occlusion in Medical Imagingcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Surgical Video Generation From Diffusion to World Models: A Survey
- 2026SAW: Toward a Surgical Action World Model via Controllable and Scalable Video Generation
- 2025Towards Suturing World Models: Learning Predictive Models for Robotic Surgical Tasks
- 2025HieraSurg: Hierarchy-Aware Diffusion Model for Surgical Video Generation
- 2025SG2VID: Scene Graphs Enable Fine-Grained Control for Video Synthesis
- 2026Surgical WAM: A World-Action Model for Data-Efficient Surgical Robot Learning
- 2024Interactive Generation of Laparoscopic Videos with Diffusion Models
- 2024SimuScope: Realistic Endoscopic Synthetic Dataset Generation through Surgical Simulation and Diffusion Models