SurgicaL-CD: Generating Surgical Images via Unpaired Image Translation with Latent Consistency Diffusion Models
On the map: Diffusion models → Medical imaging and segmentation
Abstract (arXiv)
Computer-assisted surgery (CAS) systems are designed to assist surgeons during procedures, thereby reducing complications and enhancing patient care. Training machine learning models for these systems requires a large corpus of annotated datasets, which is challenging to obtain in the surgical domain due to patient privacy concerns and the significant labeling effort required from doctors. Previous methods have explored unpaired image translation using generative models to create realistic surgical images from simulations. However, these approaches have struggled to produce high-quality, diverse surgical images. In this work, we introduce SurgicaL-CD, a consistency-distilled diffusion method to generate realistic surgical images with only a few sampling steps without paired data. We evaluate our approach on three datasets, assessing the generated images in terms of quality and utility as downstream training datasets. Our results demonstrate that our method outperforms GANs and diffusion-based approaches. Our code is available at https://gitlab.com/ncttsopublic/gan2diffusion.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 43 of its 58 references that are in the map. First posted on arXiv 19 Aug 2024.
Builds on
43 of 58 references.
Closest ancestors · 1
Same direction, newest first
Other references · 42
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022Generative Adversarial Networkscited by 5,603
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
30 more
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
- 2023Consistency Modelscited by 1,778
- 2018Unified Perceptual Parsing for Scene Understandingcited by 1,265
- 2017CyCADA: Cycle-Consistent Adversarial Domain Adaptationcited by 1,079
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
- 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 826
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 637
- 2017Unsupervised Image-to-Image Translation Networkscited by 602
- 2020Reliable Fidelity and Diversity Metrics for Generative Modelscited by 425
- 2016EndoNet: A Deep Architecture for Recognition Tasks on Laparoscopic Videoscited by 366
- 2023Rethinking FID: Towards a Better Evaluation Metric for Image Generationcited by 303
- 2019Few-Shot Unsupervised Image-to-Image Translationcited by 222
- 2016Generating Images with Perceptual Similarity Metrics based on Deep Networkscited by 221
- 2022Metrics reloaded: Recommendations for image analysis validationcited by 190
- 2021Rendezvous: Attention Mechanisms for the Recognition of Surgical Action Triplets in Endoscopic Videoscited by 139
- 2017Surgical Data Science: Enabling Next-Generation Surgerycited by 126
- 2020Surgical Data Science -- from Concepts toward Clinical Translationcited by 105
- 2020CholecSeg8k: A Semantic Segmentation Dataset for Laparoscopic Cholecystectomy Based on Cholec80cited by 104
- 2017One-Sided Unsupervised Domain Mappingcited by 91
- 2019Generating large labeled data sets for laparoscopic image processing tasks using unpaired image-to-image translationcited by 38
- 2021Long-Term Temporally Consistent Unpaired Video Translation from Simulated Surgical 3D Datacited by 21
- 2021Mutually improved endoscopic image synthesis and landmark detection in unpaired image-to-image translationcited by 15
- 2023Exploring Semantic Consistency in Unpaired Image Translation to Generate Data for Surgical Applicationscited by 9
- 2022Detecting Adversarial Examples in Batches -- a geometrical approachcited by 2
Built on by
Citing papers per year: 2024: 1; 2025: 3.
4 papers.
- 2024Data Augmentation for Surgical Scene Segmentation with Anatomy-Aware Diffusion Modelscited by 8
- 2025PPS-Ctrl: Controllable Sim-to-Real Translation for Colonoscopy Depth Estimationcited by 2
- 2025NukesFormers: Unpaired Hyperspectral Image Generation with Non-Uniform Domain Alignmentcited by 0
- 2025Towards Application Aligned Synthetic Surgical Image Synthesiscited by 0
- 2025Towards Application Aligned Synthetic Surgical Image Synthesis23 Sep 2025
- 2025PPS-Ctrl: Controllable Sim-to-Real Translation for Colonoscopy Depth Estimation23 Apr 2025
- 2025NukesFormers: Unpaired Hyperspectral Image Generation with Non-Uniform Domain Alignment10 Mar 2025
- 2024Data Augmentation for Surgical Scene Segmentation with Anatomy-Aware Diffusion Models10 Oct 2024
Similar, not cited
Close in wording, no citation either way
- 2023Navigating the Synthetic Realm: Harnessing Diffusion-based Models for Laparoscopic Text-to-Image Generation
- 2026Surgical Video Generation From Diffusion to World Models: A Survey
- 2024SurGen: Text-Guided Diffusion Model for Surgical Video Generation
- 2024SimuScope: Realistic Endoscopic Synthetic Dataset Generation through Surgical Simulation and Diffusion Models
- 2025GAUDA: Generative Adaptive Uncertainty-guided Diffusion-based Augmentation for Surgical Segmentation
- 2024Image Synthesis with Class-Aware Semantic Diffusion Models for Surgical Scene Segmentation
- 2024Surgical Text-to-Image Generation
- 2024Interactive Generation of Laparoscopic Videos with Diffusion Models