mlsanityData to 7 Oct 2026

SurgicaL-CD: Generating Surgical Images via Unpaired Image Translation with Latent Consistency Diffusion Models

arXiv 2408.09822 ↗First posted 19 Aug 2024cs.CVcited by 4

On the map: Diffusion models → Medical imaging and segmentation

Abstract (arXiv)

Computer-assisted surgery (CAS) systems are designed to assist surgeons during procedures, thereby reducing complications and enhancing patient care. Training machine learning models for these systems requires a large corpus of annotated datasets, which is challenging to obtain in the surgical domain due to patient privacy concerns and the significant labeling effort required from doctors. Previous methods have explored unpaired image translation using generative models to create realistic surgical images from simulations. However, these approaches have struggled to produce high-quality, diverse surgical images. In this work, we introduce SurgicaL-CD, a consistency-distilled diffusion method to generate realistic surgical images with only a few sampling steps without paired data. We evaluate our approach on three datasets, assessing the generated images in terms of quality and utility as downstream training datasets. Our results demonstrate that our method outperforms GANs and diffusion-based approaches. Our code is available at https://gitlab.com/ncttsopublic/gan2diffusion.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 43 of its 58 references that are in the map. First posted on arXiv 19 Aug 2024.

Builds on

43 of 58 references.

Closest ancestors · 1

Same direction, newest first

  1. 2022Diffusion Models for Medical Image Analysis: A Comprehensive Survey14 Nov

Other references · 42

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  7. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  8. 2022Classifier-Free Diffusion Guidancecited by 5,717
  9. 2022Generative Adversarial Networkscited by 5,603
  10. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  11. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  12. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
30 more
  1. 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
  2. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  3. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
  4. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
  5. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  6. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
  7. 2023Consistency Modelscited by 1,778
  8. 2018Unified Perceptual Parsing for Scene Understandingcited by 1,265
  9. 2017CyCADA: Cycle-Consistent Adversarial Domain Adaptationcited by 1,079
  10. 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
  11. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 826
  12. 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
  13. 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 637
  14. 2017Unsupervised Image-to-Image Translation Networkscited by 602
  15. 2020Reliable Fidelity and Diversity Metrics for Generative Modelscited by 425
  16. 2016EndoNet: A Deep Architecture for Recognition Tasks on Laparoscopic Videoscited by 366
  17. 2023Rethinking FID: Towards a Better Evaluation Metric for Image Generationcited by 303
  18. 2019Few-Shot Unsupervised Image-to-Image Translationcited by 222
  19. 2016Generating Images with Perceptual Similarity Metrics based on Deep Networkscited by 221
  20. 2022Metrics reloaded: Recommendations for image analysis validationcited by 190
  21. 2021Rendezvous: Attention Mechanisms for the Recognition of Surgical Action Triplets in Endoscopic Videoscited by 139
  22. 2017Surgical Data Science: Enabling Next-Generation Surgerycited by 126
  23. 2020Surgical Data Science -- from Concepts toward Clinical Translationcited by 105
  24. 2020CholecSeg8k: A Semantic Segmentation Dataset for Laparoscopic Cholecystectomy Based on Cholec80cited by 104
  25. 2017One-Sided Unsupervised Domain Mappingcited by 91
  26. 2019Generating large labeled data sets for laparoscopic image processing tasks using unpaired image-to-image translationcited by 38
  27. 2021Long-Term Temporally Consistent Unpaired Video Translation from Simulated Surgical 3D Datacited by 21
  28. 2021Mutually improved endoscopic image synthesis and landmark detection in unpaired image-to-image translationcited by 15
  29. 2023Exploring Semantic Consistency in Unpaired Image Translation to Generate Data for Surgical Applicationscited by 9
  30. 2022Detecting Adversarial Examples in Batches -- a geometrical approachcited by 2

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 3.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023Navigating the Synthetic Realm: Harnessing Diffusion-based Models for Laparoscopic Text-to-Image Generation
  2. 2026Surgical Video Generation From Diffusion to World Models: A Survey
  3. 2024SurGen: Text-Guided Diffusion Model for Surgical Video Generation
  4. 2024SimuScope: Realistic Endoscopic Synthetic Dataset Generation through Surgical Simulation and Diffusion Models
  5. 2025GAUDA: Generative Adaptive Uncertainty-guided Diffusion-based Augmentation for Surgical Segmentation
  6. 2024Image Synthesis with Class-Aware Semantic Diffusion Models for Surgical Scene Segmentation
  7. 2024Surgical Text-to-Image Generation
  8. 2024Interactive Generation of Laparoscopic Videos with Diffusion Models