mlsanityData to 14 Oct 2026

Diffusion-based Image Translation with Label Guidance for Domain Adaptive Semantic Segmentation

arXiv 2308.12350 ↗First posted 23 Aug 2023cs.CVcited by 27

On the map: Diffusion models → Medical imaging and segmentation

Abstract (arXiv)

Translating images from a source domain to a target domain for learning target models is one of the most common strategies in domain adaptive semantic segmentation (DASS). However, existing methods still struggle to preserve semantically-consistent local details between the original and translated images. In this work, we present an innovative approach that addresses this challenge by using source-domain labels as explicit guidance during image translation. Concretely, we formulate cross-domain image translation as a denoising diffusion process and utilize a novel Semantic Gradient Guidance (SGG) method to constrain the translation process, conditioning it on the pixel-wise source labels. Additionally, a Progressive Translation Learning (PTL) strategy is devised to enable the SGG method to work reliably across domains with large gaps. Extensive experiments demonstrate the superiority of our approach over state-of-the-art methods.

Key facts. Cited by 27 papers in the map (data through 14 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 70 of its 87 references that are in the map. First posted on arXiv 23 Aug 2023.

Builds on

70 of 87 references.

References · 70

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  6. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  8. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  9. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
  10. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
  11. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
  12. 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,241
38 more
  1. 2016Wide Residual Networkscited by 3,070
  2. 2015Domain-Adversarial Training of Neural Networkscited by 3,044
  3. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
  4. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  5. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,719
  6. 2018Spectral Normalization for Generative Adversarial Networkscited by 1,636
  7. 2017CyCADA: Cycle-Consistent Adversarial Domain Adaptationcited by 1,082
  8. 2022Diffusion-LM Improves Controllable Text Generationcited by 1,027
  9. 2016Playing for Data: Ground Truth from Computer Gamescited by 818
  10. 2018CCNet: Criss-Cross Attention for Semantic Segmentationcited by 718
  11. 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
  12. 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 642
  13. 2021Score-based Generative Modeling in Latent Spacecited by 636
  14. 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 635
  15. 2020FDA: Fourier Domain Adaptation for Semantic Segmentationcited by 541
  16. 2022DiffuSeq: Sequence to Sequence Text Generation with Diffusion Modelscited by 450
  17. 2019Confidence Regularized Self-Trainingcited by 419
  18. 2022DiffusionDet: Diffusion Model for Object Detectioncited by 354
  19. 2019Bidirectional Learning for Domain Adaptation of Semantic Segmentationcited by 308
  20. 2021DAFormer: Improving Network Architectures and Training Strategies for Domain-Adaptive Semantic Segmentationcited by 300
  21. 2018Taking A Closer Look at Domain Shift: Category-level Adversaries for Semantics Consistent Domain Adaptationcited by 295
  22. 2021Prototypical Pseudo Label Denoising and Target Structure Learning for Domain Adaptive Semantic Segmentationcited by 268
  23. 2016FCNs in the Wild: Pixel-level Adversarial and Constraint-based Adaptationcited by 243
  24. 2015Conditional Random Fields as Recurrent Neural Networkscited by 214
  25. 2022Dual Diffusion Implicit Bridges for Image-to-Image Translationcited by 213
  26. 2020Unsupervised Intra-domain Adaptation for Semantic Segmentation through Self-Supervisioncited by 198
  27. 2022Stochastic Trajectory Prediction via Motion Indeterminacy Diffusioncited by 185
  28. 2022Sketch-Guided Text-to-Image Diffusion Modelscited by 180
  29. 2023Noise2Music: Text-conditioned Music Generation with Diffusion Modelscited by 173
  30. 2017Image to Image Translation for Domain Adaptationcited by 171
  31. 2022HRDA: Context-Aware High-Resolution Domain-Adaptive Semantic Segmentationcited by 164
  32. 2019Domain Adaptation for Structured Output via Discriminative Patch Representationscited by 150
  33. 2022ProDiff: Progressive Fast Diffusion Model For High-Quality Text-to-Speechcited by 149
  34. 2020Differential Treatment for Stuff and Things: A Simple Unsupervised Domain Adaptation Method for Semantic Segmentationcited by 126
  35. 2017No More Discrimination: Cross City Adaptation of Road Scene Segmenterscited by 111
  36. 2020CrDoCo: Pixel-level Domain Transfer with Cross-Domain Consistencycited by 107
  37. 2022DiffPose: Toward More Reliable 3D Pose Estimationcited by 100
  38. 2017ROAD: Reality Oriented Adaptation for Semantic Segmentation of Urban Scenescited by 95

50 most cited of 70 All 70 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 5; 2024: 9; 2025: 10; 2026: 3.

27 papers.

Sort:

By area:

  1. 2023DGInStyle: Domain-Generalizable Semantic Segmentation with Image Diffusion Models and Stylized Semantic Controlcited by 45
  2. 2023Distribution-Aligned Diffusion for Human Mesh Recoverycited by 27
  3. 2023Unsupervised Domain Adaptation via Domain-Adaptive Diffusioncited by 20
  4. 2024ODGEN: Domain-specific Object Detection Data Generation with Diffusion Modelscited by 17
  5. 2023Improving In-Context Learning in Diffusion Models with Visual Context-Modulated Promptscited by 10
  6. 2025Style Transfer with Diffusion Models for Synthetic-to-Real Domain Adaptationcited by 6
  7. 2024Diffusion Features to Bridge Domain Gap for Semantic Segmentationcited by 5
  8. 2024Noise Calibration: Plug-and-play Content-Preserving Video Enhancement using Pre-trained Video Diffusion Modelscited by 5
  9. 2024Towards Unsupervised Domain Bridging via Image Degradation in Semantic Segmentationcited by 5
  10. 2024Language-Guided Instance-Aware Domain-Adaptive Panoptic Segmentationcited by 4
  11. 2025DUDA: Distilled Unsupervised Domain Adaptation for Lightweight Semantic Segmentationcited by 3
  12. 2023Diffusion-Based Particle-DETR for BEV Perceptioncited by 2
15 more
  1. 2025SG-LDM: Semantic-Guided LiDAR Generation via Latent-Aligned Diffusioncited by 2
  2. 2025Stable-Sim2Real: Exploring Simulation of Real-Captured 3D Data with Two-Stage Depth Diffusioncited by 2
  3. 2025Balanced Learning for Domain Adaptive Semantic Segmentationcited by 2
  4. 2025VFM-UDA++: Improving Network Architectures and Data Strategies for Unsupervised Domain Adaptive Semantic Segmentationcited by 1
  5. 2025What is the Added Value of UDA in the VFM Era?cited by 1
  6. 2025Beyond the Seen: Bounded Distribution Estimation for Open-Vocabulary Learningcited by 1
  7. 2026DA-Cal: Towards Cross-Domain Calibration in Semantic Segmentationcited by 1
  8. 2026Unlocking Diffusion Hierarchies: Adaptive Timestep Selection for Zero-Shot Segmentationcited by 1
  9. 2024Beyond Traditional Single Object Tracking: A Surveycited by 0
  10. 2024Text Image Generation for Low-Resource Languages with Dual Translation Learningcited by 0
  11. 2024Reducing Semantic Ambiguity In Domain Adaptive Semantic Segmentation Via Probabilistic Prototypical Pixel Contrastcited by 0
  12. 2024Inverse Entropic Optimal Transport Solves Semi-supervised Learning via Data Likelihood Maximizationcited by 0
  13. 2025Multi-Channel Uncertainty-Weighted Score Matching for Conditional Diffusion in Medical UDAcited by 0
  14. 2025A Framework for Low-Effort Training Data Generation for Urban Semantic Segmentationcited by 0
  15. 2026Monocular Depth Estimation From the Perspective of Feature Restoration: A Diffusion Enhanced Depth Restoration Approachcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2023Prompting Diffusion Representations for Cross-Domain Semantic Segmentation
  2. 2021Label-Efficient Semantic Segmentation with Diffusion Models
  3. 2023Generalization by Adaptation: Diffusion-Based Domain Extension for Domain-Generalized Semantic Segmentation
  4. 2023Improving Diffusion-based Image Translation using Asymmetric Gradient Guidance
  5. 2025A Diffusion Model Translator for Efficient Image-to-Image Translation
  6. 2025IELDG: Suppressing Domain-Specific Noise with Inverse Evolution Layers for Domain Generalized Semantic Segmentation
  7. 2025Zero Shot Domain Adaptive Semantic Segmentation by Synthetic Data Generation and Progressive Adaptation
  8. 2026Adaptive Domain Shift in Diffusion Models for Cross-Modality Image Translation