mlsanityData to 7 Oct 2026

Image Harmonization with Diffusion Model

arXiv 2306.10441 ↗First posted 17 Jun 2023cs.CVcited by 3

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Image composition in image editing involves merging a foreground image with a background image to create a composite. Inconsistent lighting conditions between the foreground and background often result in unrealistic composites. Image harmonization addresses this challenge by adjusting illumination and color to achieve visually appealing and consistent outputs. In this paper, we present a novel approach for image harmonization by leveraging diffusion models. We conduct a comparative analysis of two conditional diffusion models, namely Classifier-Guidance and Classifier-Free. Our focus is on addressing the challenge of adjusting illumination and color in foreground images to create visually appealing outputs that seamlessly blend with the background. Through this research, we establish a solid groundwork for future investigations in the realm of diffusion model-based image harmonization.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 16 of its 24 references that are in the map. First posted on arXiv 17 Jun 2023.

Builds on

16 of 24 references.

Closest ancestors · 3

Same direction, newest first

  1. 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
  2. 2022Blended Latent Diffusion6 Jun
  3. 2021Palette: Image-to-Image Diffusion Models10 Nov

Other references · 13

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  6. 2022Classifier-Free Diffusion Guidancecited by 5,717
  7. 2021Image Super-Resolution via Iterative Refinementcited by 1,506
  8. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
  9. 2019DoveNet: Deep Image Harmonization via Domain Verificationcited by 134
  10. 2017Deep Image Harmonizationcited by 120
  11. 2019Improving the Harmony of the Composite Image by Spatial-Separated Attention Modulecited by 73
  12. 2021High-Resolution Image Harmonization via Collaborative Dual Transformationscited by 55
1 more
  1. 2015Learning a Discriminative Model for the Perception of Realism in Composite Imagescited by 52

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 1; 2025: 1.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023Painterly Image Harmonization using Diffusion Model
  2. 2023Relightful Harmonization: Lighting-aware Portrait Background Replacement
  3. 2024Diffusion Model-Based Image Editing: A Survey
  4. 2025Region-to-Region: Enhancing Generative Image Harmonization with Adaptive Regional Injection
  5. 2023FreePIH: Training-Free Painterly Image Harmonization with Diffusion Model
  6. 2023ControlCom: Controllable Image Composition using Diffusion Model
  7. 2025HarmonPaint: Harmonized Training-Free Diffusion Inpainting
  8. 2023Paste, Inpaint and Harmonize via Denoising: Subject-Driven Image Editing with Pre-Trained Diffusion Model