Image Harmonization with Diffusion Model
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Image composition in image editing involves merging a foreground image with a background image to create a composite. Inconsistent lighting conditions between the foreground and background often result in unrealistic composites. Image harmonization addresses this challenge by adjusting illumination and color to achieve visually appealing and consistent outputs. In this paper, we present a novel approach for image harmonization by leveraging diffusion models. We conduct a comparative analysis of two conditional diffusion models, namely Classifier-Guidance and Classifier-Free. Our focus is on addressing the challenge of adjusting illumination and color in foreground images to create visually appealing outputs that seamlessly blend with the background. Through this research, we establish a solid groundwork for future investigations in the realm of diffusion model-based image harmonization.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 16 of its 24 references that are in the map. First posted on arXiv 17 Jun 2023.
Builds on
16 of 24 references.
Closest ancestors · 3
Same direction, newest first
- 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
- 2022Blended Latent Diffusion6 Jun
- 2021Palette: Image-to-Image Diffusion Models10 Nov
Other references · 13
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2021Image Super-Resolution via Iterative Refinementcited by 1,506
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
- 2019DoveNet: Deep Image Harmonization via Domain Verificationcited by 134
- 2017Deep Image Harmonizationcited by 120
- 2019Improving the Harmony of the Composite Image by Spatial-Separated Attention Modulecited by 73
- 2021High-Resolution Image Harmonization via Collaborative Dual Transformationscited by 55
1 more
Built on by
Citing papers per year: 2023: 1; 2024: 1; 2025: 1.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2023Painterly Image Harmonization using Diffusion Model
- 2023Relightful Harmonization: Lighting-aware Portrait Background Replacement
- 2024Diffusion Model-Based Image Editing: A Survey
- 2025Region-to-Region: Enhancing Generative Image Harmonization with Adaptive Regional Injection
- 2023FreePIH: Training-Free Painterly Image Harmonization with Diffusion Model
- 2023ControlCom: Controllable Image Composition using Diffusion Model
- 2025HarmonPaint: Harmonized Training-Free Diffusion Inpainting
- 2023Paste, Inpaint and Harmonize via Denoising: Subject-Driven Image Editing with Pre-Trained Diffusion Model