Deep Image Harmonization
Not on the map. Why?
Cited by 22 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Compositing is one of the most common operations in photo editing. To generate realistic composites, the appearances of foreground and background need to be adjusted to make them compatible. Previous approaches to harmonize composites have focused on learning statistical relationships between hand-crafted appearance features of the foreground and background, which is unreliable especially when the contents in the two layers are vastly different. In this work, we propose an end-to-end deep convolutional neural network for image harmonization, which can capture both the context and semantic information of the composite images during harmonization. We also introduce an efficient way to collect large-scale and high-quality training data that can facilitate the training process. Experiments on the synthesized dataset and real composite images show that the proposed network outperforms previous state-of-the-art methods.
Key facts. Cited by 120 papers in the map (data through 14 Oct 2026). First posted on arXiv 28 Feb 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 21; 2022: 35; 2023: 28; 2024: 13; 2025: 13; 2026: 10.
120 papers.
Sort:
By area:
- 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
- 2021GAN Inversion: A Surveycited by 367
- 2022ARF: Artistic Radiance Fieldscited by 147
- 2022Photorealistic Monocular 3D Reconstruction of Humans Wearing Clothingcited by 126
- 2024Transparent Image Layer Diffusion using Latent Transparencycited by 114
- 2021Region-aware Adaptive Instance Normalization for Image Harmonizationcited by 71
- 2021Making Images Real Again: A Comprehensive Survey on Deep Image Compositioncited by 63
- 2022Harmonizer: Learning to Perform White-Box Image and Video Harmonizationcited by 61
- 2021SSH: A Self-Supervised Framework for Image Harmonizationcited by 60
- 2023Unified Multi-Modal Latent Diffusion for Joint Subject and Text Conditional Image Generationcited by 60
- 2023Relightful Harmonization: Lighting-aware Portrait Background Replacementcited by 57
- 2021High-Resolution Image Harmonization via Collaborative Dual Transformationscited by 55
38 more
- 2021TransFill: Reference-guided Image Inpainting by Merging Multiple Color and Spatial Transformationscited by 48
- 2022DCCF: Deep Comprehensible Color Filter Learning Framework for High-Resolution Image Harmonizationcited by 46
- 2023ControlCom: Controllable Image Composition using Diffusion Modelcited by 43
- 2025OmniPaint: Mastering Object-Oriented Editing via Disentangled Insertion-Removal Inpaintingcited by 39
- 2022ObjectStitch: Generative Object Compositingcited by 36
- 2023Neural Preset for Color Style Transfercited by 36
- 2021Shadow Generation for Composite Image in Real-world Scenescited by 35
- 2021Contrastive Representation Learning for Hand Shape Estimationcited by 34
- 2022Probabilistic Compositional Embeddings for Multimodal Image Retrievalcited by 29
- 2021OPA: Object Placement Assessment Datasetcited by 28
- 2023Semi-supervised Parametric Real-world Image Harmonizationcited by 26
- 2021Spatial-Separated Curve Rendering Network for Efficient and High-Resolution Image Harmonizationcited by 25
- 2022SCS-Co: Self-Consistent Style Contrastive Learning for Image Harmonizationcited by 24
- 2023Paste, Inpaint and Harmonize via Denoising: Subject-Driven Image Editing with Pre-Trained Diffusion Modelcited by 21
- 2022Learning Object Placement via Dual-path Graph Completioncited by 20
- 2023Dense Pixel-to-Pixel Harmonization via Continuous Image Representationcited by 19
- 2023Towards Enhanced Image Inpainting: Mitigating Unwanted Object Insertion and Preserving Color Consistencycited by 19
- 2022Image Amodal Completion: A Surveycited by 18
- 2023NCHO: Unsupervised Learning for Neural 3D Composition of Humans and Objectscited by 17
- 2023DreamCom: Finetuning Text-guided Inpainting Model for Image Compositioncited by 17
- 2024Shadow Generation for Composite Image Using Diffusion modelcited by 17
- 2025IntrinsicEdit: Precise generative image manipulation in intrinsic spacecited by 17
- 2023Integrating View Conditions for Image Synthesiscited by 16
- 2024Geometry Transfer for Stylizing Radiance Fieldscited by 16
- 2024ZeroComp: Zero-shot Object Compositing from Image Intrinsics via Diffusioncited by 16
- 2023PixHt-Lab: Pixel Height Based Light Effect Generation for Image Compositingcited by 15
- 2021Visible Watermark Removal via Self-calibrated Localization and Background Refinementcited by 14
- 2023Cross-domain Compositing with Pretrained Diffusion Modelscited by 13
- 2024Open-Set Domain Adaptation for Semantic Segmentationcited by 13
- 2022Fast Object Placement Assessmentcited by 12
- 2022Hierarchical Dynamic Image Harmonizationcited by 12
- 2023LEMaRT: Label-Efficient Masked Region Transform for Image Harmonizationcited by 12
- 2023Deep Image Harmonization in Dual Color Spacescited by 12
- 2025Comprehensive Relighting: Generalizable and Consistent Monocular Human Relighting and Harmonizationcited by 12
- 2021Deep Image Harmonization by Bridging the Reality Gapcited by 11
- 2022Painterly Image Harmonization in Dual Domainscited by 11
- 2026DiffusionHarmonizer: Bridging Neural Reconstruction and Photorealistic Simulation with Online Diffusion Enhancercited by 10
- 2022Deep Video Harmonization with Color Mapping Consistencycited by 9
50 most cited of 120 All 120 (JSON)
- 2026Scene-Consistent Illumination Transfer for Inserted Advertising Graphics29 Sep 2026
- 2026Semantically-Guided Domain Randomization for Industrial Object Detection in Low-Image-Budget Regimes22 Sep 2026
- 2026Geometry-Driven Shadow Harmonisation for Composited Faces: A Multiplicative, Albedo-Preserving Relighting Pipeline15 Sep 2026
- 2026Hybrid Generative-Discriminative Object Placement24 Aug 2026
- 2026Smart-Insertion-V: Photorealistic Video Insertion via a Closed-Loop Feedback Dual-Stream Framework22 May 2026
- 2026PICS: Pairwise Image Compositing with Spatial Interactions6 Mar 2026
- 2026DiffusionHarmonizer: Bridging Neural Reconstruction and Photorealistic Simulation with Online Diffusion Enhancer27 Feb 2026
- 2026Geometric Image Editing via Effects-Sensitive In-Context Inpainting with Diffusion Transformers9 Feb 2026
- 2026Aligned Stable Inpainting: Mitigating Unwanted Object Insertion and Preserving Color Consistency21 Jan 2026
- 2026LooseRoPE: Content-aware Attention Manipulation for Semantic Harmonization8 Jan 2026
- 2025RoomEditor++: A Parameter-Sharing Diffusion Architecture for High-Fidelity Furniture Synthesis19 Dec 2025
- 2025POLAR: A Portrait OLAT Dataset and Generative Framework for Illumination-Aware Face Modeling15 Dec 2025
38 more
- 2025PixPerfect: Seamless Latent Diffusion Local Editing with Discriminative Pixel-Space Refinement2 Dec 2025
- 2025MagicQuillV2: Precise and Interactive Image Editing with Layered Visual Cues2 Dec 2025
- 2025Insert In Style: A Zero-Shot Generative Framework for Harmonious Cross-Domain Object Composition19 Nov 2025
- 2025Region-to-Region: Enhancing Generative Image Harmonization with Adaptive Regional Injection13 Aug 2025
- 2025DreamLight: Towards Harmonious and Consistent Image Relighting17 Jun 2025
- 2025ConsiStyle: Style Diversity in Training-Free Consistent T2I Generation27 May 2025
- 2025IntrinsicEdit: Precise generative image manipulation in intrinsic space13 May 2025
- 2025Comprehensive Relighting: Generalizable and Consistent Monocular Human Relighting and Harmonization3 Apr 2025
- 2025BOOTPLACE: Bootstrapped Object Placement with Detection Transformers27 Mar 2025
- 2025OmniPaint: Mastering Object-Oriented Editing via Disentangled Insertion-Removal Inpainting11 Mar 2025
- 2025Blind Augmentation: Calibration-free Camera Distortion Model Estimation for Real-time Mixed-reality Consistency3 Mar 2025
- 2024ZeroComp: Zero-shot Object Compositing from Image Intrinsics via Diffusion10 Oct 2024
- 2024Foodfusion: A Novel Approach for Food Image Composition via Diffusion Models26 Aug 2024
- 2024Harmonizing Attention: Training-free Texture-aware Geometry Transfer19 Aug 2024
- 2024TALE: Training-free Cross-domain Image Composition via Adaptive Latent Manipulation and Energy-guided Optimization7 Aug 2024
- 2024Diverse Image Harmonization22 Jul 2024
- 2024Open-Set Domain Adaptation for Semantic Segmentation30 May 2024
- 2024DiffHarmony: Latent Diffusion Model Meets Image Harmonization9 Apr 2024
- 2024Shadow Generation for Composite Image Using Diffusion model22 Mar 2024
- 2024Transparent Image Layer Diffusion using Latent Transparency27 Feb 2024
- 2024Geometry Transfer for Stylizing Radiance Fields1 Feb 2024
- 2024Repositioning the Subject within Image30 Jan 2024
- 2024RPNR: Robust-Perception Neural Reshading25 Jan 2024
- 2024Edit One for All: Interactive Batch Image Editing18 Jan 2024
- 2023Segment Anything Model Meets Image Harmonization20 Dec 2023
- 2023Progressive Painterly Image Harmonization from Low-level Styles to High-level Styles15 Dec 2023
- 2023Painterly Image Harmonization by Learning from Painterly Objects15 Dec 2023
- 2023Relightful Harmonization: Lighting-aware Portrait Background Replacement11 Dec 2023
- 2023Towards Enhanced Image Inpainting: Mitigating Unwanted Object Insertion and Preserving Color Consistency8 Dec 2023
- 2023Painterly Image Harmonization via Adversarial Residual Learning15 Nov 2023
- 2023Virtual Accessory Try-On via Keypoint Hallucination26 Oct 2023
- 2023Integrating View Conditions for Image Synthesis24 Oct 2023
- 2023DreamCom: Finetuning Text-guided Inpainting Model for Image Composition27 Sep 2023
- 2023ControlCom: Controllable Image Composition using Diffusion Model19 Aug 2023
- 2023Foreground Object Search by Distilling Composite Image Feature9 Aug 2023
- 2023Deep Image Harmonization in Dual Color Spaces5 Aug 2023
- 2023Deep Image Harmonization with Learnable Augmentation1 Aug 2023
- 2023Deep Image Harmonization with Globally Guided Feature Transformation and Relation Distillation1 Aug 2023
50 newest of 120 All 120 (JSON)
- 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
- 2024Transparent Image Layer Diffusion using Latent Transparencycited by 114
- 2023Unified Multi-Modal Latent Diffusion for Joint Subject and Text Conditional Image Generationcited by 60
- 2023Relightful Harmonization: Lighting-aware Portrait Background Replacementcited by 57
- 2023ControlCom: Controllable Image Composition using Diffusion Modelcited by 43
- 2025OmniPaint: Mastering Object-Oriented Editing via Disentangled Insertion-Removal Inpaintingcited by 39
- 2023Paste, Inpaint and Harmonize via Denoising: Subject-Driven Image Editing with Pre-Trained Diffusion Modelcited by 21
- 2023Towards Enhanced Image Inpainting: Mitigating Unwanted Object Insertion and Preserving Color Consistencycited by 19
- 2024Shadow Generation for Composite Image Using Diffusion modelcited by 17
- 2025IntrinsicEdit: Precise generative image manipulation in intrinsic spacecited by 17
- 2023Cross-domain Compositing with Pretrained Diffusion Modelscited by 13
- 2025Comprehensive Relighting: Generalizable and Consistent Monocular Human Relighting and Harmonizationcited by 12
12 most cited of 22 All 22 (JSON)
- 2026Semantically-Guided Domain Randomization for Industrial Object Detection in Low-Image-Budget Regimes22 Sep 2026
- 2026PICS: Pairwise Image Compositing with Spatial Interactions6 Mar 2026
- 2026Geometric Image Editing via Effects-Sensitive In-Context Inpainting with Diffusion Transformers9 Feb 2026
- 2026LooseRoPE: Content-aware Attention Manipulation for Semantic Harmonization8 Jan 2026
- 2025PixPerfect: Seamless Latent Diffusion Local Editing with Discriminative Pixel-Space Refinement2 Dec 2025
- 2025MagicQuillV2: Precise and Interactive Image Editing with Layered Visual Cues2 Dec 2025
- 2025IntrinsicEdit: Precise generative image manipulation in intrinsic space13 May 2025
- 2025Comprehensive Relighting: Generalizable and Consistent Monocular Human Relighting and Harmonization3 Apr 2025
- 2025OmniPaint: Mastering Object-Oriented Editing via Disentangled Insertion-Removal Inpainting11 Mar 2025
- 2024Foodfusion: A Novel Approach for Food Image Composition via Diffusion Models26 Aug 2024
- 2024TALE: Training-free Cross-domain Image Composition via Adaptive Latent Manipulation and Energy-guided Optimization7 Aug 2024
- 2024DiffHarmony: Latent Diffusion Model Meets Image Harmonization9 Apr 2024
12 newest of 22 All 22 (JSON)
- 2021GAN Inversion: A Surveycited by 367
- 2022ARF: Artistic Radiance Fieldscited by 147
- 2022Photorealistic Monocular 3D Reconstruction of Humans Wearing Clothingcited by 126
- 2021Region-aware Adaptive Instance Normalization for Image Harmonizationcited by 71
- 2021Making Images Real Again: A Comprehensive Survey on Deep Image Compositioncited by 63
- 2022Harmonizer: Learning to Perform White-Box Image and Video Harmonizationcited by 61
- 2021SSH: A Self-Supervised Framework for Image Harmonizationcited by 60
- 2021High-Resolution Image Harmonization via Collaborative Dual Transformationscited by 55
- 2021TransFill: Reference-guided Image Inpainting by Merging Multiple Color and Spatial Transformationscited by 48
- 2022DCCF: Deep Comprehensible Color Filter Learning Framework for High-Resolution Image Harmonizationcited by 46
- 2022ObjectStitch: Generative Object Compositingcited by 36
- 2023Neural Preset for Color Style Transfercited by 36
12 most cited of 97 All 97 (JSON)
- 2026Scene-Consistent Illumination Transfer for Inserted Advertising Graphics29 Sep 2026
- 2026Geometry-Driven Shadow Harmonisation for Composited Faces: A Multiplicative, Albedo-Preserving Relighting Pipeline15 Sep 2026
- 2026Hybrid Generative-Discriminative Object Placement24 Aug 2026
- 2026Smart-Insertion-V: Photorealistic Video Insertion via a Closed-Loop Feedback Dual-Stream Framework22 May 2026
- 2026DiffusionHarmonizer: Bridging Neural Reconstruction and Photorealistic Simulation with Online Diffusion Enhancer27 Feb 2026
- 2026Aligned Stable Inpainting: Mitigating Unwanted Object Insertion and Preserving Color Consistency21 Jan 2026
- 2025RoomEditor++: A Parameter-Sharing Diffusion Architecture for High-Fidelity Furniture Synthesis19 Dec 2025
- 2025POLAR: A Portrait OLAT Dataset and Generative Framework for Illumination-Aware Face Modeling15 Dec 2025
- 2025Insert In Style: A Zero-Shot Generative Framework for Harmonious Cross-Domain Object Composition19 Nov 2025
- 2025Region-to-Region: Enhancing Generative Image Harmonization with Adaptive Regional Injection13 Aug 2025
- 2025DreamLight: Towards Harmonious and Consistent Image Relighting17 Jun 2025
- 2025ConsiStyle: Style Diversity in Training-Free Consistent T2I Generation27 May 2025
12 newest of 97 All 97 (JSON)