Learning a Discriminative Model for the Perception of Realism in Composite Images
Not on the map. Why?
Abstract (arXiv)
What makes an image appear realistic? In this work, we are answering this question from a data-driven perspective by learning the perception of visual realism directly from large amounts of data. In particular, we train a Convolutional Neural Network (CNN) model that distinguishes natural photographs from automatically generated composite images. The model learns to predict visual realism of a scene in terms of color, lighting and texture compatibility, without any human annotations pertaining to it. Our model outperforms previous works that rely on hand-crafted heuristics, for the task of classifying realistic vs. unrealistic photos. Furthermore, we apply our learned model to compute optimal parameters of a compositing method, to maximize the visual realism score predicted by our CNN model. We demonstrate its advantage against existing methods via a human perception study.
Key facts. Cited by 52 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Oct 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 12; 2022: 14; 2023: 15; 2024: 6; 2025: 3; 2026: 2.
52 papers.
Sort:
By area:
- 2024Transparent Image Layer Diffusion using Latent Transparencycited by 111
- 2021Region-aware Adaptive Instance Normalization for Image Harmonizationcited by 71
- 2021Making Images Real Again: A Comprehensive Survey on Deep Image Compositioncited by 63
- 2022Harmonizer: Learning to Perform White-Box Image and Video Harmonizationcited by 61
- 2021SSH: A Self-Supervised Framework for Image Harmonizationcited by 60
- 2023Relightful Harmonization: Lighting-aware Portrait Background Replacementcited by 56
- 2021CAMPARI: Camera-Aware Decomposed Generative Neural Radiance Fieldscited by 55
- 2021High-Resolution Image Harmonization via Collaborative Dual Transformationscited by 55
- 2021TransFill: Reference-guided Image Inpainting by Merging Multiple Color and Spatial Transformationscited by 48
- 2021Shadow Generation for Composite Image in Real-world Scenescited by 35
- 2023Semi-supervised Parametric Real-world Image Harmonizationcited by 26
- 2021Spatial-Separated Curve Rendering Network for Efficient and High-Resolution Image Harmonizationcited by 25
38 more
- 2022SCS-Co: Self-Consistent Style Contrastive Learning for Image Harmonizationcited by 24
- 2022Learning Object Placement via Dual-path Graph Completioncited by 20
- 2023Towards Enhanced Image Inpainting: Mitigating Unwanted Object Insertion and Preserving Color Consistencycited by 19
- 2023NCHO: Unsupervised Learning for Neural 3D Composition of Humans and Objectscited by 17
- 2024FreeCompose: Generic Zero-Shot Image Composition with Diffusion Priorcited by 16
- 2023Realistic Saliency Guided Image Enhancementcited by 14
- 20233D-aware Blending with Generative NeRFscited by 13
- 2023LEMaRT: Label-Efficient Masked Region Transform for Image Harmonizationcited by 12
- 2023Painterly Image Harmonization using Diffusion Modelcited by 12
- 2023Deep Image Harmonization in Dual Color Spacescited by 12
- 2025Comprehensive Relighting: Generalizable and Consistent Monocular Human Relighting and Harmonizationcited by 12
- 2022Painterly Image Harmonization in Dual Domainscited by 11
- 2022Memory-Driven Text-to-Image Generationcited by 10
- 2022Deep Video Harmonization with Color Mapping Consistencycited by 9
- 2022FRIH: Fine-grained Region-aware Image Harmonizationcited by 9
- 2022Semantic-guided Multi-Mask Image Harmonizationcited by 6
- 2023Foreground Object Search by Distilling Composite Image Featurecited by 6
- 2023Deep Image Harmonization with Learnable Augmentationcited by 5
- 2022GALA: Toward Geometry-and-Lighting-Aware Object Search for Compositingcited by 4
- 2025MagicQuillV2: Precise and Interactive Image Editing with Layered Visual Cuescited by 4
- 2022Cut-Paste Consistency Learning for Semi-Supervised Lesion Segmentationcited by 3
- 2023Image Harmonization with Diffusion Modelcited by 3
- 2023Reference-based Painterly Inpainting via Diffusion: Crossing the Wild Reference Domain Gapcited by 3
- 2024DiffHarmony: Latent Diffusion Model Meets Image Harmonizationcited by 3
- 2024Quality Prediction of AI Generated Images and Videos: Emerging Trends and Opportunitiescited by 3
- 2021SIDNet: Learning Shading-aware Illumination Descriptor for Image Harmonizationcited by 2
- 2022Interactive Portrait Harmonizationcited by 2
- 2022Spatial Transformation for Image Composition via Correspondence Learningcited by 2
- 2022gCoRF: Generative Compositional Radiance Fieldscited by 2
- 2021A Generative Adversarial Framework for Optimizing Image Matting and Harmonization Simultaneouslycited by 1
- 2022Image Harmonization with Region-wise Contrastive Learningcited by 1
- 2024Diverse Image Harmonizationcited by 1
- 2025POLAR: A Portrait OLAT Dataset and Generative Framework for Illumination-Aware Face Modelingcited by 1
- 2021Deep Image Compositingcited by 0
- 2021HYouTube: Video Harmonization Datasetcited by 0
- 2023Virtual Accessory Try-On via Keypoint Hallucinationcited by 0
- 2023Painterly Image Harmonization via Adversarial Residual Learningcited by 0
- 2024Harmonizing Attention: Training-free Texture-aware Geometry Transfercited by 0
50 most cited of 52 All 52 (JSON)
- 2026BG-REAL: A Public Real-Data Anchored Benchmark for Background Manipulation Detection and Localization28 Jul 2026
- 2026Aligned Stable Inpainting: Mitigating Unwanted Object Insertion and Preserving Color Consistency21 Jan 2026
- 2025POLAR: A Portrait OLAT Dataset and Generative Framework for Illumination-Aware Face Modeling15 Dec 2025
- 2025MagicQuillV2: Precise and Interactive Image Editing with Layered Visual Cues2 Dec 2025
- 2025Comprehensive Relighting: Generalizable and Consistent Monocular Human Relighting and Harmonization3 Apr 2025
- 2024Quality Prediction of AI Generated Images and Videos: Emerging Trends and Opportunities11 Oct 2024
- 2024Harmonizing Attention: Training-free Texture-aware Geometry Transfer19 Aug 2024
- 2024Diverse Image Harmonization22 Jul 2024
- 2024FreeCompose: Generic Zero-Shot Image Composition with Diffusion Prior6 Jul 2024
- 2024DiffHarmony: Latent Diffusion Model Meets Image Harmonization9 Apr 2024
- 2024Transparent Image Layer Diffusion using Latent Transparency27 Feb 2024
- 2023Relightful Harmonization: Lighting-aware Portrait Background Replacement11 Dec 2023
38 more
- 2023Towards Enhanced Image Inpainting: Mitigating Unwanted Object Insertion and Preserving Color Consistency8 Dec 2023
- 2023Painterly Image Harmonization via Adversarial Residual Learning15 Nov 2023
- 2023Virtual Accessory Try-On via Keypoint Hallucination26 Oct 2023
- 2023Foreground Object Search by Distilling Composite Image Feature9 Aug 2023
- 2023Deep Image Harmonization in Dual Color Spaces5 Aug 2023
- 2023Painterly Image Harmonization using Diffusion Model4 Aug 2023
- 2023Deep Image Harmonization with Learnable Augmentation1 Aug 2023
- 2023Reference-based Painterly Inpainting via Diffusion: Crossing the Wild Reference Domain Gap20 Jul 2023
- 2023Image Harmonization with Diffusion Model17 Jun 2023
- 2023Realistic Saliency Guided Image Enhancement9 Jun 2023
- 2023NCHO: Unsupervised Learning for Neural 3D Composition of Humans and Objects23 May 2023
- 2023LEMaRT: Label-Efficient Masked Region Transform for Image Harmonization25 Apr 2023
- 2023Semi-supervised Parametric Real-world Image Harmonization1 Mar 2023
- 20233D-aware Blending with Generative NeRFs13 Feb 2023
- 2022Painterly Image Harmonization in Dual Domains17 Dec 2022
- 2022gCoRF: Generative Compositional Radiance Fields31 Oct 2022
- 2022Cut-Paste Consistency Learning for Semi-Supervised Lesion Segmentation1 Oct 2022
- 2022Memory-Driven Text-to-Image Generation15 Aug 2022
- 2022Semantic-guided Multi-Mask Image Harmonization24 Jul 2022
- 2022Learning Object Placement via Dual-path Graph Completion23 Jul 2022
- 2022Spatial Transformation for Image Composition via Correspondence Learning6 Jul 2022
- 2022Harmonizer: Learning to Perform White-Box Image and Video Harmonization4 Jul 2022
- 2022Image Harmonization with Region-wise Contrastive Learning27 May 2022
- 2022FRIH: Fine-grained Region-aware Image Harmonization13 May 2022
- 2022Deep Video Harmonization with Color Mapping Consistency2 May 2022
- 2022SCS-Co: Self-Consistent Style Contrastive Learning for Image Harmonization29 Apr 2022
- 2022GALA: Toward Geometry-and-Lighting-Aware Object Search for Compositing31 Mar 2022
- 2022Interactive Portrait Harmonization15 Mar 2022
- 2021SIDNet: Learning Shading-aware Illumination Descriptor for Image Harmonization2 Dec 2021
- 2021HYouTube: Video Harmonization Dataset18 Sep 2021
- 2021High-Resolution Image Harmonization via Collaborative Dual Transformations14 Sep 2021
- 2021Spatial-Separated Curve Rendering Network for Efficient and High-Resolution Image Harmonization13 Sep 2021
- 2021SSH: A Self-Supervised Framework for Image Harmonization15 Aug 2021
- 2021A Generative Adversarial Framework for Optimizing Image Matting and Harmonization Simultaneously13 Aug 2021
- 2021Making Images Real Again: A Comprehensive Survey on Deep Image Composition28 Jun 2021
- 2021Region-aware Adaptive Instance Normalization for Image Harmonization5 Jun 2021
- 2021Shadow Generation for Composite Image in Real-world Scenes21 Apr 2021
- 2021CAMPARI: Camera-Aware Decomposed Generative Neural Radiance Fields31 Mar 2021
50 newest of 52 All 52 (JSON)
- 2024Transparent Image Layer Diffusion using Latent Transparencycited by 111
- 2023Relightful Harmonization: Lighting-aware Portrait Background Replacementcited by 56
- 2023Towards Enhanced Image Inpainting: Mitigating Unwanted Object Insertion and Preserving Color Consistencycited by 19
- 2024FreeCompose: Generic Zero-Shot Image Composition with Diffusion Priorcited by 16
- 2023Painterly Image Harmonization using Diffusion Modelcited by 12
- 2025Comprehensive Relighting: Generalizable and Consistent Monocular Human Relighting and Harmonizationcited by 12
- 2025MagicQuillV2: Precise and Interactive Image Editing with Layered Visual Cuescited by 4
- 2023Image Harmonization with Diffusion Modelcited by 3
- 2024DiffHarmony: Latent Diffusion Model Meets Image Harmonizationcited by 3
- 2025MagicQuillV2: Precise and Interactive Image Editing with Layered Visual Cues2 Dec 2025
- 2025Comprehensive Relighting: Generalizable and Consistent Monocular Human Relighting and Harmonization3 Apr 2025
- 2024FreeCompose: Generic Zero-Shot Image Composition with Diffusion Prior6 Jul 2024
- 2024DiffHarmony: Latent Diffusion Model Meets Image Harmonization9 Apr 2024
- 2024Transparent Image Layer Diffusion using Latent Transparency27 Feb 2024
- 2023Relightful Harmonization: Lighting-aware Portrait Background Replacement11 Dec 2023
- 2023Towards Enhanced Image Inpainting: Mitigating Unwanted Object Insertion and Preserving Color Consistency8 Dec 2023
- 2023Painterly Image Harmonization using Diffusion Model4 Aug 2023
- 2023Image Harmonization with Diffusion Model17 Jun 2023
- 2021Region-aware Adaptive Instance Normalization for Image Harmonizationcited by 71
- 2021Making Images Real Again: A Comprehensive Survey on Deep Image Compositioncited by 63
- 2022Harmonizer: Learning to Perform White-Box Image and Video Harmonizationcited by 61
- 2021SSH: A Self-Supervised Framework for Image Harmonizationcited by 60
- 2021CAMPARI: Camera-Aware Decomposed Generative Neural Radiance Fieldscited by 55
- 2021High-Resolution Image Harmonization via Collaborative Dual Transformationscited by 55
- 2021TransFill: Reference-guided Image Inpainting by Merging Multiple Color and Spatial Transformationscited by 48
- 2021Shadow Generation for Composite Image in Real-world Scenescited by 35
- 2023Semi-supervised Parametric Real-world Image Harmonizationcited by 26
- 2021Spatial-Separated Curve Rendering Network for Efficient and High-Resolution Image Harmonizationcited by 25
- 2022SCS-Co: Self-Consistent Style Contrastive Learning for Image Harmonizationcited by 24
- 2022Learning Object Placement via Dual-path Graph Completioncited by 20
12 most cited of 43 All 43 (JSON)
- 2026BG-REAL: A Public Real-Data Anchored Benchmark for Background Manipulation Detection and Localization28 Jul 2026
- 2026Aligned Stable Inpainting: Mitigating Unwanted Object Insertion and Preserving Color Consistency21 Jan 2026
- 2025POLAR: A Portrait OLAT Dataset and Generative Framework for Illumination-Aware Face Modeling15 Dec 2025
- 2024Quality Prediction of AI Generated Images and Videos: Emerging Trends and Opportunities11 Oct 2024
- 2024Harmonizing Attention: Training-free Texture-aware Geometry Transfer19 Aug 2024
- 2024Diverse Image Harmonization22 Jul 2024
- 2023Painterly Image Harmonization via Adversarial Residual Learning15 Nov 2023
- 2023Virtual Accessory Try-On via Keypoint Hallucination26 Oct 2023
- 2023Foreground Object Search by Distilling Composite Image Feature9 Aug 2023
- 2023Deep Image Harmonization in Dual Color Spaces5 Aug 2023
- 2023Deep Image Harmonization with Learnable Augmentation1 Aug 2023
- 2023Reference-based Painterly Inpainting via Diffusion: Crossing the Wild Reference Domain Gap20 Jul 2023
12 newest of 43 All 43 (JSON)