Shadow Generation for Composite Image in Real-world Scenes
Not on the map. Why?
Abstract (arXiv)
Image composition targets at inserting a foreground object into a background image. Most previous image composition methods focus on adjusting the foreground to make it compatible with background while ignoring the shadow effect of foreground on the background. In this work, we focus on generating plausible shadow for the foreground object in the composite image. First, we contribute a real-world shadow generation dataset DESOBA by generating synthetic composite images based on paired real images and deshadowed images. Then, we propose a novel shadow generation network SGRNet, which consists of a shadow mask prediction stage and a shadow filling stage. In the shadow mask prediction stage, foreground and background information are thoroughly interacted to generate foreground shadow mask. In the shadow filling stage, shadow parameters are predicted to fill the shadow area. Extensive experiments on our DESOBA dataset and real composite images demonstrate the effectiveness of our proposed method. Our dataset and code are available at https://github.com/bcmi/Object-Shadow-Generation-Dataset-DESOBA.
Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). Builds on 32 of its 54 references that are in the map. First posted on arXiv 21 Apr 2021.
Builds on
32 of 54 references.
References · 32
- 2017Attention Is All You Needcited by 59,932
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2017Non-local Neural Networkscited by 2,290
- 2017Improved Training of Wasserstein GANscited by 2,223
- 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
- 2018Self-Attention Generative Adversarial Networkscited by 809
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2018cGANs with Projection Discriminatorcited by 253
- 2017Learning to Predict Indoor Illumination from a Single Imagecited by 160
- 2019DoveNet: Deep Image Harmonization via Domain Verificationcited by 134
- 2017Deep Image Harmonizationcited by 120
20 more
- 2019Towards Ghost-free Shadow Removal via Dual Hierarchical Aggregation Network and Shadow Matting GANcited by 102
- 2019Shadow Removal via Shadow Image Decompositioncited by 96
- 2019Mask-ShadowGAN: Learning to Remove Shadows from Unpaired Datacited by 91
- 2018ST-GAN: Spatial Transformer Generative Adversarial Networks for Image Compositingcited by 90
- 2019Deep Parametric Indoor Lighting Estimationcited by 82
- 2019Improving the Harmony of the Composite Image by Spatial-Separated Attention Modulecited by 73
- 2018Spatial Fusion GAN for Image Synthesiscited by 68
- 2017GP-GAN: Towards Realistic High-Resolution Image Blendingcited by 64
- 2019Deep Image Blendingcited by 62
- 2020From Shadow Segmentation to Shadow Removalcited by 59
- 2015Learning a Discriminative Model for the Perception of Realism in Composite Imagescited by 52
- 2020BargainNet: Background-Guided Domain Translation for Image Harmonizationcited by 52
- 2019All-Weather Deep Outdoor Lighting Estimationcited by 41
- 2019Instance Shadow Detectioncited by 37
- 2019Automatic Scene Inference for 3D Object Compositingcited by 36
- 2019RIS-GAN: Explore Residual and Illumination with Generative Adversarial Networks for Shadow Removalcited by 35
- 2018Conditional Image-to-Image Translationcited by 30
- 2020Adversarial Image Composition with Auxiliary Illuminationcited by 21
- 2020Deep Image Compositingcited by 21
- 2020Towards Realistic 3D Embedding via View Alignmentcited by 10
Built on by
Citing papers per year: 2021: 1; 2022: 6; 2023: 9; 2024: 9; 2025: 5; 2026: 5.
35 papers.
Sort:
By area:
- 2023TF-ICON: Diffusion-Based Training-Free Cross-Domain Image Compositioncited by 182
- 2024ObjectDrop: Bootstrapping Counterfactuals for Photorealistic Object Removal and Insertioncited by 71
- 2024IMPRINT: Generative Object Compositing by Learning Identity-Preserving Representationcited by 64
- 2021Making Images Real Again: A Comprehensive Survey on Deep Image Compositioncited by 63
- 2022ObjectStitch: Generative Object Compositingcited by 36
- 2023Collage Diffusioncited by 33
- 2025Does FLUX Already Know How to Perform Physically Plausible Image Composition?cited by 30
- 2023Latent Feature-Guided Diffusion Models for Shadow Removalcited by 28
- 2024Tuning-Free Image Customization with Image and Text Guidancecited by 25
- 2022Instance Shadow Detection with A Single-Stage Detectorcited by 22
- 2022Controllable Shadow Generation Using Pixel Height Mapscited by 22
- 2022Learning Object Placement via Dual-path Graph Completioncited by 20
23 more
- 2024PrimeComposer: Faster Progressively Combined Diffusion for Image Composition with Attention Steeringcited by 20
- 2023DreamCom: Finetuning Text-guided Inpainting Model for Image Compositioncited by 17
- 2024Shadow Generation for Composite Image Using Diffusion modelcited by 17
- 2024ObjectMate: A Recurrence Prior for Object Insertion and Subject-Driven Generationcited by 16
- 2023Cross-domain Compositing with Pretrained Diffusion Modelscited by 13
- 2022Fast Object Placement Assessmentcited by 12
- 2025ORIDa: Object-centric Real-world Image Composition Datasetcited by 11
- 2024Single-Image Shadow Removal Using Deep Learning: A Comprehensive Surveycited by 7
- 2023Foreground Object Search by Distilling Composite Image Featurecited by 6
- 2024Unveiling Deep Shadows: A Survey and Benchmark on Image and Video Shadow Detection, Removal, and Generation in the Deep Learning Eracited by 6
- 2024MetaShadow: Object-Centered Shadow Detection, Removal, and Synthesiscited by 5
- 2023Structure-Informed Shadow Removal Networkscited by 3
- 2023DESOBAv2: Towards Large-scale Real-world Dataset for Shadow Generationcited by 3
- 2023Animating Street Viewcited by 3
- 2022Spatial Transformation for Image Composition via Correspondence Learningcited by 2
- 2025Refracting Reality: Generating Images with Realistic Transparent Objectscited by 2
- 2025FastInstShadow: A Simple Query-Based Model for Instance Shadow Detectioncited by 0
- 2025Embedding Physical Reasoning into Diffusion-Based Shadow Generation Under the Sun and Skycited by 0
- 2026Joint Shadow Generation and Relighting via Light-Geometry Interaction Mapscited by 0
- 2026MultiShadow: Multi-Object Shadow Generation for Image Compositing via Diffusion Modelcited by 0
- 2026VSDiffusion: Taming Ill-Posed Shadow Generation via Visibility-Constrained Diffusioncited by 0
- 2026Revisiting Shadow Detection from a Vision-Language Perspectivecited by 0
- 2026Hybrid Generative-Discriminative Object Placementcited by 0
- 2026Hybrid Generative-Discriminative Object Placement24 Aug 2026
- 2026Revisiting Shadow Detection from a Vision-Language Perspective12 May 2026
- 2026VSDiffusion: Taming Ill-Posed Shadow Generation via Visibility-Constrained Diffusion9 Mar 2026
- 2026MultiShadow: Multi-Object Shadow Generation for Image Compositing via Diffusion Model3 Mar 2026
- 2026Joint Shadow Generation and Relighting via Light-Geometry Interaction Maps25 Feb 2026
- 2025Embedding Physical Reasoning into Diffusion-Based Shadow Generation Under the Sun and Sky5 Dec 2025
- 2025Refracting Reality: Generating Images with Realistic Transparent Objects21 Nov 2025
- 2025Does FLUX Already Know How to Perform Physically Plausible Image Composition?25 Sep 2025
- 2025ORIDa: Object-centric Real-world Image Composition Dataset10 Jun 2025
- 2025FastInstShadow: A Simple Query-Based Model for Instance Shadow Detection10 Mar 2025
- 2024ObjectMate: A Recurrence Prior for Object Insertion and Subject-Driven Generation11 Dec 2024
- 2024MetaShadow: Object-Centered Shadow Detection, Removal, and Synthesis3 Dec 2024
23 more
- 2024Unveiling Deep Shadows: A Survey and Benchmark on Image and Video Shadow Detection, Removal, and Generation in the Deep Learning Era3 Sep 2024
- 2024Single-Image Shadow Removal Using Deep Learning: A Comprehensive Survey11 Jul 2024
- 2024ObjectDrop: Bootstrapping Counterfactuals for Photorealistic Object Removal and Insertion27 Mar 2024
- 2024Shadow Generation for Composite Image Using Diffusion model22 Mar 2024
- 2024Tuning-Free Image Customization with Image and Text Guidance19 Mar 2024
- 2024IMPRINT: Generative Object Compositing by Learning Identity-Preserving Representation15 Mar 2024
- 2024PrimeComposer: Faster Progressively Combined Diffusion for Image Composition with Attention Steering8 Mar 2024
- 2023Latent Feature-Guided Diffusion Models for Shadow Removal4 Dec 2023
- 2023Animating Street View12 Oct 2023
- 2023DreamCom: Finetuning Text-guided Inpainting Model for Image Composition27 Sep 2023
- 2023DESOBAv2: Towards Large-scale Real-world Dataset for Shadow Generation19 Aug 2023
- 2023Foreground Object Search by Distilling Composite Image Feature9 Aug 2023
- 2023TF-ICON: Diffusion-Based Training-Free Cross-Domain Image Composition24 Jul 2023
- 2023Collage Diffusion1 Mar 2023
- 2023Cross-domain Compositing with Pretrained Diffusion Models20 Feb 2023
- 2023Structure-Informed Shadow Removal Networks9 Jan 2023
- 2022ObjectStitch: Generative Object Compositing2 Dec 2022
- 2022Learning Object Placement via Dual-path Graph Completion23 Jul 2022
- 2022Controllable Shadow Generation Using Pixel Height Maps12 Jul 2022
- 2022Instance Shadow Detection with A Single-Stage Detector11 Jul 2022
- 2022Spatial Transformation for Image Composition via Correspondence Learning6 Jul 2022
- 2022Fast Object Placement Assessment28 May 2022
- 2021Making Images Real Again: A Comprehensive Survey on Deep Image Composition28 Jun 2021
- 2023TF-ICON: Diffusion-Based Training-Free Cross-Domain Image Compositioncited by 182
- 2024ObjectDrop: Bootstrapping Counterfactuals for Photorealistic Object Removal and Insertioncited by 71
- 2023Collage Diffusioncited by 33
- 2023Latent Feature-Guided Diffusion Models for Shadow Removalcited by 28
- 2024Tuning-Free Image Customization with Image and Text Guidancecited by 25
- 2024Shadow Generation for Composite Image Using Diffusion modelcited by 17
- 2023Cross-domain Compositing with Pretrained Diffusion Modelscited by 13
- 2026MultiShadow: Multi-Object Shadow Generation for Image Compositing via Diffusion Modelcited by 0
- 2026MultiShadow: Multi-Object Shadow Generation for Image Compositing via Diffusion Model3 Mar 2026
- 2024ObjectDrop: Bootstrapping Counterfactuals for Photorealistic Object Removal and Insertion27 Mar 2024
- 2024Shadow Generation for Composite Image Using Diffusion model22 Mar 2024
- 2024Tuning-Free Image Customization with Image and Text Guidance19 Mar 2024
- 2023Latent Feature-Guided Diffusion Models for Shadow Removal4 Dec 2023
- 2023TF-ICON: Diffusion-Based Training-Free Cross-Domain Image Composition24 Jul 2023
- 2023Collage Diffusion1 Mar 2023
- 2023Cross-domain Compositing with Pretrained Diffusion Models20 Feb 2023
- 2024IMPRINT: Generative Object Compositing by Learning Identity-Preserving Representationcited by 64
- 2021Making Images Real Again: A Comprehensive Survey on Deep Image Compositioncited by 63
- 2022ObjectStitch: Generative Object Compositingcited by 36
- 2025Does FLUX Already Know How to Perform Physically Plausible Image Composition?cited by 30
- 2022Instance Shadow Detection with A Single-Stage Detectorcited by 22
- 2022Controllable Shadow Generation Using Pixel Height Mapscited by 22
- 2022Learning Object Placement via Dual-path Graph Completioncited by 20
- 2024PrimeComposer: Faster Progressively Combined Diffusion for Image Composition with Attention Steeringcited by 20
- 2023DreamCom: Finetuning Text-guided Inpainting Model for Image Compositioncited by 17
- 2024ObjectMate: A Recurrence Prior for Object Insertion and Subject-Driven Generationcited by 16
- 2022Fast Object Placement Assessmentcited by 12
- 2025ORIDa: Object-centric Real-world Image Composition Datasetcited by 11
12 most cited of 27 All 27 (JSON)
- 2026Hybrid Generative-Discriminative Object Placement24 Aug 2026
- 2026Revisiting Shadow Detection from a Vision-Language Perspective12 May 2026
- 2026VSDiffusion: Taming Ill-Posed Shadow Generation via Visibility-Constrained Diffusion9 Mar 2026
- 2026Joint Shadow Generation and Relighting via Light-Geometry Interaction Maps25 Feb 2026
- 2025Embedding Physical Reasoning into Diffusion-Based Shadow Generation Under the Sun and Sky5 Dec 2025
- 2025Refracting Reality: Generating Images with Realistic Transparent Objects21 Nov 2025
- 2025Does FLUX Already Know How to Perform Physically Plausible Image Composition?25 Sep 2025
- 2025ORIDa: Object-centric Real-world Image Composition Dataset10 Jun 2025
- 2025FastInstShadow: A Simple Query-Based Model for Instance Shadow Detection10 Mar 2025
- 2024ObjectMate: A Recurrence Prior for Object Insertion and Subject-Driven Generation11 Dec 2024
- 2024MetaShadow: Object-Centered Shadow Detection, Removal, and Synthesis3 Dec 2024
- 2024Unveiling Deep Shadows: A Survey and Benchmark on Image and Video Shadow Detection, Removal, and Generation in the Deep Learning Era3 Sep 2024
12 newest of 27 All 27 (JSON)