Shadow Removal via Shadow Image Decomposition
Not on the map. Why?
Abstract (arXiv)
We propose a novel deep learning method for shadow removal. Inspired by physical models of shadow formation, we use a linear illumination transformation to model the shadow effects in the image that allows the shadow image to be expressed as a combination of the shadow-free image, the shadow parameters, and a matte layer. We use two deep networks, namely SP-Net and M-Net, to predict the shadow parameters and the shadow matte respectively. This system allows us to remove the shadow effects on the images. We train and test our framework on the most challenging shadow removal dataset (ISTD). Compared to the state-of-the-art method, our model achieves a 40% error reduction in terms of root mean square error (RMSE) for the shadow area, reducing RMSE from 13.3 to 7.9. Moreover, we create an augmented ISTD dataset based on an image decomposition system by modifying the shadow parameters to generate new synthetic shadow images. Training our model on this new augmented ISTD dataset further lowers the RMSE on the shadow area to 7.4.
Key facts. Cited by 98 papers in the map (data through 14 Oct 2026). First posted on arXiv 23 Aug 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 12; 2022: 12; 2023: 16; 2024: 29; 2025: 14; 2026: 15.
98 papers.
Sort:
By area:
- 2023Diffusion Models for Image Restoration and Enhancement: A Comprehensive Surveycited by 109
- 2022ShadowDiffusion: When Degradation Prior Meets Diffusion Model for Shadow Removalcited by 103
- 2023Embedding Fourier for Ultra-High-Definition Low-Light Image Enhancementcited by 86
- 2021Auto-Exposure Fusion for Single-Image Shadow Removalcited by 79
- 2024ObjectDrop: Bootstrapping Counterfactuals for Photorealistic Object Removal and Insertioncited by 71
- 2022DC-ShadowNet: Single-Image Hard and Soft Shadow Removal Using Unsupervised Domain-Classifier Guided Networkcited by 69
- 2023Residual Denoising Diffusion Modelscited by 69
- 2021From Shadow Generation to Shadow Removalcited by 55
- 2021CANet: A Context-Aware Network for Shadow Removalcited by 47
- 2022Generating Representative Samples for Few-Shot Classificationcited by 39
- 2022DeS3: Adaptive Attention-driven Self and Soft Shadow Removal using ViT Similaritycited by 38
- 2021Shadow Generation for Composite Image in Real-world Scenescited by 35
38 more
- 2023ShadowFormer: Global Context Helps Image Shadow Removalcited by 35
- 2023Latent Feature-Guided Diffusion Models for Shadow Removalcited by 29
- 2021Learning from Synthetic Shadows for Shadow Detection and Removalcited by 27
- 2023Leveraging Inpainting for Single-Image Shadow Removalcited by 25
- 2024Recasting Regional Lighting for Shadow Removalcited by 23
- 2022Instance Shadow Detection with A Single-Stage Detectorcited by 22
- 2024ShadowRefiner: Towards Mask-free Shadow Removal via Fast Fourier Transformercited by 20
- 2023Resfusion: Denoising Diffusion Probabilistic Models for Image Restoration Based on Prior Residual Noisecited by 19
- 2024OmniSR: Shadow Removal under Direct and Indirect Lightingcited by 19
- 2021Blind Image Decompositioncited by 18
- 2021Unsupervised Portrait Shadow Removal via Generative Priorscited by 16
- 2024Detail-Preserving Latent Diffusion for Stable Shadow Removalcited by 13
- 2024Taming Diffusion Models for Image Restoration: A Reviewcited by 12
- 2024Regional Attention for Shadow Removalcited by 12
- 2022Shadow-Aware Dynamic Convolution for Shadow Removalcited by 11
- 2023SDDNet: Style-guided Dual-layer Disentanglement Network for Shadow Detectioncited by 11
- 2024Benchmarking Adversarial Robustness of Image Shadow Removal with Shadow-adaptive Attackscited by 10
- 2024Diff-Shadow: Global-guided Diffusion Model for Shadow Removalcited by 10
- 2021Fine-Context Shadow Detection using Shadow Removalcited by 9
- 2024Towards Image Ambient Lighting Normalizationcited by 9
- 2022CRFormer: A Cross-Region Transformer for Shadow Removalcited by 8
- 2023Memory augment is All You Need for image restorationcited by 8
- 2022SpA-Former: Transformer image shadow detection and removal via spatial attentioncited by 7
- 2024ShadowMaskFormer: Mask Augmented Patch Embeddings for Shadow Removalcited by 7
- 2024Single-Image Shadow Removal Using Deep Learning: A Comprehensive Surveycited by 7
- 2024Unveiling Deep Shadows: A Survey and Benchmark on Image and Video Shadow Detection, Removal, and Generation in the Deep Learning Eracited by 7
- 2021Repopulating Street Scenescited by 6
- 2023SAM-helps-Shadow:When Segment Anything Model meet shadow removalcited by 6
- 2024S3R-Net: A Single-Stage Approach to Self-Supervised Shadow Removalcited by 6
- 2021Temporal Feature Warping for Video Shadow Detectioncited by 5
- 2022CNSNet: A Cleanness-Navigated-Shadow Network for Shadow Removalcited by 5
- 2023LP-IOANet: Efficient High Resolution Document Shadow Removalcited by 5
- 2024Shadow Removal Refinement via Material-Consistent Shadow Edgescited by 5
- 2024MetaShadow: Object-Centered Shadow Detection, Removal, and Synthesiscited by 5
- 2025DenseSR: Image Shadow Removal as Dense Predictioncited by 5
- 2025UniSER: A Foundation Model for Unified Soft Effects Removalcited by 5
- 2024FieldNet: Efficient Real-Time Shadow Removal for Enhanced Vision in Field Roboticscited by 4
- 2024SoftShadow: Leveraging Soft Masks for Penumbra-Aware Shadow Removalcited by 4
50 most cited of 98 All 98 (JSON)
- 2026OccludeBench: Can VLMs Find What's Missing?9 Oct 2026
- 2026Shadow Feature Refinement Network: Progressive Feature Refinement based on Knowledge Distillation for Effective Shadow Removal4 Oct 2026
- 2026ODDR: One-Step Deshadow Diffusion via Reward Guidance1 Oct 2026
- 2026After a Decade: Bringing Shadow Removal into the Real World with Agentic Training Data29 Sep 2026
- 2026Consistency as Regularization for Unsupervised Shadow Removal1 Sep 2026
- 2026Domain-Grounded Candidate Selection for Agentic Image Editing: A Shadow Removal Case6 Aug 2026
- 2026FreeShadow: Training-Free Shadow Removal via Illumination Transfer and Selective Content Preservation in Diffusion Models29 Jul 2026
- 2026WildShadowRemover: In-the-Wild Video Shadow Removal via Detail-Preserving Video Diffusion Models28 Jul 2026
- 2026CFSR: Geometry-Conditioned Shadow Removal via Physical Disentanglement20 Apr 2026
- 2026Winner of CVPR2026 NTIRE Challenge on Image Shadow Removal: Semantic and Geometric Guidance for Shadow Removal via Cascaded Refinement17 Apr 2026
- 2026OmniLight: One Model to Rule All Lighting Conditions16 Apr 2026
- 2026UniBlendNet: Unified Global, Multi-Scale, and Region-Adaptive Modeling for Ambient Lighting Normalization15 Apr 2026
38 more
- 2026CANDLE: Illumination-Invariant Semantic Priors for Color Ambient Lighting Normalization3 Apr 2026
- 2026DINOLight: Robust Ambient Light Normalization with Self-supervised Visual Prior Integration13 Mar 2026
- 2026PhaSR: Generalized Image Shadow Removal with Physically Aligned Priors24 Jan 2026
- 2025Cast and Attached Shadow Detection via Iterative Light and Geometry Reasoning5 Dec 2025
- 2025Embedding Physical Reasoning into Diffusion-Based Shadow Generation Under the Sun and Sky5 Dec 2025
- 2025UniSER: A Foundation Model for Unified Soft Effects Removal18 Nov 2025
- 2025DeshadowMamba: Deshadowing as 1D Sequential Similarity28 Oct 2025
- 2025D2-Mamba: Dual-Scale Fusion and Dual-Path Scanning with SSMs for Shadow Removal18 Aug 2025
- 2025Contrast-Prior Enhanced Duality for Mask-Free Shadow Removal29 Jul 2025
- 2025DenseSR: Image Shadow Removal as Dense Prediction22 Jul 2025
- 2025Structure-Guided Diffusion Models for High-Fidelity Portrait Shadow Removal7 Jul 2025
- 2025DocShaDiffusion: Diffusion Model in Latent Space for Document Image Shadow Removal2 Jul 2025
- 2025NTIRE 2025 Image Shadow Removal Challenge Report18 Jun 2025
- 2025Image Restoration via Multi-domain Learning7 May 2025
- 2025Shadow Erosion and Nighttime Adaptability for Camera-Based Automated Driving Applications11 Apr 2025
- 2025FASR-Net: Unsupervised Shadow Removal Leveraging Inherent Frequency Priors8 Apr 2025
- 2025Prompt-Aware Controllable Shadow Removal25 Jan 2025
- 2024Detail-Preserving Latent Diffusion for Stable Shadow Removal23 Dec 2024
- 2024MetaShadow: Object-Centered Shadow Detection, Removal, and Synthesis3 Dec 2024
- 2024ShadowHack: Hacking Shadows via Luminance-Color Divide and Conquer3 Dec 2024
- 2024Controlling the Latent Diffusion Model for Generative Image Shadow Removal via Residual Generation3 Dec 2024
- 2024Regional Attention for Shadow Removal21 Nov 2024
- 2024ShadowMamba: State-Space Model with Boundary-Region Selective Scan for Shadow Removal5 Nov 2024
- 2024OmniSR: Shadow Removal under Direct and Indirect Lighting2 Oct 2024
- 2024A Feature Generator for Few-Shot Learning21 Sep 2024
- 2024Taming Diffusion Models for Image Restoration: A Review16 Sep 2024
- 2024SoftShadow: Leveraging Soft Masks for Penumbra-Aware Shadow Removal11 Sep 2024
- 2024Shadow Removal Refinement via Material-Consistent Shadow Edges10 Sep 2024
- 2024ArtiFade: Learning to Generate High-quality Subject from Blemished Images5 Sep 2024
- 2024Unveiling Deep Shadows: A Survey and Benchmark on Image and Video Shadow Detection, Removal, and Generation in the Deep Learning Era3 Sep 2024
- 2024Soft-Hard Attention U-Net Model and Benchmark Dataset for Multiscale Image Shadow Removal7 Aug 2024
- 2024Diff-Shadow: Global-guided Diffusion Model for Shadow Removal23 Jul 2024
- 2024Single-Image Shadow Removal Using Deep Learning: A Comprehensive Survey11 Jul 2024
- 2024Semantic-guided Adversarial Diffusion Model for Self-supervised Shadow Removal1 Jul 2024
- 2024Cross-Modal Spherical Aggregation for Weakly Supervised Remote Sensing Shadow Removal25 Jun 2024
- 2024ShadowMaskFormer: Mask Augmented Patch Embeddings for Shadow Removal29 Apr 2024
- 2024ShadowRefiner: Towards Mask-free Shadow Removal via Fast Fourier Transformer18 Apr 2024
- 2024S3R-Net: A Single-Stage Approach to Self-Supervised Shadow Removal18 Apr 2024
50 newest of 98 All 98 (JSON)
- 2023Diffusion Models for Image Restoration and Enhancement: A Comprehensive Surveycited by 109
- 2022ShadowDiffusion: When Degradation Prior Meets Diffusion Model for Shadow Removalcited by 103
- 2024ObjectDrop: Bootstrapping Counterfactuals for Photorealistic Object Removal and Insertioncited by 71
- 2023Residual Denoising Diffusion Modelscited by 69
- 2023Latent Feature-Guided Diffusion Models for Shadow Removalcited by 29
- 2023Resfusion: Denoising Diffusion Probabilistic Models for Image Restoration Based on Prior Residual Noisecited by 19
- 2024Detail-Preserving Latent Diffusion for Stable Shadow Removalcited by 13
- 2024Taming Diffusion Models for Image Restoration: A Reviewcited by 12
- 2024Diff-Shadow: Global-guided Diffusion Model for Shadow Removalcited by 10
- 2024Semantic-guided Adversarial Diffusion Model for Self-supervised Shadow Removalcited by 3
- 2023Deshadow-Anything: When Segment Anything Model Meets Zero-shot shadow removalcited by 2
- 2023Detail Reinforcement Diffusion Model: Augmentation Fine-Grained Visual Categorization in Few-Shot Conditionscited by 1
12 most cited of 17 All 17 (JSON)
- 2026FreeShadow: Training-Free Shadow Removal via Illumination Transfer and Selective Content Preservation in Diffusion Models29 Jul 2026
- 2026WildShadowRemover: In-the-Wild Video Shadow Removal via Detail-Preserving Video Diffusion Models28 Jul 2026
- 2025Structure-Guided Diffusion Models for High-Fidelity Portrait Shadow Removal7 Jul 2025
- 2025DocShaDiffusion: Diffusion Model in Latent Space for Document Image Shadow Removal2 Jul 2025
- 2024Detail-Preserving Latent Diffusion for Stable Shadow Removal23 Dec 2024
- 2024Controlling the Latent Diffusion Model for Generative Image Shadow Removal via Residual Generation3 Dec 2024
- 2024Taming Diffusion Models for Image Restoration: A Review16 Sep 2024
- 2024Diff-Shadow: Global-guided Diffusion Model for Shadow Removal23 Jul 2024
- 2024Semantic-guided Adversarial Diffusion Model for Self-supervised Shadow Removal1 Jul 2024
- 2024ObjectDrop: Bootstrapping Counterfactuals for Photorealistic Object Removal and Insertion27 Mar 2024
- 2023Latent Feature-Guided Diffusion Models for Shadow Removal4 Dec 2023
- 2023Resfusion: Denoising Diffusion Probabilistic Models for Image Restoration Based on Prior Residual Noise25 Nov 2023
12 newest of 17 All 17 (JSON)
- 2023Embedding Fourier for Ultra-High-Definition Low-Light Image Enhancementcited by 86
- 2021Auto-Exposure Fusion for Single-Image Shadow Removalcited by 79
- 2022DC-ShadowNet: Single-Image Hard and Soft Shadow Removal Using Unsupervised Domain-Classifier Guided Networkcited by 69
- 2021From Shadow Generation to Shadow Removalcited by 55
- 2021CANet: A Context-Aware Network for Shadow Removalcited by 47
- 2022Generating Representative Samples for Few-Shot Classificationcited by 39
- 2022DeS3: Adaptive Attention-driven Self and Soft Shadow Removal using ViT Similaritycited by 38
- 2021Shadow Generation for Composite Image in Real-world Scenescited by 35
- 2023ShadowFormer: Global Context Helps Image Shadow Removalcited by 35
- 2021Learning from Synthetic Shadows for Shadow Detection and Removalcited by 27
- 2023Leveraging Inpainting for Single-Image Shadow Removalcited by 25
- 2024Recasting Regional Lighting for Shadow Removalcited by 23
12 most cited of 75 All 75 (JSON)
- 2026ODDR: One-Step Deshadow Diffusion via Reward Guidance1 Oct 2026
- 2026After a Decade: Bringing Shadow Removal into the Real World with Agentic Training Data29 Sep 2026
- 2026Consistency as Regularization for Unsupervised Shadow Removal1 Sep 2026
- 2026CFSR: Geometry-Conditioned Shadow Removal via Physical Disentanglement20 Apr 2026
- 2026Winner of CVPR2026 NTIRE Challenge on Image Shadow Removal: Semantic and Geometric Guidance for Shadow Removal via Cascaded Refinement17 Apr 2026
- 2026OmniLight: One Model to Rule All Lighting Conditions16 Apr 2026
- 2026UniBlendNet: Unified Global, Multi-Scale, and Region-Adaptive Modeling for Ambient Lighting Normalization15 Apr 2026
- 2026CANDLE: Illumination-Invariant Semantic Priors for Color Ambient Lighting Normalization3 Apr 2026
- 2026DINOLight: Robust Ambient Light Normalization with Self-supervised Visual Prior Integration13 Mar 2026
- 2026PhaSR: Generalized Image Shadow Removal with Physically Aligned Priors24 Jan 2026
- 2025Cast and Attached Shadow Detection via Iterative Light and Geometry Reasoning5 Dec 2025
- 2025Embedding Physical Reasoning into Diffusion-Based Shadow Generation Under the Sun and Sky5 Dec 2025
12 newest of 75 All 75 (JSON)