# NTIRE 2021 Depth Guided Image Relighting Challenge arXiv: https://arxiv.org/abs/2104.13365 ยท HTML: https://mlsanity.com/paper/2104.13365/ ## Key facts - Cited by 23 papers in the map (data through 14 Oct 2026). - Builds on 24 of its 59 references that are in the map. - First posted on arXiv 27 Apr 2021. ## Builds on (most cited first, 24 of 24) - [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015) - [The Unreasonable Effectiveness of Deep Features as a Perceptual Metric](https://mlsanity.com/paper/1801.03924/) (2018) - [Densely Connected Convolutional Networks](https://mlsanity.com/paper/1608.06993/) (2016) - [Perceptual Losses for Real-Time Style Transfer and Super-Resolution](https://mlsanity.com/paper/1603.08155/) (2016) - [ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design](https://mlsanity.com/paper/1807.11164/) (2018) - [Res2Net: A New Multi-scale Backbone Architecture](https://mlsanity.com/paper/1904.01169/) (2019) - [A General and Adaptive Robust Loss Function](https://mlsanity.com/paper/1701.03077/) (2017) - [Spatially-Attentive Patch-Hierarchical Network for Adaptive Motion Deblurring](https://mlsanity.com/paper/2004.05343/) (2020) - [Replacing Mobile Camera ISP with a Single Deep Learning Model](https://mlsanity.com/paper/2002.05509/) (2020) - [Hierarchical Dynamic Filtering Network for RGB-D Salient Object Detection](https://mlsanity.com/paper/2007.06227/) (2020) - [Progressively Guided Alternate Refinement Network for RGB-D Salient Object Detection](https://mlsanity.com/paper/2008.07064/) (2020) - [Blind Universal Bayesian Image Denoising with Gaussian Noise Level Learning](https://mlsanity.com/paper/1907.03029/) (2019) - [Hierarchical Regression Network for Spectral Reconstruction from RGB Images](https://mlsanity.com/paper/2005.04703/) (2020) - [VIDIT: Virtual Image Dataset for Illumination Transfer](https://mlsanity.com/paper/2005.05460/) (2020) - [NTIRE 2021 Challenge on Quality Enhancement of Compressed Video: Methods and Results](https://mlsanity.com/paper/2104.10781/) (2021) - [Stochastic Frequency Masking to Improve Super-Resolution and Denoising Networks](https://mlsanity.com/paper/2003.07119/) (2020) - [AIM 2020: Scene Relighting and Illumination Estimation Challenge](https://mlsanity.com/paper/2009.12798/) (2020) - [Y-net: Multi-scale feature aggregation network with wavelet structure similarity loss function for single image dehazing](https://mlsanity.com/paper/2003.13912/) (2020) - [WDRN : A Wavelet Decomposed RelightNet for Image Relighting](https://mlsanity.com/paper/2009.06678/) (2020) - [Deep Relighting Networks for Image Light Source Manipulation](https://mlsanity.com/paper/2008.08298/) (2020) - [2D Image Relighting with Image-to-Image Translation](https://mlsanity.com/paper/2006.07816/) (2020) - [DSRN: an Efficient Deep Network for Image Relighting](https://mlsanity.com/paper/2102.09242/) (2021) - [Multi-scale Self-calibrated Network for Image Light Source Transfer](https://mlsanity.com/paper/2104.08838/) (2021) - [Scene relighting with illumination estimation in the latent space on an encoder-decoder scheme](https://mlsanity.com/paper/2006.02333/) (2020) ## Built on by (most cited first, 23 of 23) - [NTIRE 2021 Challenge on Image Deblurring](https://mlsanity.com/paper/2104.14854/) (2021) - [NTIRE 2021 Challenge on High Dynamic Range Imaging: Dataset, Methods and Results](https://mlsanity.com/paper/2106.01439/) (2021) - [NTIRE 2021 Challenge on Burst Super-Resolution: Methods and Results](https://mlsanity.com/paper/2106.03839/) (2021) - [NTIRE 2021 Challenge on Perceptual Image Quality Assessment](https://mlsanity.com/paper/2105.03072/) (2021) - [NTIRE 2021 Challenge on Video Super-Resolution](https://mlsanity.com/paper/2104.14852/) (2021) - [S3Net: A Single Stream Structure for Depth Guided Image Relighting](https://mlsanity.com/paper/2105.00681/) (2021) - [NTIRE 2021 Multi-modal Aerial View Object Classification Challenge](https://mlsanity.com/paper/2107.01189/) (2021) - [Multi-modal Bifurcated Network for Depth Guided Image Relighting](https://mlsanity.com/paper/2105.00690/) (2021) - [Exposure Correction Model to Enhance Image Quality](https://mlsanity.com/paper/2204.10648/) (2022) - [Relighting from a Single Image: Datasets and Deep Intrinsic-based Architecture](https://mlsanity.com/paper/2409.18770/) (2024) - [SILT: Self-supervised Lighting Transfer Using Implicit Image Decomposition](https://mlsanity.com/paper/2110.12914/) (2021) - [Computational Flash Photography through Intrinsics](https://mlsanity.com/paper/2306.06089/) (2023) - [Physically Inspired Dense Fusion Networks for Relighting](https://mlsanity.com/paper/2105.02209/) (2021) - [Designing An Illumination-Aware Network for Deep Image Relighting](https://mlsanity.com/paper/2207.10582/) (2022) - [Spectral Sensitivity Estimation Without a Camera](https://mlsanity.com/paper/2304.11549/) (2023) - [Local Relighting of Real Scenes](https://mlsanity.com/paper/2207.02774/) (2022) - [SIRfyN: Single Image Relighting from your Neighbors](https://mlsanity.com/paper/2112.04497/) (2021) - [MLI-NeRF: Multi-Light Intrinsic-Aware Neural Radiance Fields](https://mlsanity.com/paper/2411.17235/) (2024) - [Maturity-Aware Active Learning for Semantic Segmentation with Hierarchically-Adaptive Sample Assessment](https://mlsanity.com/paper/2308.14904/) (2023) - [Learning Relighting and Intrinsic Decomposition in Neural Radiance Fields](https://mlsanity.com/paper/2406.11077/) (2024) - [RehearsalNeRF: Decoupling Intrinsic Neural Fields of Dynamic Illuminations for Scene Editing](https://mlsanity.com/paper/2603.27948/) (2026) - [Hidden-Shot: Towards One-Shot Task Generalization for Low-Level Vision Generalist Models](https://mlsanity.com/paper/2607.01535/) (2026) - [Monocular Depth Estimation from a Single Image: Progress and Opportunities](https://mlsanity.com/paper/2609.01172/) (2026) ## Abstract (arXiv) Image relighting is attracting increasing interest due to its various applications. From a research perspective, image relighting can be exploited to conduct both image normalization for domain adaptation, and also for data augmentation. It also has multiple direct uses for photo montage and aesthetic enhancement. In this paper, we review the NTIRE 2021 depth guided image relighting challenge. We rely on the VIDIT dataset for each of our two challenge tracks, including depth information. The first track is on one-to-one relighting where the goal is to transform the illumination setup of an input image (color temperature and light source position) to the target illumination setup. In the second track, the any-to-any relighting challenge, the objective is to transform the illumination settings of the input image to match those of another guide image, similar to style transfer. In both tracks, participants were given depth information about the captured scenes. We had nearly 250 registered participants, leading to 18 confirmed team submissions in the final competition stage. The competitions, methods, and final results are presented in this paper.