# 2D Image Relighting with Image-to-Image Translation

arXiv: https://arxiv.org/abs/2006.07816 · HTML: https://mlsanity.com/paper/2006.07816/

## Key facts

- Cited by 10 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 14 Jun 2020.

## Built on by (most cited first, 10 of 10)

- [NTIRE 2021 Depth Guided Image Relighting Challenge](https://mlsanity.com/paper/2104.13365/) (2021)
- [SIMBAR: Single Image-Based Scene Relighting For Effective Data Augmentation For Automated Driving Vision Tasks](https://mlsanity.com/paper/2204.00644/) (2022)
- [Relighting from a Single Image: Datasets and Deep Intrinsic-based Architecture](https://mlsanity.com/paper/2409.18770/) (2024)
- [DSRN: an Efficient Deep Network for Image Relighting](https://mlsanity.com/paper/2102.09242/) (2021)
- [SILT: Self-supervised Lighting Transfer Using Implicit Image Decomposition](https://mlsanity.com/paper/2110.12914/) (2021)
- [Physically Inspired Dense Fusion Networks for Relighting](https://mlsanity.com/paper/2105.02209/) (2021)
- [MSR-Net: Multi-Scale Relighting Network for One-to-One Relighting](https://mlsanity.com/paper/2107.06125/) (2021)
- [Designing An Illumination-Aware Network for Deep Image Relighting](https://mlsanity.com/paper/2207.10582/) (2022)
- [Local Relighting of Real Scenes](https://mlsanity.com/paper/2207.02774/) (2022)
- [SIRfyN: Single Image Relighting from your Neighbors](https://mlsanity.com/paper/2112.04497/) (2021)

## Abstract (arXiv)

With the advent of Generative Adversarial Networks (GANs), a finer level of control in manipulating various features of an image has become possible. One example of such fine manipulation is changing the position of the light source in a scene. This is fundamentally an ill-posed problem, since it requires understanding the scene geometry to generate proper lighting effects. This problem is not a trivial one and can become even more complicated if we want to change the direction of the light source from any direction to a specific one. Here we provide our attempt to solve this problem using GANs. Specifically, pix2pix [arXiv:1611.07004] trained with the dataset VIDIT [arXiv:2005.05460] which contains images of the same scene with different types of light temperature and 8 different light source positions (N, NE, E, SE, S, SW, W, NW). The results are 8 neural networks trained to be able to change the direction of the light source from any direction to one of the 8 previously mentioned. Additionally, we provide, as a tool, a simple CNN trained to identify the direction of the light source in an image.