Intrinsic Image Transfer for Illumination Manipulation
Not on the map. Why?
Abstract (arXiv)
This paper presents a novel intrinsic image transfer (IIT) algorithm for illumination manipulation, which creates a local image translation between two illumination surfaces. This model is built on an optimization-based framework consisting of three photo-realistic losses defined on the sub-layers factorized by an intrinsic image decomposition. We illustrate that all losses can be reduced without the necessity of taking an intrinsic image decomposition under the well-known spatial-varying illumination illumination-invariant reflectance prior knowledge. Moreover, with a series of relaxations, all of them can be directly defined on images, giving a closed-form solution for image illumination manipulation. This new paradigm differs from the prevailing Retinex-based algorithms, as it provides an implicit way to deal with the per-pixel image illumination. We finally demonstrate its versatility and benefits to the illumination-related tasks such as illumination compensation, image enhancement, and high dynamic range (HDR) image compression, and show the high-quality results on natural image datasets.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 23 of its 76 references that are in the map. First posted on arXiv 1 Jul 2021.
Builds on
23 of 76 references.
References · 23
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2018Deep Retinex Decomposition for Low-Light Enhancementcited by 720
- 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
- 2020Zero-Reference Deep Curve Estimation for Low-Light Image Enhancementcited by 541
- 2019EnlightenGAN: Deep Light Enhancement without Paired Supervisioncited by 466
- 2018Learning to See in the Darkcited by 459
- 2017NIMA: Neural Image Assessmentcited by 387
- 2017Universal Style Transfer via Feature Transformscited by 352
- 2017Neural Style Transfer: A Reviewcited by 199
- 2019Photorealistic Style Transfer via Wavelet Transformscited by 166
- 2017Learning to Predict Indoor Illumination from a Single Imagecited by 160
11 more
- 2017DSLR-Quality Photos on Mobile Devices with Deep Convolutional Networkscited by 156
- 2018Learning Intrinsic Image Decomposition from Watching the Worldcited by 74
- 2016Deep Outdoor Illumination Estimationcited by 53
- 2017Self-Supervised Intrinsic Image Decompositioncited by 43
- 2019A Closed-form Solution to Universal Style Transfercited by 42
- 2018LIME: Live Intrinsic Material Estimationcited by 33
- 2015Direct Intrinsics: Learning Albedo-Shading Decomposition by Convolutional Regressioncited by 32
- 2017WESPE: Weakly Supervised Photo Enhancer for Digital Camerascited by 32
- 2018Intrinsic Image Transformation via Scale Space Decompositioncited by 10
- 2016Radiometric Scene Decomposition: Scene Reflectance, Illumination, and Geometry from RGB-D Imagescited by 7
- 2018Multispectral Image Intrinsic Decomposition via Low Rank Constraintcited by 1
Built on by
Citing papers per year: 2023: 1.
1 paper.
- 2023Optimal Image Transport on Sparse Dictionariescited by 1
- 2023Optimal Image Transport on Sparse Dictionaries3 Nov 2023