StyleRetoucher: Generalized Portrait Image Retouching with GAN Priors
Not on the map. Why?
Abstract (arXiv)
Creating fine-retouched portrait images is tedious and time-consuming even for professional artists. There exist automatic retouching methods, but they either suffer from over-smoothing artifacts or lack generalization ability. To address such issues, we present StyleRetoucher, a novel automatic portrait image retouching framework, leveraging StyleGAN's generation and generalization ability to improve an input portrait image's skin condition while preserving its facial details. Harnessing the priors of pretrained StyleGAN, our method shows superior robustness: a). performing stably with fewer training samples and b). generalizing well on the out-domain data. Moreover, by blending the spatial features of the input image and intermediate features of the StyleGAN layers, our method preserves the input characteristics to the largest extent. We further propose a novel blemish-aware feature selection mechanism to effectively identify and remove the skin blemishes, improving the image skin condition. Qualitative and quantitative evaluations validate the great generalization capability of our method. Further experiments show StyleRetoucher's superior performance to the alternative solutions in the image retouching task. We also conduct a user perceptive study to confirm the superior retouching performance of our method over the existing state-of-the-art alternatives.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 31 of its 58 references that are in the map. First posted on arXiv 22 Dec 2023.
Builds on
31 of 58 references.
References · 31
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2022Generative Adversarial Networkscited by 5,627
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,304
- 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,179
- 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 991
- 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
- 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
- 2020GANSpace: Discovering Interpretable GAN Controlscited by 614
- 2021Designing an Encoder for StyleGAN Image Manipulationcited by 544
- 2020In-Domain GAN Inversion for Real Image Editingcited by 420
19 more
- 2020PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Modelscited by 358
- 2019Image2StyleGAN++: How to Edit the Embedded Images?cited by 356
- 2020StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flowscited by 349
- 2021Towards Real-World Blind Face Restoration with Generative Facial Priorcited by 349
- 2017Deep Bilateral Learning for Real-Time Image Enhancementcited by 200
- 2021GAN Prior Embedded Network for Blind Face Restoration in the Wildcited by 197
- 2020Learning Image-adaptive 3D Lookup Tables for High Performance Photo Enhancement in Real-timecited by 163
- 2020GLEAN: Generative Latent Bank for Large-Factor Image Super-Resolutioncited by 158
- 2019STGAN: A Unified Selective Transfer Network for Arbitrary Image Attribute Editingcited by 120
- 2020Resolution Dependent GAN Interpolation for Controllable Image Synthesis Between Domainscited by 96
- 2019Deep Exemplar-based Video Colorizationcited by 75
- 2020Conditional Sequential Modulation for Efficient Global Image Retouchingcited by 71
- 2021Real-time Image Enhancer via Learnable Spatial-aware 3D Lookup Tablescited by 65
- 2020HistoGAN: Controlling Colors of GAN-Generated and Real Images via Color Histogramscited by 64
- 2021JoJoGAN: One Shot Face Stylizationcited by 49
- 2020Joint Bilateral Learning for Real-time Universal Photorealistic Style Transfercited by 31
- 2022DrawingInStyles: Portrait Image Generation and Editing with Spatially Conditioned StyleGANcited by 18
- 2022Panini-Net: GAN Prior Based Degradation-Aware Feature Interpolation for Face Restorationcited by 12
- 2023RetouchingFFHQ: A Large-scale Dataset for Fine-grained Face Retouching Detectioncited by 5
Built on by
Citing papers per year: 2024: 1; 2025: 1; 2026: 1.
3 papers.