Photorealistic Facial Wrinkles Removal
Not on the map. Why?
Abstract (arXiv)
Editing and retouching facial attributes is a complex task that usually requires human artists to obtain photo-realistic results. Its applications are numerous and can be found in several contexts such as cosmetics or digital media retouching, to name a few. Recently, advancements in conditional generative modeling have shown astonishing results at modifying facial attributes in a realistic manner. However, current methods are still prone to artifacts, and focus on modifying global attributes like age and gender, or local mid-sized attributes like glasses or moustaches. In this work, we revisit a two-stage approach for retouching facial wrinkles and obtain results with unprecedented realism. First, a state of the art wrinkle segmentation network is used to detect the wrinkles within the facial region. Then, an inpainting module is used to remove the detected wrinkles, filling them in with a texture that is statistically consistent with the surrounding skin. To achieve this, we introduce a novel loss term that reuses the wrinkle segmentation network to penalize those regions that still contain wrinkles after the inpainting. We evaluate our method qualitatively and quantitatively, showing state of the art results for the task of wrinkle removal. Moreover, we introduce the first high-resolution dataset, named FFHQ-Wrinkles, to evaluate wrinkle detection methods.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 28 of its 43 references that are in the map. First posted on arXiv 3 Nov 2022.
Builds on
28 of 43 references.
References · 28
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2022Generative Adversarial Networkscited by 5,627
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
- 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,546
- 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,161
- 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,179
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
16 more
- 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 639
- 2019UNet++: Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentationcited by 586
- 2018Albumentations: fast and flexible image augmentationscited by 560
- 2019Image2StyleGAN++: How to Edit the Embedded Images?cited by 356
- 2017AttGAN: Facial Attribute Editing by Only Changing What You Wantcited by 242
- 2017Improving the Adversarial Robustness and Interpretability of Deep Neural Networks by Regularizing their Input Gradientscited by 236
- 2020Focal Frequency Loss for Image Reconstruction and Synthesiscited by 206
- 2019STGAN: A Unified Selective Transfer Network for Arbitrary Image Attribute Editingcited by 120
- 2017Fader Networks: Manipulating Images by Sliding Attributescited by 118
- 2021Only a Matter of Style: Age Transformation Using a Style-Based Regression Modelcited by 92
- 2020Lifespan Age Transformation Synthesiscited by 60
- 2019RelGAN: Multi-Domain Image-to-Image Translation via Relative Attributescited by 56
- 2020Guidance and Evaluation: Semantic-Aware Image Inpainting for Mixed Scenescited by 43
- 2020Learning to Incorporate Structure Knowledge for Image Inpaintingcited by 37
- 2020Image Inpainting Guided by Coherence Priors of Semantics and Texturescited by 37
- 2022GLaMa: Joint Spatial and Frequency Loss for General Image Inpaintingcited by 15
Built on by
Citing papers per year: 2023: 1.
1 paper.