ShapeEditer: a StyleGAN Encoder for Face Swapping
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose a novel encoder, called ShapeEditor, for high-resolution, realistic and high-fidelity face exchange. First of all, in order to ensure sufficient clarity and authenticity, our key idea is to use an advanced pretrained high-quality random face image generator, i.e. StyleGAN, as backbone. Secondly, we design ShapeEditor, a two-step encoder, to make the swapped face integrate the identity and attribute of the input faces. In the first step, we extract the identity vector of the source image and the attribute vector of the target image respectively; in the second step, we map the concatenation of identity vector and attribute vector into the W+ potential space. In addition, for learning to map into the latent space of StyleGAN, we propose a set of self-supervised loss functions with which the training data do not need to be labeled manually. Extensive experiments on the test dataset show that the results of our method not only have a great advantage in clarity and authenticity than other state-of-the-art methods, but also reflect the sufficient integration of identity and attribute.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 19 of its 24 references that are in the map. First posted on arXiv 26 Jun 2021.
Builds on
19 of 24 references.
References · 19
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
- 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
- 2019MaskGAN: Towards Diverse and Interactive Facial Image Manipulationcited by 624
- 2020In-Domain GAN Inversion for Real Image Editingcited by 420
- 2020Closed-Form Factorization of Latent Semantics in GANscited by 407
- 2020InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANscited by 393
- 2019FSGAN: Subject Agnostic Face Swapping and Reenactmentcited by 319
- 2020StyleRig: Rigging StyleGAN for 3D Control over Portrait Imagescited by 267
- 2019FaceShifter: Towards High Fidelity And Occlusion Aware Face Swappingcited by 221
7 more
- 2019Image Processing Using Multi-Code GAN Priorcited by 185
- 2016Fast Face-swap Using Convolutional Neural Networkscited by 119
- 2018Towards Open-Set Identity Preserving Face Synthesiscited by 74
- 2017On Face Segmentation, Face Swapping, and Face Perceptioncited by 71
- 2018RSGAN: Face Swapping and Editing using Face and Hair Representation in Latent Spacescited by 50
- 2018A Hybrid Model for Identity Obfuscation by Face Replacementcited by 43
- 2018FSNet: An Identity-Aware Generative Model for Image-based Face Swappingcited by 29
Built on by
Citing papers per year: 2022: 1; 2023: 1.
2 papers.
- 2022Region-Aware Face Swappingcited by 45
- 2023High-Fidelity Face Swapping with Style Blendingcited by 0
- 2023High-Fidelity Face Swapping with Style Blending17 Dec 2023
- 2022Region-Aware Face Swapping9 Mar 2022