mlsanityData to 13 Oct 2026

3D Face Arbitrary Style Transfer

arXiv 2303.07709 ↗First posted 14 Mar 2023cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Style transfer of 3D faces has gained more and more attention. However, previous methods mainly use images of artistic faces for style transfer while ignoring arbitrary style images such as abstract paintings. To solve this problem, we propose a novel method, namely Face-guided Dual Style Transfer (FDST). To begin with, FDST employs a 3D decoupling module to separate facial geometry and texture. Then we propose a style fusion strategy for facial geometry. Subsequently, we design an optimization-based DDSG mechanism for textures that can guide the style transfer by two style images. Besides the normal style image input, DDSG can utilize the original face input as another style input as the face prior. By this means, high-quality face arbitrary style transfer results can be obtained. Furthermore, FDST can be applied in many downstream tasks, including region-controllable style transfer, high-fidelity face texture reconstruction, large-pose face reconstruction, and artistic face reconstruction. Comprehensive quantitative and qualitative results show that our method can achieve comparable performance. All source codes and pre-trained weights will be released to the public.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 41 of its 54 references that are in the map. First posted on arXiv 14 Mar 2023.

Builds on

41 of 54 references.

References · 41

  1. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,000
  2. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,687
  3. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,005
  4. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
  5. 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
  6. 2015A Neural Algorithm of Artistic Stylecited by 481
  7. 2017Neural 3D Mesh Renderercited by 437
  8. 2020Towards Fast, Accurate and Stable 3D Dense Face Alignmentcited by 219
  9. 2017Neural Style Transfer: A Reviewcited by 199
  10. 2018Arbitrary Style Transfer with Style-Attentional Networkscited by 198
  11. 2019Unsupervised Learning of Probably Symmetric Deformable 3D Objects from Images in the Wildcited by 180
  12. 2017Deep Photo Style Transfercited by 168
29 more
  1. 2019Style Transfer by Relaxed Optimal Transport and Self-Similaritycited by 167
  2. 2019Photorealistic Style Transfer via Wavelet Transformscited by 166
  3. 2017MoFA: Model-based Deep Convolutional Face Autoencoder for Unsupervised Monocular Reconstructioncited by 163
  4. 2018Nonlinear 3D Face Morphable Modelcited by 157
  5. 2019GANFIT: Generative Adversarial Network Fitting for High Fidelity 3D Face Reconstructioncited by 150
  6. 2021CIPS-3D: A 3D-Aware Generator of GANs Based on Conditionally-Independent Pixel Synthesiscited by 149
  7. 2021FENeRF: Face Editing in Neural Radiance Fieldscited by 112
  8. 2016Regressing Robust and Discriminative 3D Morphable Models with a very Deep Neural Networkcited by 109
  9. 2020Blind Face Restoration via Deep Multi-scale Component Dictionariescited by 106
  10. 2018Unsupervised Training for 3D Morphable Model Regressioncited by 99
  11. 2020Resolution Dependent GAN Interpolation for Controllable Image Synthesis Between Domainscited by 96
  12. 2019Towards High-fidelity Nonlinear 3D Face Morphable Modelcited by 91
  13. 2018Arbitrary Style Transfer with Deep Feature Reshufflecited by 75
  14. 2016Learning Detailed Face Reconstruction from a Single Imagecited by 71
  15. 2020Lifting 2D StyleGAN for 3D-Aware Face Generationcited by 64
  16. 2020Do 2D GANs Know 3D Shape? Unsupervised 3D shape reconstruction from 2D Image GANscited by 63
  17. 2017UV-GAN: Adversarial Facial UV Map Completion for Pose-invariant Face Recognitioncited by 62
  18. 2021JoJoGAN: One Shot Face Stylizationcited by 49
  19. 2021BlendGAN: Implicitly GAN Blending for Arbitrary Stylized Face Generationcited by 47
  20. 2020Rotate-and-Render: Unsupervised Photorealistic Face Rotation from Single-View Imagescited by 37
  21. 2020OSTeC: One-Shot Texture Completioncited by 37
  22. 2019Synthesizing Coupled 3D Face Modalities by Trunk-Branch Generative Adversarial Networkscited by 34
  23. 2018WarpGAN: Automatic Caricature Generationcited by 28
  24. 2021AniGAN: Style-Guided Generative Adversarial Networks for Unsupervised Anime Face Generationcited by 25
  25. 2021Exemplar-Based 3D Portrait Stylizationcited by 21
  26. 2018CaricatureShop: Personalized and Photorealistic Caricature Sketchingcited by 12
  27. 20203D-CariGAN: An End-to-End Solution to 3D Caricature Generation from Face Photoscited by 7
  28. 2018CariGAN: Caricature Generation through Weakly Paired Adversarial Learningcited by 6
  29. 2022IDE-3D: Interactive Disentangled Editing for High-Resolution 3D-aware Portrait Synthesiscited by 5

Built on by

Not cited yet.