mlsanityData to 7 Oct 2026

High-Quality Face Caricature via Style Translation

arXiv 2311.13338 ↗First posted 22 Nov 2023cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Caricature is an exaggerated form of artistic portraiture that accentuates unique yet subtle characteristics of human faces. Recently, advancements in deep end-to-end techniques have yielded encouraging outcomes in capturing both style and elevated exaggerations in creating face caricatures. Most of these approaches tend to produce cartoon-like results that could be more practical for real-world applications. In this study, we proposed a high-quality, unpaired face caricature method that is appropriate for use in the real world and uses computer vision techniques and GAN models. We attain the exaggeration of facial features and the stylization of appearance through a two-step process: Face caricature generation and face caricature projection. The face caricature generation step creates new caricature face datasets from real images and trains a generative model using the real and newly created caricature datasets. The Face caricature projection employs an encoder trained with real and caricature faces with the pretrained generator to project real and caricature faces. We perform an incremental facial exaggeration from the real image to the caricature faces using the encoder and generator's latent space. Our projection preserves the facial identity, attributes, and expressions from the input image. Also, it accounts for facial occlusions, such as reading glasses or sunglasses, to enhance the robustness of our model. Furthermore, we conducted a comprehensive comparison of our approach with various state-of-the-art face caricature methods, highlighting our process's distinctiveness and exceptional realism.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 45 of its 75 references that are in the map. First posted on arXiv 22 Nov 2023.

Builds on

45 of 75 references.

References · 45

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  5. 2022Generative Adversarial Networkscited by 5,603
  6. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  7. 2014Deep Learning Face Attributes in the Wildcited by 3,679
  8. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  9. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
  10. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
  11. 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
  12. 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,095
33 more
  1. 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
  2. 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
  3. 2016Generative Adversarial Text to Image Synthesiscited by 735
  4. 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
  5. 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
  6. 2018Which Training Methods for GANs do actually Converge?cited by 672
  7. 2018BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentationcited by 645
  8. 2017Unsupervised Image-to-Image Translation Networkscited by 602
  9. 2021Designing an Encoder for StyleGAN Image Manipulationcited by 542
  10. 2021GAN Inversion: A Surveycited by 366
  11. 2021ReStyle: A Residual-Based StyleGAN Encoder via Iterative Refinementcited by 248
  12. 2022Towards Robust Blind Face Restoration with Codebook Lookup Transformercited by 230
  13. 2021HyperStyle: StyleGAN Inversion with HyperNetworks for Real Image Editingcited by 208
  14. 2019U-GAT-IT: Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translationcited by 186
  15. 2016Semantic Image Inpainting with Deep Generative Modelscited by 156
  16. 2017Visual Attribute Transfer through Deep Image Analogycited by 123
  17. 2016Combining Markov Random Fields and Convolutional Neural Networks for Image Synthesiscited by 102
  18. 2016Controlling Perceptual Factors in Neural Style Transfercited by 99
  19. 2020Resolution Dependent GAN Interpolation for Controllable Image Synthesis Between Domainscited by 96
  20. 2022Pastiche Master: Exemplar-Based High-Resolution Portrait Style Transfercited by 66
  21. 2020Collaborative Learning for Faster StyleGAN Embeddingcited by 65
  22. 2022MatteFormer: Transformer-Based Image Matting via Prior-Tokenscited by 48
  23. 20233DAvatarGAN: Bridging Domains for Personalized Editable Avatarscited by 38
  24. 2018WarpGAN: Automatic Caricature Generationcited by 28
  25. 2022Face Generation and Editing with StyleGAN: A Surveycited by 27
  26. 2018Alive Caricature from 2D to 3Dcited by 13
  27. 2018CaricatureShop: Personalized and Photorealistic Caricature Sketchingcited by 12
  28. 2020AutoToon: Automatic Geometric Warping for Face Cartoon Generationcited by 12
  29. 2022Portrait Eyeglasses and Shadow Removal by Leveraging 3D Synthetic Datacited by 11
  30. 2017Automatic Trimap Generation for Image Mattingcited by 6
  31. 2018CariGAN: Caricature Generation through Weakly Paired Adversarial Learningcited by 6
  32. 2019Attribute-Driven Spontaneous Motion in Unpaired Image Translationcited by 5
  33. 2017Unpaired Photo-to-Caricature Translation on Faces in the Wildcited by 3

Built on by

Not cited yet.