Fine-Tuning StyleGAN2 For Cartoon Face Generation
Not on the map. Why?
Abstract (arXiv)
Recent studies have shown remarkable success in the unsupervised image to image (I2I) translation. However, due to the imbalance in the data, learning joint distribution for various domains is still very challenging. Although existing models can generate realistic target images, it's difficult to maintain the structure of the source image. In addition, training a generative model on large data in multiple domains requires a lot of time and computer resources. To address these limitations, we propose a novel image-to-image translation method that generates images of the target domain by finetuning a stylegan2 pretrained model. The stylegan2 model is suitable for unsupervised I2I translation on unbalanced datasets; it is highly stable, produces realistic images, and even learns properly from limited data when applied with simple fine-tuning techniques. Thus, in this paper, we propose new methods to preserve the structure of the source images and generate realistic images in the target domain. The code and results are available at https://github.com/happy-jihye/Cartoon-StyleGan2
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 19 of its 20 references that are in the map. First posted on arXiv 22 Jun 2021.
Builds on
19 of 20 references.
References · 19
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2014Conditional Generative Adversarial Netscited by 2,152
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
- 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
- 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 990
- 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
- 2017Unsupervised Image-to-Image Translation Networkscited by 602
- 2020In-Domain GAN Inversion for Real Image Editingcited by 420
7 more
- 2020Closed-Form Factorization of Latent Semantics in GANscited by 407
- 2017DualGAN: Unsupervised Dual Learning for Image-to-Image Translationcited by 310
- 2017Learning to Discover Cross-Domain Relations with Generative Adversarial Networkscited by 278
- 2020Freeze the Discriminator: a Simple Baseline for Fine-Tuning GANscited by 132
- 2020Resolution Dependent GAN Interpolation for Controllable Image Synthesis Between Domainscited by 96
- 2021Exploiting Spatial Dimensions of Latent in GAN for Real-time Image Editingcited by 91
- 2020Unsupervised Image-to-Image Translation via Pre-trained StyleGAN2 Networkcited by 36
Built on by
Citing papers per year: 2022: 5; 2023: 5; 2024: 2.
12 papers.
- 2022Face Generation and Editing with StyleGAN: A Surveycited by 27
- 2023Interactive Face Video Coding: A Generative Compression Frameworkcited by 17
- 2023Null-text Guidance in Diffusion Models is Secretly a Cartoon-style Creatorcited by 12
- 2023SwiftAvatar: Efficient Auto-Creation of Parameterized Stylized Character on Arbitrary Avatar Enginescited by 3
- 20223D Cartoon Face Generation with Controllable Expressions from a Single GAN Imagecited by 2
- 2023Cross-GAN Auditing: Unsupervised Identification of Attribute Level Similarities and Differences between Pretrained Generative Modelscited by 2
- 2023Domain-Scalable Unpaired Image Translation via Latent Space Anchoringcited by 2
- 2024ToonAging: Face Re-Aging upon Artistic Portrait Style Transfercited by 2
- 2024HyperGAN-CLIP: A Unified Framework for Domain Adaptation, Image Synthesis and Manipulationcited by 1
- 2022Enhancing Quality of Pose-varied Face Restoration with Local Weak Feature Sensing and GAN Priorcited by 0
- 2022Looks Like Magic: Transfer Learning in GANs to Generate New Card Illustrationscited by 0
- 2022Shapes2Toon: Generating Cartoon Characters from Simple Geometric Shapescited by 0
- 2024HyperGAN-CLIP: A Unified Framework for Domain Adaptation, Image Synthesis and Manipulation19 Nov 2024
- 2024ToonAging: Face Re-Aging upon Artistic Portrait Style Transfer5 Feb 2024
- 2023Domain-Scalable Unpaired Image Translation via Latent Space Anchoring26 Jun 2023
- 2023Null-text Guidance in Diffusion Models is Secretly a Cartoon-style Creator11 May 2023
- 2023Cross-GAN Auditing: Unsupervised Identification of Attribute Level Similarities and Differences between Pretrained Generative Models19 Mar 2023
- 2023Interactive Face Video Coding: A Generative Compression Framework20 Feb 2023
- 2023SwiftAvatar: Efficient Auto-Creation of Parameterized Stylized Character on Arbitrary Avatar Engines19 Jan 2023
- 2022Face Generation and Editing with StyleGAN: A Survey18 Dec 2022
- 2022Shapes2Toon: Generating Cartoon Characters from Simple Geometric Shapes3 Nov 2022
- 20223D Cartoon Face Generation with Controllable Expressions from a Single GAN Image29 Jul 2022
- 2022Looks Like Magic: Transfer Learning in GANs to Generate New Card Illustrations28 May 2022
- 2022Enhancing Quality of Pose-varied Face Restoration with Local Weak Feature Sensing and GAN Prior28 May 2022