AniGAN: Style-Guided Generative Adversarial Networks for Unsupervised Anime Face Generation
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose a novel framework to translate a portrait photo-face into an anime appearance. Our aim is to synthesize anime-faces which are style-consistent with a given reference anime-face. However, unlike typical translation tasks, such anime-face translation is challenging due to complex variations of appearances among anime-faces. Existing methods often fail to transfer the styles of reference anime-faces, or introduce noticeable artifacts/distortions in the local shapes of their generated faces. We propose AniGAN, a novel GAN-based translator that synthesizes high-quality anime-faces. Specifically, a new generator architecture is proposed to simultaneously transfer color/texture styles and transform local facial shapes into anime-like counterparts based on the style of a reference anime-face, while preserving the global structure of the source photo-face. We propose a double-branch discriminator to learn both domain-specific distributions and domain-shared distributions, helping generate visually pleasing anime-faces and effectively mitigate artifacts. Extensive experiments on selfie2anime and a new face2anime dataset qualitatively and quantitatively demonstrate the superiority of our method over state-of-the-art methods. The new dataset is available at https://github.com/bing-li-ai/AniGAN .
Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). Builds on 36 of its 48 references that are in the map. First posted on arXiv 24 Feb 2021.
Builds on
36 of 48 references.
References · 36
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2016Layer Normalizationcited by 5,579
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
- 2017Improved Training of Wasserstein GANscited by 2,223
- 2014Conditional Generative Adversarial Netscited by 2,152
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
24 more
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
- 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,187
- 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,176
- 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,095
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
- 2018Self-Attention Generative Adversarial Networkscited by 809
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
- 2018Which Training Methods for GANs do actually Converge?cited by 672
- 2017Unsupervised Image-to-Image Translation Networkscited by 602
- 2015A Neural Algorithm of Artistic Stylecited by 480
- 2019DRIT++: Diverse Image-to-Image Translation via Disentangled Representationscited by 244
- 2017Geometric GANcited by 232
- 2019Few-Shot Unsupervised Image-to-Image Translationcited by 222
- 2019U-GAT-IT: Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translationcited by 186
- 2019PSGAN: Pose and Expression Robust Spatial-Aware GAN for Customizable Makeup Transfercited by 66
- 2017Contextual-based Image Inpainting: Infer, Match, and Translatecited by 50
- 2018Exemplar Guided Unsupervised Image-to-Image Translation with Semantic Consistencycited by 41
- 2019Unsupervised Sketch-to-Photo Synthesiscited by 38
- 2018WarpGAN: Automatic Caricature Generationcited by 28
- 2020One-Shot Domain Adaptation For Face Generationcited by 15
- 2018Show, Attend and Translate: Unsupervised Image Translation with Self-Regularization and Attentioncited by 10
- 2019Quality-aware Unpaired Image-to-Image Translationcited by 9
- 2017Generative Semantic Manipulation with Contrasting GANcited by 4
Built on by
Citing papers per year: 2021: 2; 2022: 5; 2023: 15; 2024: 3.
25 papers.
Sort:
By area:
- 2023FreeDoM: Training-Free Energy-Guided Conditional Diffusion Modelcited by 290
- 2022Pastiche Master: Exemplar-Based High-Resolution Portrait Style Transfercited by 66
- 2024Vivid-ZOO: Multi-View Video Generation with Diffusion Modelcited by 40
- 2022VToonify: Controllable High-Resolution Portrait Video Style Transfercited by 20
- 2021GANs N' Roses: Stable, Controllable, Diverse Image to Image Translation (works for videos too!)cited by 13
- 2023Automatic Animation of Hair Blowing in Still Portrait Photoscited by 13
- 2023DeformToon3D: Deformable 3D Toonification from Neural Radiance Fieldscited by 9
- 2023HyperStyle3D: Text-Guided 3D Portrait Stylization via Hypernetworkscited by 7
- 2023AgileGAN3D: Few-Shot 3D Portrait Stylization by Augmented Transfer Learningcited by 5
- 2022Combating Mode Collapse in GANs via Manifold Entropy Estimationcited by 4
- 2023Fix the Noise: Disentangling Source Feature for Controllable Domain Translationcited by 4
- 2023Cartoondiff: Training-free Cartoon Image Generation with Diffusion Transformer Modelscited by 4
13 more
- 2023Disentangled Representation Learning for Controllable Person Image Generationcited by 4
- 2024Re:Draw -- Context Aware Translation as a Controllable Method for Artistic Productioncited by 3
- 2023Dynamically Masked Discriminator for Generative Adversarial Networkscited by 2
- 2021Universal Face Restoration With Memorized Modulationcited by 1
- 2023Improving GAN Training via Feature Space Shrinkagecited by 1
- 2023Multi-Modal Face Stylization with a Generative Priorcited by 1
- 2023Context-Preserving Two-Stage Video Domain Translation for Portrait Stylizationcited by 1
- 2022MontageGAN: Generation and Assembly of Multiple Components by GANscited by 0
- 2022Real-Time Portrait Stylization on the Edgecited by 0
- 20233D Face Arbitrary Style Transfercited by 0
- 2023FISTNet: FusIon of STyle-path generative Networks for Facial Style Transfercited by 0
- 2023Vision-language Assisted Attribute Learningcited by 0
- 2024ArtNeRF: A Stylized Neural Field for 3D-Aware Cartoonized Face Synthesiscited by 0
- 2024Vivid-ZOO: Multi-View Video Generation with Diffusion Model12 Jun 2024
- 2024ArtNeRF: A Stylized Neural Field for 3D-Aware Cartoonized Face Synthesis21 Apr 2024
- 2024Re:Draw -- Context Aware Translation as a Controllable Method for Artistic Production7 Jan 2024
- 2023Vision-language Assisted Attribute Learning12 Dec 2023
- 2023Disentangled Representation Learning for Controllable Person Image Generation10 Dec 2023
- 2023Automatic Animation of Hair Blowing in Still Portrait Photos25 Sep 2023
- 2023Cartoondiff: Training-free Cartoon Image Generation with Diffusion Transformer Models15 Sep 2023
- 2023DeformToon3D: Deformable 3D Toonification from Neural Radiance Fields8 Sep 2023
- 2023FISTNet: FusIon of STyle-path generative Networks for Facial Style Transfer18 Jul 2023
- 2023Dynamically Masked Discriminator for Generative Adversarial Networks13 Jun 2023
- 2023Context-Preserving Two-Stage Video Domain Translation for Portrait Stylization30 May 2023
- 2023Multi-Modal Face Stylization with a Generative Prior29 May 2023
13 more
- 2023HyperStyle3D: Text-Guided 3D Portrait Stylization via Hypernetworks19 Apr 2023
- 2023AgileGAN3D: Few-Shot 3D Portrait Stylization by Augmented Transfer Learning24 Mar 2023
- 2023Fix the Noise: Disentangling Source Feature for Controllable Domain Translation21 Mar 2023
- 2023FreeDoM: Training-Free Energy-Guided Conditional Diffusion Model17 Mar 2023
- 20233D Face Arbitrary Style Transfer14 Mar 2023
- 2023Improving GAN Training via Feature Space Shrinkage2 Mar 2023
- 2022VToonify: Controllable High-Resolution Portrait Video Style Transfer22 Sep 2022
- 2022Combating Mode Collapse in GANs via Manifold Entropy Estimation25 Aug 2022
- 2022Real-Time Portrait Stylization on the Edge2 Jun 2022
- 2022MontageGAN: Generation and Assembly of Multiple Components by GANs31 May 2022
- 2022Pastiche Master: Exemplar-Based High-Resolution Portrait Style Transfer24 Mar 2022
- 2021Universal Face Restoration With Memorized Modulation3 Oct 2021
- 2021GANs N' Roses: Stable, Controllable, Diverse Image to Image Translation (works for videos too!)11 Jun 2021
- 2022Pastiche Master: Exemplar-Based High-Resolution Portrait Style Transfercited by 66
- 2022VToonify: Controllable High-Resolution Portrait Video Style Transfercited by 20
- 2021GANs N' Roses: Stable, Controllable, Diverse Image to Image Translation (works for videos too!)cited by 13
- 2023Automatic Animation of Hair Blowing in Still Portrait Photoscited by 13
- 2023DeformToon3D: Deformable 3D Toonification from Neural Radiance Fieldscited by 9
- 2023HyperStyle3D: Text-Guided 3D Portrait Stylization via Hypernetworkscited by 7
- 2023AgileGAN3D: Few-Shot 3D Portrait Stylization by Augmented Transfer Learningcited by 5
- 2022Combating Mode Collapse in GANs via Manifold Entropy Estimationcited by 4
- 2023Fix the Noise: Disentangling Source Feature for Controllable Domain Translationcited by 4
- 2023Disentangled Representation Learning for Controllable Person Image Generationcited by 4
- 2024Re:Draw -- Context Aware Translation as a Controllable Method for Artistic Productioncited by 3
- 2023Dynamically Masked Discriminator for Generative Adversarial Networkscited by 2
12 most cited of 22 All 22 (JSON)
- 2024ArtNeRF: A Stylized Neural Field for 3D-Aware Cartoonized Face Synthesis21 Apr 2024
- 2024Re:Draw -- Context Aware Translation as a Controllable Method for Artistic Production7 Jan 2024
- 2023Vision-language Assisted Attribute Learning12 Dec 2023
- 2023Disentangled Representation Learning for Controllable Person Image Generation10 Dec 2023
- 2023Automatic Animation of Hair Blowing in Still Portrait Photos25 Sep 2023
- 2023DeformToon3D: Deformable 3D Toonification from Neural Radiance Fields8 Sep 2023
- 2023FISTNet: FusIon of STyle-path generative Networks for Facial Style Transfer18 Jul 2023
- 2023Dynamically Masked Discriminator for Generative Adversarial Networks13 Jun 2023
- 2023Context-Preserving Two-Stage Video Domain Translation for Portrait Stylization30 May 2023
- 2023Multi-Modal Face Stylization with a Generative Prior29 May 2023
- 2023HyperStyle3D: Text-Guided 3D Portrait Stylization via Hypernetworks19 Apr 2023
- 2023AgileGAN3D: Few-Shot 3D Portrait Stylization by Augmented Transfer Learning24 Mar 2023
12 newest of 22 All 22 (JSON)