JoJoGAN: One Shot Face Stylization
Not on the map. Why?
Abstract (arXiv)
A style mapper applies some fixed style to its input images (so, for example, taking faces to cartoons). This paper describes a simple procedure -- JoJoGAN -- to learn a style mapper from a single example of the style. JoJoGAN uses a GAN inversion procedure and StyleGAN's style-mixing property to produce a substantial paired dataset from a single example style. The paired dataset is then used to fine-tune a StyleGAN. An image can then be style mapped by GAN-inversion followed by the fine-tuned StyleGAN. JoJoGAN needs just one reference and as little as 30 seconds of training time. JoJoGAN can use extreme style references (say, animal faces) successfully. Furthermore, one can control what aspects of the style are used and how much of the style is applied. Qualitative and quantitative evaluation show that JoJoGAN produces high quality high resolution images that vastly outperform the current state-of-the-art.
Key facts. Cited by 49 papers in the map (data through 7 Oct 2026). Builds on 35 of its 41 references that are in the map. First posted on arXiv 22 Dec 2021.
Builds on
35 of 41 references.
References · 35
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2016Improved Techniques for Training GANscited by 2,938
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2021Designing an Encoder for StyleGAN Image Manipulationcited by 542
- 2020Closed-Form Factorization of Latent Semantics in GANscited by 407
23 more
- 2020InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANscited by 393
- 2020PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Modelscited by 358
- 2017Universal Style Transfer via Feature Transformscited by 352
- 2021Towards Real-World Blind Face Restoration with Generative Facial Priorcited by 347
- 2020StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generationcited by 331
- 2021ReStyle: A Residual-Based StyleGAN Encoder via Iterative Refinementcited by 248
- 2021Few-shot Image Generation via Cross-domain Correspondencecited by 206
- 2018Arbitrary Style Transfer with Style-Attentional Networkscited by 197
- 2021GAN Prior Embedded Network for Blind Face Restoration in the Wildcited by 197
- 2021StyleGAN-NADA: CLIP-Guided Domain Adaptation of Image Generatorscited by 164
- 2019Effectively Unbiased FID and Inception Score and where to find themcited by 161
- 2020Freeze the Discriminator: a Simple Baseline for Fine-Tuning GANscited by 132
- 2020Few-shot Image Generation with Elastic Weight Consolidationcited by 122
- 2020Resolution Dependent GAN Interpolation for Controllable Image Synthesis Between Domainscited by 96
- 2020Improved StyleGAN Embedding: Where are the Good Latents?cited by 88
- 2021Mind the Gap: Domain Gap Control for Single Shot Domain Adaptation for Generative Adversarial Networkscited by 68
- 2020Few-Shot Adaptation of Generative Adversarial Networkscited by 64
- 2021BlendGAN: Implicitly GAN Blending for Arbitrary Stylized Face Generationcited by 47
- 2020Deformable Style Transfercited by 31
- 2021Retrieve in Style: Unsupervised Facial Feature Transfer and Retrievalcited by 15
- 2021StyleGAN of All Trades: Image Manipulation with Only Pretrained StyleGANcited by 14
- 2021GANs N' Roses: Stable, Controllable, Diverse Image to Image Translation (works for videos too!)cited by 13
- 2019Improving Style Transfer with Calibrated Metricscited by 5
Built on by
Citing papers per year: 2022: 15; 2023: 21; 2024: 9; 2025: 2; 2026: 2.
49 papers.
Sort:
By area:
- 2023ZipLoRA: Any Subject in Any Style by Effectively Merging LoRAscited by 194
- 2022Diffusion-based Image Translation using Disentangled Style and Content Representationcited by 148
- 2023OBJECT 3DIT: Language-guided 3D-aware Image Editingcited by 62
- 2023StyleGAN knows Normal, Depth, Albedo, and Morecited by 44
- 20233DAvatarGAN: Bridging Domains for Personalized Editable Avatarscited by 38
- 2023Training-free Content Injection using h-space in Diffusion Modelscited by 36
- 2022DATID-3D: Diversity-Preserved Domain Adaptation Using Text-to-Image Diffusion for 3D Generative Modelcited by 32
- 2022One-Shot Adaptation of GAN in Just One CLIPcited by 31
- 2024UnZipLoRA: Separating Content and Style from a Single Imagecited by 24
- 2023MapPrior: Bird's-Eye View Map Layout Estimation with Generative Modelscited by 21
- 2022Generalized One-shot Domain Adaptation of Generative Adversarial Networkscited by 19
- 2023A Survey on Generative Modeling with Limited Data, Few Shots, and Zero Shotcited by 19
37 more
- 2023Domain Re-Modulation for Few-Shot Generative Domain Adaptationcited by 18
- 2024One-Shot Structure-Aware Stylized Image Synthesiscited by 14
- 2024Deformable One-shot Face Stylization via DINO Semantic Guidancecited by 14
- 2022Bridging CLIP and StyleGAN through Latent Alignment for Image Editingcited by 12
- 2023WeditGAN: Few-Shot Image Generation via Latent Space Relocationcited by 12
- 2024Diffusion-driven GAN Inversion for Multi-Modal Face Image Generationcited by 12
- 2022CtlGAN: Few-shot Artistic Portraits Generation with Contrastive Transfer Learningcited by 10
- 2022StyleDomain: Efficient and Lightweight Parameterizations of StyleGAN for One-shot and Few-shot Domain Adaptationcited by 10
- 2023Portrait Diffusion: Training-free Face Stylization with Chain-of-Paintingcited by 10
- 2024Contrastive Test-Time Composition of Multiple LoRA Models for Image Generationcited by 9
- 2022Video2StyleGAN: Disentangling Local and Global Variations in a Videocited by 8
- 2022WebtoonMe: A Data-Centric Approach for Full-Body Portrait Stylizationcited by 6
- 2023StyO: Stylize Your Face in Only One-shotcited by 6
- 2023AgileGAN3D: Few-Shot 3D Portrait Stylization by Augmented Transfer Learningcited by 5
- 2023Target-Aware Generative Augmentations for Single-Shot Adaptationcited by 5
- 2022StyLitGAN: Prompting StyleGAN to Produce New Illumination Conditionscited by 4
- 2022Leveraging GAN Priors for Few-Shot Part Segmentationcited by 4
- 2024Stylized Face Sketch Extraction via Generative Prior with Limited Datacited by 4
- 2022MultiStyleGAN: Multiple One-shot Image Stylizations using a Single GANcited by 3
- 2023StyleRetoucher: Generalized Portrait Image Retouching with GAN Priorscited by 3
- 2024ToonAging: Face Re-Aging upon Artistic Portrait Style Transfercited by 2
- 2022Single-Shot Domain Adaptation via Target-Aware Generative Augmentationcited by 1
- 2022Realtime Data-Efficient Portrait Stylization Based On Geometric Alignmentcited by 1
- 2023Cross-modal Face- and Voice-style Transfercited by 1
- 2023Few-shots Portrait Generation with Style Enhancement and Identity Preservationcited by 1
- 2023Multi-Modal Face Stylization with a Generative Priorcited by 1
- 2023Context-Preserving Two-Stage Video Domain Translation for Portrait Stylizationcited by 1
- 2025FFaceNeRF: Few-shot Face Editing in Neural Radiance Fieldscited by 1
- 2022Generative Adversarial Network Applications in Creating a Meta-Universecited by 0
- 2023Few-shot Face Image Translation via GAN Prior Distillationcited by 0
- 20233D Face Arbitrary Style Transfercited by 0
- 2023One-Shot Stylization for Full-Body Human Imagescited by 0
- 2024ArtNeRF: A Stylized Neural Field for 3D-Aware Cartoonized Face Synthesiscited by 0
- 2024PS-StyleGAN: Illustrative Portrait Sketching using Attention-Based Style Adaptationcited by 0
- 2025Efficient Few-shot Identity Preserving Attribute Editing for 3D-aware Deep Generative Modelscited by 0
- 2026Geometry Preserving Loss Functions Promote Improved Adaptation of Blackbox Generative Modelcited by 0
- 2026AnyStyle: A Single LoRA is Sufficient for Image-Guided Style Transfercited by 0
- 2026AnyStyle: A Single LoRA is Sufficient for Image-Guided Style Transfer6 Jul 2026
- 2026Geometry Preserving Loss Functions Promote Improved Adaptation of Blackbox Generative Model26 Apr 2026
- 2025Efficient Few-shot Identity Preserving Attribute Editing for 3D-aware Deep Generative Models21 Oct 2025
- 2025FFaceNeRF: Few-shot Face Editing in Neural Radiance Fields21 Mar 2025
- 2024UnZipLoRA: Separating Content and Style from a Single Image5 Dec 2024
- 2024PS-StyleGAN: Illustrative Portrait Sketching using Attention-Based Style Adaptation31 Aug 2024
- 2024Diffusion-driven GAN Inversion for Multi-Modal Face Image Generation7 May 2024
- 2024ArtNeRF: A Stylized Neural Field for 3D-Aware Cartoonized Face Synthesis21 Apr 2024
- 2024Contrastive Test-Time Composition of Multiple LoRA Models for Image Generation28 Mar 2024
- 2024Stylized Face Sketch Extraction via Generative Prior with Limited Data17 Mar 2024
- 2024Deformable One-shot Face Stylization via DINO Semantic Guidance1 Mar 2024
- 2024One-Shot Structure-Aware Stylized Image Synthesis27 Feb 2024
37 more
- 2024ToonAging: Face Re-Aging upon Artistic Portrait Style Transfer5 Feb 2024
- 2023StyleRetoucher: Generalized Portrait Image Retouching with GAN Priors22 Dec 2023
- 2023Portrait Diffusion: Training-free Face Stylization with Chain-of-Painting3 Dec 2023
- 2023ZipLoRA: Any Subject in Any Style by Effectively Merging LoRAs22 Nov 2023
- 2023MapPrior: Bird's-Eye View Map Layout Estimation with Generative Models24 Aug 2023
- 2023A Survey on Generative Modeling with Limited Data, Few Shots, and Zero Shot26 Jul 2023
- 2023OBJECT 3DIT: Language-guided 3D-aware Image Editing20 Jul 2023
- 2023StyleGAN knows Normal, Depth, Albedo, and More1 Jun 2023
- 2023Context-Preserving Two-Stage Video Domain Translation for Portrait Stylization30 May 2023
- 2023Multi-Modal Face Stylization with a Generative Prior29 May 2023
- 2023Target-Aware Generative Augmentations for Single-Shot Adaptation22 May 2023
- 2023WeditGAN: Few-Shot Image Generation via Latent Space Relocation11 May 2023
- 2023One-Shot Stylization for Full-Body Human Images14 Apr 2023
- 2023Training-free Content Injection using h-space in Diffusion Models27 Mar 2023
- 2023AgileGAN3D: Few-Shot 3D Portrait Stylization by Augmented Transfer Learning24 Mar 2023
- 20233D Face Arbitrary Style Transfer14 Mar 2023
- 2023StyO: Stylize Your Face in Only One-shot6 Mar 2023
- 2023Few-shots Portrait Generation with Style Enhancement and Identity Preservation1 Mar 2023
- 2023Cross-modal Face- and Voice-style Transfer27 Feb 2023
- 2023Domain Re-Modulation for Few-Shot Generative Domain Adaptation6 Feb 2023
- 2023Few-shot Face Image Translation via GAN Prior Distillation28 Jan 2023
- 20233DAvatarGAN: Bridging Domains for Personalized Editable Avatars6 Jan 2023
- 2022StyleDomain: Efficient and Lightweight Parameterizations of StyleGAN for One-shot and Few-shot Domain Adaptation20 Dec 2022
- 2022DATID-3D: Diversity-Preserved Domain Adaptation Using Text-to-Image Diffusion for 3D Generative Model29 Nov 2022
- 2022Realtime Data-Efficient Portrait Stylization Based On Geometric Alignment28 Nov 2022
- 2022Single-Shot Domain Adaptation via Target-Aware Generative Augmentation29 Oct 2022
- 2022WebtoonMe: A Data-Centric Approach for Full-Body Portrait Stylization19 Oct 2022
- 2022Bridging CLIP and StyleGAN through Latent Alignment for Image Editing10 Oct 2022
- 2022MultiStyleGAN: Multiple One-shot Image Stylizations using a Single GAN8 Oct 2022
- 2022Diffusion-based Image Translation using Disentangled Style and Content Representation30 Sep 2022
- 2022Generalized One-shot Domain Adaptation of Generative Adversarial Networks8 Sep 2022
- 2022Leveraging GAN Priors for Few-Shot Part Segmentation27 Jul 2022
- 2022Video2StyleGAN: Disentangling Local and Global Variations in a Video27 May 2022
- 2022StyLitGAN: Prompting StyleGAN to Produce New Illumination Conditions20 May 2022
- 2022One-Shot Adaptation of GAN in Just One CLIP17 Mar 2022
- 2022CtlGAN: Few-shot Artistic Portraits Generation with Contrastive Transfer Learning16 Mar 2022
- 2022Generative Adversarial Network Applications in Creating a Meta-Universe23 Jan 2022
- 2022Diffusion-based Image Translation using Disentangled Style and Content Representationcited by 148
- 2023Training-free Content Injection using h-space in Diffusion Modelscited by 36
- 2022DATID-3D: Diversity-Preserved Domain Adaptation Using Text-to-Image Diffusion for 3D Generative Modelcited by 32
- 2024One-Shot Structure-Aware Stylized Image Synthesiscited by 14
- 2024One-Shot Structure-Aware Stylized Image Synthesis27 Feb 2024
- 2023Training-free Content Injection using h-space in Diffusion Models27 Mar 2023
- 2022DATID-3D: Diversity-Preserved Domain Adaptation Using Text-to-Image Diffusion for 3D Generative Model29 Nov 2022
- 2022Diffusion-based Image Translation using Disentangled Style and Content Representation30 Sep 2022
- 2023ZipLoRA: Any Subject in Any Style by Effectively Merging LoRAscited by 194
- 2023OBJECT 3DIT: Language-guided 3D-aware Image Editingcited by 62
- 2023StyleGAN knows Normal, Depth, Albedo, and Morecited by 44
- 20233DAvatarGAN: Bridging Domains for Personalized Editable Avatarscited by 38
- 2022One-Shot Adaptation of GAN in Just One CLIPcited by 31
- 2024UnZipLoRA: Separating Content and Style from a Single Imagecited by 24
- 2023MapPrior: Bird's-Eye View Map Layout Estimation with Generative Modelscited by 21
- 2022Generalized One-shot Domain Adaptation of Generative Adversarial Networkscited by 19
- 2023A Survey on Generative Modeling with Limited Data, Few Shots, and Zero Shotcited by 19
- 2023Domain Re-Modulation for Few-Shot Generative Domain Adaptationcited by 18
- 2024Deformable One-shot Face Stylization via DINO Semantic Guidancecited by 14
- 2023WeditGAN: Few-Shot Image Generation via Latent Space Relocationcited by 12
12 most cited of 44 All 44 (JSON)
- 2026AnyStyle: A Single LoRA is Sufficient for Image-Guided Style Transfer6 Jul 2026
- 2026Geometry Preserving Loss Functions Promote Improved Adaptation of Blackbox Generative Model26 Apr 2026
- 2025Efficient Few-shot Identity Preserving Attribute Editing for 3D-aware Deep Generative Models21 Oct 2025
- 2025FFaceNeRF: Few-shot Face Editing in Neural Radiance Fields21 Mar 2025
- 2024UnZipLoRA: Separating Content and Style from a Single Image5 Dec 2024
- 2024PS-StyleGAN: Illustrative Portrait Sketching using Attention-Based Style Adaptation31 Aug 2024
- 2024Diffusion-driven GAN Inversion for Multi-Modal Face Image Generation7 May 2024
- 2024ArtNeRF: A Stylized Neural Field for 3D-Aware Cartoonized Face Synthesis21 Apr 2024
- 2024Contrastive Test-Time Composition of Multiple LoRA Models for Image Generation28 Mar 2024
- 2024Stylized Face Sketch Extraction via Generative Prior with Limited Data17 Mar 2024
- 2024Deformable One-shot Face Stylization via DINO Semantic Guidance1 Mar 2024
- 2024ToonAging: Face Re-Aging upon Artistic Portrait Style Transfer5 Feb 2024
12 newest of 44 All 44 (JSON)