StyleGAN of All Trades: Image Manipulation with Only Pretrained StyleGAN
Not on the map. Why?
Abstract (arXiv)
Recently, StyleGAN has enabled various image manipulation and editing tasks thanks to the high-quality generation and the disentangled latent space. However, additional architectures or task-specific training paradigms are usually required for different tasks. In this work, we take a deeper look at the spatial properties of StyleGAN. We show that with a pretrained StyleGAN along with some operations, without any additional architecture, we can perform comparably to the state-of-the-art methods on various tasks, including image blending, panorama generation, generation from a single image, controllable and local multimodal image to image translation, and attributes transfer. The proposed method is simple, effective, efficient, and applicable to any existing pretrained StyleGAN model.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 29 of its 34 references that are in the map. First posted on arXiv 2 Nov 2021.
Builds on
29 of 34 references.
References · 29
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,355
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
- 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 695
- 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
- 2020GANSpace: Discovering Interpretable GAN Controlscited by 614
- 2020InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANscited by 394
- 2019Image2StyleGAN++: How to Edit the Embedded Images?cited by 356
17 more
- 2019SinGAN: Learning a Generative Model from a Single Natural Imagecited by 348
- 2020StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generationcited by 332
- 2018Diverse Image-to-Image Translation via Disentangled Representationscited by 296
- 2020Editing in Style: Uncovering the Local Semantics of GANscited by 183
- 2020Semantic Photo Manipulation with a Generative Image Priorcited by 178
- 2019Effectively Unbiased FID and Inception Score and where to find themcited by 165
- 2020Rewriting a Deep Generative Modelcited by 107
- 2020Resolution Dependent GAN Interpolation for Controllable Image Synthesis Between Domainscited by 96
- 2021GAN-Control: Explicitly Controllable GANscited by 91
- 2020Generative Hierarchical Features from Synthesizing Imagescited by 83
- 2021Aligning Latent and Image Spaces to Connect the Unconnectablecited by 70
- 2019COCO-GAN: Generation by Parts via Conditional Coordinatingcited by 67
- 2021In&Out : Diverse Image Outpainting via GAN Inversioncited by 55
- 2020Disentangled Image Generation Through Structured Noise Injectioncited by 39
- 2020Unsupervised Image-to-Image Translation via Pre-trained StyleGAN2 Networkcited by 36
- 2020Improving Inversion and Generation Diversity in StyleGAN using a Gaussianized Latent Spacecited by 34
- 2018Spatially Controllable Image Synthesis with Internal Representation Collagingcited by 23
Built on by
Citing papers per year: 2021: 1; 2022: 7; 2023: 6.
14 papers.
Sort:
By area:
- 2022InfiniteNature-Zero: Learning Perpetual View Generation of Natural Scenes from Single Imagescited by 82
- 2023OTAvatar: One-shot Talking Face Avatar with Controllable Tri-plane Renderingcited by 67
- 2023OBJECT 3DIT: Language-guided 3D-aware Image Editingcited by 63
- 2021JoJoGAN: One Shot Face Stylizationcited by 49
- 2023Persistent Nature: A Generative Model of Unbounded 3D Worldscited by 44
- 2023StyleGAN knows Normal, Depth, Albedo, and Morecited by 44
- 20233DAvatarGAN: Bridging Domains for Personalized Editable Avatarscited by 38
- 2022Underwater Light Field Retention : Neural Rendering for Underwater Imagingcited by 22
- 2022Context-Consistent Semantic Image Editing with Style-Preserved Modulationcited by 10
- 2022Cycle Encoding of a StyleGAN Encoder for Improved Reconstruction and Editabilitycited by 7
- 2023ReGANIE: Rectifying GAN Inversion Errors for Accurate Real Image Editingcited by 6
- 2022Overparameterization Improves StyleGAN Inversioncited by 4
- 2023OBJECT 3DIT: Language-guided 3D-aware Image Editing20 Jul 2023
- 2023StyleGAN knows Normal, Depth, Albedo, and More1 Jun 2023
- 2023OTAvatar: One-shot Talking Face Avatar with Controllable Tri-plane Rendering26 Mar 2023
- 2023Persistent Nature: A Generative Model of Unbounded 3D Worlds23 Mar 2023
- 2023ReGANIE: Rectifying GAN Inversion Errors for Accurate Real Image Editing31 Jan 2023
- 20233DAvatarGAN: Bridging Domains for Personalized Editable Avatars6 Jan 2023
- 2022Out-of-domain GAN inversion via Invertibility Decomposition for Photo-Realistic Human Face Manipulation19 Dec 2022
- 2022InfiniteNature-Zero: Learning Perpetual View Generation of Natural Scenes from Single Images22 Jul 2022
- 2022Cycle Encoding of a StyleGAN Encoder for Improved Reconstruction and Editability19 Jul 2022
- 2022Context-Consistent Semantic Image Editing with Style-Preserved Modulation13 Jul 2022
- 2022StyLitGAN: Prompting StyleGAN to Produce New Illumination Conditions20 May 2022
- 2022Overparameterization Improves StyleGAN Inversion12 May 2022
2 more
- 2022Underwater Light Field Retention : Neural Rendering for Underwater Imaging21 Mar 2022
- 2021JoJoGAN: One Shot Face Stylization22 Dec 2021
- 2023Persistent Nature: A Generative Model of Unbounded 3D Worldscited by 44
- 2023Persistent Nature: A Generative Model of Unbounded 3D Worlds23 Mar 2023
- 2022InfiniteNature-Zero: Learning Perpetual View Generation of Natural Scenes from Single Imagescited by 82
- 2023OTAvatar: One-shot Talking Face Avatar with Controllable Tri-plane Renderingcited by 67
- 2023OBJECT 3DIT: Language-guided 3D-aware Image Editingcited by 63
- 2021JoJoGAN: One Shot Face Stylizationcited by 49
- 2023StyleGAN knows Normal, Depth, Albedo, and Morecited by 44
- 20233DAvatarGAN: Bridging Domains for Personalized Editable Avatarscited by 38
- 2022Underwater Light Field Retention : Neural Rendering for Underwater Imagingcited by 22
- 2022Context-Consistent Semantic Image Editing with Style-Preserved Modulationcited by 10
- 2022Cycle Encoding of a StyleGAN Encoder for Improved Reconstruction and Editabilitycited by 7
- 2023ReGANIE: Rectifying GAN Inversion Errors for Accurate Real Image Editingcited by 6
- 2022Overparameterization Improves StyleGAN Inversioncited by 4
- 2022StyLitGAN: Prompting StyleGAN to Produce New Illumination Conditionscited by 4
12 most cited of 13 All 13 (JSON)
- 2023OBJECT 3DIT: Language-guided 3D-aware Image Editing20 Jul 2023
- 2023StyleGAN knows Normal, Depth, Albedo, and More1 Jun 2023
- 2023OTAvatar: One-shot Talking Face Avatar with Controllable Tri-plane Rendering26 Mar 2023
- 2023ReGANIE: Rectifying GAN Inversion Errors for Accurate Real Image Editing31 Jan 2023
- 20233DAvatarGAN: Bridging Domains for Personalized Editable Avatars6 Jan 2023
- 2022Out-of-domain GAN inversion via Invertibility Decomposition for Photo-Realistic Human Face Manipulation19 Dec 2022
- 2022InfiniteNature-Zero: Learning Perpetual View Generation of Natural Scenes from Single Images22 Jul 2022
- 2022Cycle Encoding of a StyleGAN Encoder for Improved Reconstruction and Editability19 Jul 2022
- 2022Context-Consistent Semantic Image Editing with Style-Preserved Modulation13 Jul 2022
- 2022StyLitGAN: Prompting StyleGAN to Produce New Illumination Conditions20 May 2022
- 2022Overparameterization Improves StyleGAN Inversion12 May 2022
- 2022Underwater Light Field Retention : Neural Rendering for Underwater Imaging21 Mar 2022
12 newest of 13 All 13 (JSON)