ISF-GAN: An Implicit Style Function for High-Resolution Image-to-Image Translation
Not on the map. Why?
Abstract (arXiv)
Recently, there has been an increasing interest in image editing methods that employ pre-trained unconditional image generators (e.g., StyleGAN). However, applying these methods to translate images to multiple visual domains remains challenging. Existing works do not often preserve the domain-invariant part of the image (e.g., the identity in human face translations), they do not usually handle multiple domains, or do not allow for multi-modal translations. This work proposes an implicit style function (ISF) to straightforwardly achieve multi-modal and multi-domain image-to-image translation from pre-trained unconditional generators. The ISF manipulates the semantics of an input latent code to make the image generated from it lying in the desired visual domain. Our results in human face and animal manipulations show significantly improved results over the baselines. Our model enables cost-effective multi-modal unsupervised image-to-image translations at high resolution using pre-trained unconditional GANs. The code and data are available at: urlhttps://github.com/yhlleo/stylegan-mmuit.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 51 of its 66 references that are in the map. First posted on arXiv 26 Sep 2021.
Builds on
51 of 66 references.
References · 51
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2016Layer Normalizationcited by 5,579
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
38 more
- 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,187
- 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,095
- 2017CyCADA: Cycle-Consistent Adversarial Domain Adaptationcited by 1,079
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
- 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
- 2020First Order Motion Model for Image Animationcited by 698
- 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 691
- 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
- 2018Which Training Methods for GANs do actually Converge?cited by 672
- 2020GANSpace: Discovering Interpretable GAN Controlscited by 612
- 2017Unsupervised Image-to-Image Translation Networkscited by 602
- 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 523
- 2020InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANscited by 393
- 2020PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Modelscited by 358
- 2019Image2StyleGAN++: How to Edit the Embedded Images?cited by 356
- 2020StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flowscited by 348
- 2020StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generationcited by 331
- 2018Diverse Image-to-Image Translation via Disentangled Representationscited by 296
- 2017Toward Multimodal Image-to-Image Translationcited by 295
- 2019DRIT++: Diverse Image-to-Image Translation via Disentangled Representationscited by 244
- 2019Controllable Text-to-Image Generationcited by 187
- 2020Editing in Style: Uncovering the Local Semantics of GANscited by 183
- 2017Deformable GANs for Pose-based Human Image Generationcited by 166
- 2021A Good Image Generator Is What You Need for High-Resolution Video Synthesiscited by 162
- 2018GANimation: Anatomically-aware Facial Animation from a Single Imagecited by 160
- 2019Mode Seeking Generative Adversarial Networks for Diverse Image Synthesiscited by 138
- 2019SC-FEGAN: Face Editing Generative Adversarial Network with User's Sketch and Colorcited by 105
- 2020Image GANs meet Differentiable Rendering for Inverse Graphics and Interpretable 3D Neural Renderingcited by 101
- 2020Collaborative Learning for Faster StyleGAN Embeddingcited by 65
- 2020Do 2D GANs Know 3D Shape? Unsupervised 3D shape reconstruction from 2D Image GANscited by 63
- 2021Using latent space regression to analyze and leverage compositionality in GANscited by 55
- 2021Labels4Free: Unsupervised Segmentation using StyleGANcited by 53
- 2018Context-Aware Synthesis and Placement of Object Instancescited by 41
- 2021Smoothing the Disentangled Latent Style Space for Unsupervised Image-to-Image Translationcited by 35
- 2020Describe What to Change: A Text-guided Unsupervised Image-to-Image Translation Approachcited by 29
- 2020GMM-UNIT: Unsupervised Multi-Domain and Multi-Modal Image-to-Image Translation via Attribute Gaussian Mixture Modelingcited by 11
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2021: 1; 2022: 4; 2023: 2; 2024: 1; 2025: 1.
9 papers.
- 2022Semantic Image Synthesis via Diffusion Modelscited by 131
- 20223D-LDM: Neural Implicit 3D Shape Generation with Latent Diffusion Modelscited by 67
- 2023Text-guided Eyeglasses Manipulation with Spatial Constraintscited by 10
- 2022Training and Tuning Generative Neural Radiance Fields for Attribute-Conditional 3D-Aware Face Generationcited by 8
- 2021DRAN: Detailed Region-Adaptive Normalization for Conditional Image Synthesiscited by 6
- 2022A comprehensive survey on semantic facial attribute editing using generative adversarial networkscited by 3
- 2023Identity-preserving Editing of Multiple Facial Attributes by Learning Global Edit Directions and Local Adjustmentscited by 2
- 2024Tex-ViT: A Generalizable, Robust, Texture-based dual-branch cross-attention deepfake detectorcited by 2
- 2025StyleMorpheus: A Style-Based 3D-Aware Morphable Face Modelcited by 1
- 2025StyleMorpheus: A Style-Based 3D-Aware Morphable Face Model14 Mar 2025
- 2024Tex-ViT: A Generalizable, Robust, Texture-based dual-branch cross-attention deepfake detector29 Aug 2024
- 2023Identity-preserving Editing of Multiple Facial Attributes by Learning Global Edit Directions and Local Adjustments25 Sep 2023
- 2023Text-guided Eyeglasses Manipulation with Spatial Constraints25 Apr 2023
- 20223D-LDM: Neural Implicit 3D Shape Generation with Latent Diffusion Models1 Dec 2022
- 2022Training and Tuning Generative Neural Radiance Fields for Attribute-Conditional 3D-Aware Face Generation26 Aug 2022
- 2022Semantic Image Synthesis via Diffusion Models30 Jun 2022
- 2022A comprehensive survey on semantic facial attribute editing using generative adversarial networks21 May 2022
- 2021DRAN: Detailed Region-Adaptive Normalization for Conditional Image Synthesis29 Sep 2021