Fix the Noise: Disentangling Source Feature for Controllable Domain Translation
Not on the map. Why?
Abstract (arXiv)
Recent studies show strong generative performance in domain translation especially by using transfer learning techniques on the unconditional generator. However, the control between different domain features using a single model is still challenging. Existing methods often require additional models, which is computationally demanding and leads to unsatisfactory visual quality. In addition, they have restricted control steps, which prevents a smooth transition. In this paper, we propose a new approach for high-quality domain translation with better controllability. The key idea is to preserve source features within a disentangled subspace of a target feature space. This allows our method to smoothly control the degree to which it preserves source features while generating images from an entirely new domain using only a single model. Our extensive experiments show that the proposed method can produce more consistent and realistic images than previous works and maintain precise controllability over different levels of transformation. The code is available at https://github.com/LeeDongYeun/FixNoise.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 55 of its 69 references that are in the map. First posted on arXiv 21 Mar 2023.
Builds on
55 of 69 references.
References · 55
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
- 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,355
- 2018Demystifying MMD GANscited by 1,293
- 2020Training Generative Adversarial Networks with Limited Datacited by 1,186
- 2021Alias-Free Generative Adversarial Networkscited by 1,184
- 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,179
38 more
- 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,098
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,039
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
- 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
- 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
- 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 639
- 2020GANSpace: Discovering Interpretable GAN Controlscited by 614
- 2017Unsupervised Image-to-Image Translation Networkscited by 603
- 2021Designing an Encoder for StyleGAN Image Manipulationcited by 544
- 2020In-Domain GAN Inversion for Real Image Editingcited by 420
- 2020Closed-Form Factorization of Latent Semantics in GANscited by 408
- 2019Image2StyleGAN++: How to Edit the Embedded Images?cited by 356
- 2020StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generationcited by 332
- 2017Toward Multimodal Image-to-Image Translationcited by 296
- 2018Diverse Image-to-Image Translation via Disentangled Representationscited by 296
- 2019Few-Shot Unsupervised Image-to-Image Translationcited by 222
- 2021HyperStyle: StyleGAN Inversion with HyperNetworks for Real Image Editingcited by 208
- 2021High-Fidelity GAN Inversion for Image Attribute Editingcited by 197
- 2019U-GAT-IT: Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translationcited by 186
- 2016Inverting The Generator Of A Generative Adversarial Networkcited by 140
- 2018Avatar-Net: Multi-scale Zero-shot Style Transfer by Feature Decorationcited by 115
- 2020Resolution Dependent GAN Interpolation for Controllable Image Synthesis Between Domainscited by 96
- 2017StyleBank: An Explicit Representation for Neural Image Style Transfercited by 89
- 2021HyperInverter: Improving StyleGAN Inversion via Hypernetworkcited by 85
- 2020Generative Hierarchical Features from Synthesizing Imagescited by 83
- 2019PSGAN: Pose and Expression Robust Spatial-Aware GAN for Customizable Makeup Transfercited by 66
- 2021The Spatially-Correlative Loss for Various Image Translation Taskscited by 66
- 2022Pastiche Master: Exemplar-Based High-Resolution Portrait Style Transfercited by 66
- 2019LADN: Local Adversarial Disentangling Network for Facial Makeup and De-Makeupcited by 64
- 2018A Style-Aware Content Loss for Real-time HD Style Transfercited by 58
- 2021StyleAlign: Analysis and Applications of Aligned StyleGAN Modelscited by 48
- 2021BlendGAN: Implicitly GAN Blending for Arbitrary Stylized Face Generationcited by 47
- 2019Breaking the cycle -- Colleagues are all you needcited by 40
- 2022Style Transformer for Image Inversion and Editingcited by 37
- 2020Unsupervised Image-to-Image Translation via Pre-trained StyleGAN2 Networkcited by 36
- 2021Smoothing the Disentangled Latent Style Space for Unsupervised Image-to-Image Translationcited by 35
- 2018WarpGAN: Automatic Caricature Generationcited by 28
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2023: 1; 2024: 3.
4 papers.
- 2023Expanding Expressiveness of Diffusion Models with Limited Data via Self-Distillation based Fine-Tuningcited by 11
- 2024BeautyBank: Encoding Facial Makeup in Latent Spacecited by 4
- 2024Unlocking the Capabilities of Masked Generative Models for Image Synthesis via Self-Guidancecited by 3
- 2024ToonAging: Face Re-Aging upon Artistic Portrait Style Transfercited by 2
- 2024BeautyBank: Encoding Facial Makeup in Latent Space18 Nov 2024
- 2024Unlocking the Capabilities of Masked Generative Models for Image Synthesis via Self-Guidance17 Oct 2024
- 2024ToonAging: Face Re-Aging upon Artistic Portrait Style Transfer5 Feb 2024
- 2023Expanding Expressiveness of Diffusion Models with Limited Data via Self-Distillation based Fine-Tuning2 Nov 2023