A Style-aware Discriminator for Controllable Image Translation
Not on the map. Why?
Abstract (arXiv)
Current image-to-image translations do not control the output domain beyond the classes used during training, nor do they interpolate between different domains well, leading to implausible results. This limitation largely arises because labels do not consider the semantic distance. To mitigate such problems, we propose a style-aware discriminator that acts as a critic as well as a style encoder to provide conditions. The style-aware discriminator learns a controllable style space using prototype-based self-supervised learning and simultaneously guides the generator. Experiments on multiple datasets verify that the proposed model outperforms current state-of-the-art image-to-image translation methods. In contrast with current methods, the proposed approach supports various applications, including style interpolation, content transplantation, and local image translation.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 41 of its 45 references that are in the map. First posted on arXiv 29 Mar 2022.
Builds on
41 of 45 references.
References · 41
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2022Generative Adversarial Networkscited by 5,603
- 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
29 more
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,623
- 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,350
- 2018Demystifying MMD GANscited by 1,268
- 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
- 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,095
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
- 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 990
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
- 2018Which Training Methods for GANs do actually Converge?cited by 672
- 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 637
- 2020Prototypical Contrastive Learning of Unsupervised Representationscited by 636
- 2020In-Domain GAN Inversion for Real Image Editingcited by 420
- 2019Image2StyleGAN++: How to Edit the Embedded Images?cited by 356
- 2019Few-Shot Unsupervised Image-to-Image Translationcited by 222
- 2020Swapping Autoencoder for Deep Image Manipulationcited by 215
- 2021Towards Faster and Stabilized GAN Training for High-fidelity Few-shot Image Synthesiscited by 140
- 2018Self-Supervised GANs via Auxiliary Rotation Losscited by 94
- 2021Exploiting Spatial Dimensions of Latent in GAN for Real-time Image Editingcited by 91
- 2020Rethinking the Truly Unsupervised Image-to-Image Translationcited by 56
- 2021On Aliased Resizing and Surprising Subtleties in GAN Evaluationcited by 51
- 2021Training GANs with Stronger Augmentations via Contrastive Discriminatorcited by 45
- 2020COCO-FUNIT: Few-Shot Unsupervised Image Translation with a Content Conditioned Style Encodercited by 39
- 2021Smoothing the Disentangled Latent Style Space for Unsupervised Image-to-Image Translationcited by 35
- 2019Exploring Unlabeled Faces for Novel Attribute Discoverycited by 8
- 2021Contrastive Learning for Unsupervised Image-to-Image Translationcited by 7
- 2021FA-GAN: Feature-Aware GAN for Text to Image Synthesiscited by 2
Built on by
Citing papers per year: 2022: 2; 2023: 6; 2024: 5; 2025: 3.
16 papers.
Sort:
By area:
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
- 2025AnyTouch: Learning Unified Static-Dynamic Representation across Multiple Visuo-tactile Sensorscited by 46
- 2023GP-UNIT: Generative Prior for Versatile Unsupervised Image-to-Image Translationcited by 9
- 2023Conditional 360-degree Image Synthesis for Immersive Indoor Scene Decorationcited by 9
- 2024Exploring Generative AI for Sim2Real in Driving Data Synthesiscited by 7
- 2022LANIT: Language-Driven Image-to-Image Translation for Unlabeled Datacited by 5
- 2023Disentangling Structure and Appearance in ViT Feature Spacecited by 5
- 2024Image Translation as Diffusion Visual Programmerscited by 5
- 2023Spatial-temporal Transformer-guided Diffusion based Data Augmentation for Efficient Skeleton-based Action Recognitioncited by 4
- 2023Restoring Images Captured in Arbitrary Hybrid Adverse Weather Conditions in One Gocited by 4
- 2024Unpaired Volumetric Harmonization of Brain MRI with Conditional Latent Diffusioncited by 4
- 2025Contrastive Learning Guided Latent Diffusion Model for Image-to-Image Translationcited by 3
4 more
- 20233D-Aware Multi-Class Image-to-Image Translation with NeRFscited by 2
- 2024Disentangling Racial Phenotypes: Fine-Grained Control of Race-related Facial Phenotype Characteristicscited by 1
- 2024An Analysis for Image-to-Image Translation and Style Transfercited by 1
- 2025Image Translation with Kernel Prediction Networks for Semantic Segmentationcited by 0
- 2025Image Translation with Kernel Prediction Networks for Semantic Segmentation11 Jul 2025
- 2025Contrastive Learning Guided Latent Diffusion Model for Image-to-Image Translation26 Mar 2025
- 2025AnyTouch: Learning Unified Static-Dynamic Representation across Multiple Visuo-tactile Sensors15 Feb 2025
- 2024Unpaired Volumetric Harmonization of Brain MRI with Conditional Latent Diffusion18 Aug 2024
- 2024An Analysis for Image-to-Image Translation and Style Transfer12 Aug 2024
- 2024Exploring Generative AI for Sim2Real in Driving Data Synthesis14 Apr 2024
- 2024Disentangling Racial Phenotypes: Fine-Grained Control of Race-related Facial Phenotype Characteristics29 Mar 2024
- 2024Image Translation as Diffusion Visual Programmers18 Jan 2024
- 2023Disentangling Structure and Appearance in ViT Feature Space20 Nov 2023
- 2023Conditional 360-degree Image Synthesis for Immersive Indoor Scene Decoration18 Jul 2023
- 2023GP-UNIT: Generative Prior for Versatile Unsupervised Image-to-Image Translation7 Jun 2023
- 2023Restoring Images Captured in Arbitrary Hybrid Adverse Weather Conditions in One Go17 May 2023
4 more
- 20233D-Aware Multi-Class Image-to-Image Translation with NeRFs27 Mar 2023
- 2023Spatial-temporal Transformer-guided Diffusion based Data Augmentation for Efficient Skeleton-based Action Recognition26 Feb 2023
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translation22 Nov 2022
- 2022LANIT: Language-Driven Image-to-Image Translation for Unlabeled Data31 Aug 2022
- 2023Spatial-temporal Transformer-guided Diffusion based Data Augmentation for Efficient Skeleton-based Action Recognitioncited by 4
- 2024Unpaired Volumetric Harmonization of Brain MRI with Conditional Latent Diffusioncited by 4
- 2025Contrastive Learning Guided Latent Diffusion Model for Image-to-Image Translationcited by 3
- 2025Contrastive Learning Guided Latent Diffusion Model for Image-to-Image Translation26 Mar 2025
- 2024Unpaired Volumetric Harmonization of Brain MRI with Conditional Latent Diffusion18 Aug 2024
- 2023Spatial-temporal Transformer-guided Diffusion based Data Augmentation for Efficient Skeleton-based Action Recognition26 Feb 2023
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
- 2025AnyTouch: Learning Unified Static-Dynamic Representation across Multiple Visuo-tactile Sensorscited by 46
- 2023GP-UNIT: Generative Prior for Versatile Unsupervised Image-to-Image Translationcited by 9
- 2023Conditional 360-degree Image Synthesis for Immersive Indoor Scene Decorationcited by 9
- 2024Exploring Generative AI for Sim2Real in Driving Data Synthesiscited by 7
- 2022LANIT: Language-Driven Image-to-Image Translation for Unlabeled Datacited by 5
- 2023Disentangling Structure and Appearance in ViT Feature Spacecited by 5
- 2024Image Translation as Diffusion Visual Programmerscited by 5
- 2023Restoring Images Captured in Arbitrary Hybrid Adverse Weather Conditions in One Gocited by 4
- 20233D-Aware Multi-Class Image-to-Image Translation with NeRFscited by 2
- 2024Disentangling Racial Phenotypes: Fine-Grained Control of Race-related Facial Phenotype Characteristicscited by 1
- 2024An Analysis for Image-to-Image Translation and Style Transfercited by 1
12 most cited of 13 All 13 (JSON)
- 2025Image Translation with Kernel Prediction Networks for Semantic Segmentation11 Jul 2025
- 2025AnyTouch: Learning Unified Static-Dynamic Representation across Multiple Visuo-tactile Sensors15 Feb 2025
- 2024An Analysis for Image-to-Image Translation and Style Transfer12 Aug 2024
- 2024Exploring Generative AI for Sim2Real in Driving Data Synthesis14 Apr 2024
- 2024Disentangling Racial Phenotypes: Fine-Grained Control of Race-related Facial Phenotype Characteristics29 Mar 2024
- 2024Image Translation as Diffusion Visual Programmers18 Jan 2024
- 2023Disentangling Structure and Appearance in ViT Feature Space20 Nov 2023
- 2023Conditional 360-degree Image Synthesis for Immersive Indoor Scene Decoration18 Jul 2023
- 2023GP-UNIT: Generative Prior for Versatile Unsupervised Image-to-Image Translation7 Jun 2023
- 2023Restoring Images Captured in Arbitrary Hybrid Adverse Weather Conditions in One Go17 May 2023
- 20233D-Aware Multi-Class Image-to-Image Translation with NeRFs27 Mar 2023
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translation22 Nov 2022
12 newest of 13 All 13 (JSON)