Smoothing the Disentangled Latent Style Space for Unsupervised Image-to-Image Translation
Not on the map. Why?
Abstract (arXiv)
Image-to-Image (I2I) multi-domain translation models are usually evaluated also using the quality of their semantic interpolation results. However, state-of-the-art models frequently show abrupt changes in the image appearance during interpolation, and usually perform poorly in interpolations across domains. In this paper, we propose a new training protocol based on three specific losses which help a translation network to learn a smooth and disentangled latent style space in which: 1) Both intra- and inter-domain interpolations correspond to gradual changes in the generated images and 2) The content of the source image is better preserved during the translation. Moreover, we propose a novel evaluation metric to properly measure the smoothness of latent style space of I2I translation models. The proposed method can be plugged into existing translation approaches, and our extensive experiments on different datasets show that it can significantly boost the quality of the generated images and the graduality of the interpolations.
Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). Builds on 38 of its 47 references that are in the map. First posted on arXiv 16 Jun 2021.
Builds on
38 of 47 references.
References · 38
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,095
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
- 2017VGGFace2: A dataset for recognising faces across pose and agecited by 911
26 more
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2017In Defense of the Triplet Loss for Person Re-Identificationcited by 784
- 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
- 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
- 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 691
- 2017Unsupervised Image-to-Image Translation Networkscited by 602
- 2020In-Domain GAN Inversion for Real Image Editingcited by 420
- 2018Diverse Image-to-Image Translation via Disentangled Representationscited by 296
- 2017Toward Multimodal Image-to-Image Translationcited by 295
- 2017Learning to Discover Cross-Domain Relations with Generative Adversarial Networkscited by 278
- 2019On the "steerability" of generative adversarial networkscited by 247
- 2019DRIT++: Diverse Image-to-Image Translation via Disentangled Representationscited by 244
- 2019Few-Shot Unsupervised Image-to-Image Translationcited by 222
- 2018DLOW: Domain Flow for Adaptation and Generalizationcited by 176
- 2017Latent Space Oddity: on the Curvature of Deep Generative Modelscited by 169
- 2017Optimizing the Latent Space of Generative Networkscited by 157
- 2019Mode Seeking Generative Adversarial Networks for Diverse Image Synthesiscited by 138
- 2019From Variational to Deterministic Autoencoderscited by 131
- 2016Unsupervised Cross-Domain Image Generationcited by 125
- 2018Understanding and Improving Interpolation in Autoencoders via an Adversarial Regularizercited by 87
- 2018Unsupervised Attention-guided Image to Image Translationcited by 58
- 2019RelGAN: Multi-Domain Image-to-Image Translation via Relative Attributescited by 56
- 2020Rethinking the Truly Unsupervised Image-to-Image Translationcited by 56
- 2020Describe What to Change: A Text-guided Unsupervised Image-to-Image Translation Approachcited by 29
- 2019Appearance and Pose-Conditioned Human Image Generation using Deformable GANscited by 24
- 2018SMIT: Stochastic Multi-Label Image-to-Image Translationcited by 21
Built on by
Citing papers per year: 2021: 4; 2022: 9; 2023: 10; 2024: 9; 2025: 3.
35 papers.
Sort:
By area:
- 2022Disentangled Representation Learningcited by 111
- 2021Predict, Prevent, and Evaluate: Disentangled Text-Driven Image Manipulation Empowered by Pre-Trained Vision-Language Modelcited by 34
- 2023General Image-to-Image Translation with One-Shot Image Guidancecited by 31
- 2022InstaFormer: Instance-Aware Image-to-Image Translation with Transformercited by 28
- 2022A Style-aware Discriminator for Controllable Image Translationcited by 16
- 2021Click to Move: Controlling Video Generation with Sparse Motioncited by 11
- 2022Region-aware Knowledge Distillation for Efficient Image-to-Image Translationcited by 10
- 2023StylerDALLE: Language-Guided Style Transfer Using a Vector-Quantized Tokenizer of a Large-Scale Generative Modelcited by 10
- 2021Physics-informed Guided Disentanglement in Generative Networkscited by 9
- 2021ISF-GAN: An Implicit Style Function for High-Resolution Image-to-Image Translationcited by 9
- 2024Closed-Loop Unsupervised Representation Disentanglement with β-VAE Distillation and Diffusion Probabilistic Feedbackcited by 9
- 2025Hessian Geometry of Latent Space in Generative Modelscited by 9
23 more
- 2022Training and Tuning Generative Neural Radiance Fields for Attribute-Conditional 3D-Aware Face Generationcited by 8
- 2024C-DiffSET: Leveraging Latent Diffusion for SAR-to-EO Image Translation with Confidence-Guided Reliable Object Generationcited by 8
- 2023Causal Disentangled Variational Auto-Encoder for Preference Understanding in Recommendationcited by 7
- 2024Learning at a Glance: Towards Interpretable Data-limited Continual Semantic Segmentation via Semantic-Invariance Modellingcited by 6
- 2022LANIT: Language-Driven Image-to-Image Translation for Unlabeled Datacited by 5
- 2024Path-GPTOmic: A Balanced Multi-modal Learning Framework for Survival Outcome Predictioncited by 5
- 2023Fix the Noise: Disentangling Source Feature for Controllable Domain Translationcited by 4
- 2022A comprehensive survey on semantic facial attribute editing using generative adversarial networkscited by 3
- 2023SpectralCLIP: Preventing Artifacts in Text-Guided Style Transfer from a Spectral Perspectivecited by 3
- 2022Contrastive Monotonic Pixel-Level Modulationcited by 2
- 20233D-Aware Multi-Class Image-to-Image Translation with NeRFscited by 2
- 2023Domain-Scalable Unpaired Image Translation via Latent Space Anchoringcited by 2
- 2024CoroNetGAN: Controlled Pruning of GANs via Hypernetworkscited by 2
- 2024Content-Style Learning from Unaligned Domains: Identifiability under Unknown Latent Dimensionscited by 2
- 2022ChildPredictor: A Child Face Prediction Framework with Disentangled Learningcited by 1
- 2023Panoramic Image-to-Image Translationcited by 1
- 2023UTSGAN: Unseen Transition Suss GAN for Transition-Aware Image-to-image Translationcited by 1
- 2023Progressive Energy-Based Cooperative Learning for Multi-Domain Image-to-Image Translationcited by 1
- 2024Generative Quanta Color Imagingcited by 1
- 2024Transferring disentangled representations: bridging the gap between synthetic and real imagescited by 1
- 2024Graph Residual based Method for Molecular Property Predictioncited by 0
- 2025Adversarial Wear and Tear: Exploiting Natural Damage for Generating Physical-World Adversarial Examplescited by 0
- 2025Modality-Collaborative Low-Rank Decomposers for Few-Shot Video Domain Adaptationcited by 0
- 2025Modality-Collaborative Low-Rank Decomposers for Few-Shot Video Domain Adaptation24 Nov 2025
- 2025Hessian Geometry of Latent Space in Generative Models12 Jun 2025
- 2025Adversarial Wear and Tear: Exploiting Natural Damage for Generating Physical-World Adversarial Examples27 Mar 2025
- 2024C-DiffSET: Leveraging Latent Diffusion for SAR-to-EO Image Translation with Confidence-Guided Reliable Object Generation16 Nov 2024
- 2024Content-Style Learning from Unaligned Domains: Identifiability under Unknown Latent Dimensions6 Nov 2024
- 2024Transferring disentangled representations: bridging the gap between synthetic and real images26 Sep 2024
- 2024Graph Residual based Method for Molecular Property Prediction27 Jul 2024
- 2024Learning at a Glance: Towards Interpretable Data-limited Continual Semantic Segmentation via Semantic-Invariance Modelling22 Jul 2024
- 2024Generative Quanta Color Imaging28 Mar 2024
- 2024Path-GPTOmic: A Balanced Multi-modal Learning Framework for Survival Outcome Prediction18 Mar 2024
- 2024CoroNetGAN: Controlled Pruning of GANs via Hypernetworks13 Mar 2024
- 2024Closed-Loop Unsupervised Representation Disentanglement with β-VAE Distillation and Diffusion Probabilistic Feedback4 Feb 2024
23 more
- 2023General Image-to-Image Translation with One-Shot Image Guidance20 Jul 2023
- 2023Domain-Scalable Unpaired Image Translation via Latent Space Anchoring26 Jun 2023
- 2023Progressive Energy-Based Cooperative Learning for Multi-Domain Image-to-Image Translation26 Jun 2023
- 2023UTSGAN: Unseen Transition Suss GAN for Transition-Aware Image-to-image Translation24 Apr 2023
- 2023Causal Disentangled Variational Auto-Encoder for Preference Understanding in Recommendation17 Apr 2023
- 2023Panoramic Image-to-Image Translation11 Apr 2023
- 20233D-Aware Multi-Class Image-to-Image Translation with NeRFs27 Mar 2023
- 2023Fix the Noise: Disentangling Source Feature for Controllable Domain Translation21 Mar 2023
- 2023SpectralCLIP: Preventing Artifacts in Text-Guided Style Transfer from a Spectral Perspective16 Mar 2023
- 2023StylerDALLE: Language-Guided Style Transfer Using a Vector-Quantized Tokenizer of a Large-Scale Generative Model16 Mar 2023
- 2022Disentangled Representation Learning21 Nov 2022
- 2022LANIT: Language-Driven Image-to-Image Translation for Unlabeled Data31 Aug 2022
- 2022Training and Tuning Generative Neural Radiance Fields for Attribute-Conditional 3D-Aware Face Generation26 Aug 2022
- 2022Contrastive Monotonic Pixel-Level Modulation23 Jul 2022
- 2022Region-aware Knowledge Distillation for Efficient Image-to-Image Translation25 May 2022
- 2022A comprehensive survey on semantic facial attribute editing using generative adversarial networks21 May 2022
- 2022ChildPredictor: A Child Face Prediction Framework with Disentangled Learning21 Apr 2022
- 2022InstaFormer: Instance-Aware Image-to-Image Translation with Transformer30 Mar 2022
- 2022A Style-aware Discriminator for Controllable Image Translation29 Mar 2022
- 2021Predict, Prevent, and Evaluate: Disentangled Text-Driven Image Manipulation Empowered by Pre-Trained Vision-Language Model26 Nov 2021
- 2021ISF-GAN: An Implicit Style Function for High-Resolution Image-to-Image Translation26 Sep 2021
- 2021Click to Move: Controlling Video Generation with Sparse Motion19 Aug 2021
- 2021Physics-informed Guided Disentanglement in Generative Networks29 Jul 2021
- 2024Closed-Loop Unsupervised Representation Disentanglement with β-VAE Distillation and Diffusion Probabilistic Feedbackcited by 9
- 2025Hessian Geometry of Latent Space in Generative Modelscited by 9
- 2024C-DiffSET: Leveraging Latent Diffusion for SAR-to-EO Image Translation with Confidence-Guided Reliable Object Generationcited by 8
- 2025Hessian Geometry of Latent Space in Generative Models12 Jun 2025
- 2024C-DiffSET: Leveraging Latent Diffusion for SAR-to-EO Image Translation with Confidence-Guided Reliable Object Generation16 Nov 2024
- 2024Closed-Loop Unsupervised Representation Disentanglement with β-VAE Distillation and Diffusion Probabilistic Feedback4 Feb 2024
- 2022Disentangled Representation Learningcited by 111
- 2023General Image-to-Image Translation with One-Shot Image Guidancecited by 31
- 2022InstaFormer: Instance-Aware Image-to-Image Translation with Transformercited by 28
- 2022A Style-aware Discriminator for Controllable Image Translationcited by 16
- 2021Click to Move: Controlling Video Generation with Sparse Motioncited by 11
- 2022Region-aware Knowledge Distillation for Efficient Image-to-Image Translationcited by 10
- 2023StylerDALLE: Language-Guided Style Transfer Using a Vector-Quantized Tokenizer of a Large-Scale Generative Modelcited by 10
- 2021Physics-informed Guided Disentanglement in Generative Networkscited by 9
- 2021ISF-GAN: An Implicit Style Function for High-Resolution Image-to-Image Translationcited by 9
- 2022Training and Tuning Generative Neural Radiance Fields for Attribute-Conditional 3D-Aware Face Generationcited by 8
- 2023Causal Disentangled Variational Auto-Encoder for Preference Understanding in Recommendationcited by 7
- 2024Learning at a Glance: Towards Interpretable Data-limited Continual Semantic Segmentation via Semantic-Invariance Modellingcited by 6
12 most cited of 30 All 30 (JSON)
- 2025Modality-Collaborative Low-Rank Decomposers for Few-Shot Video Domain Adaptation24 Nov 2025
- 2025Adversarial Wear and Tear: Exploiting Natural Damage for Generating Physical-World Adversarial Examples27 Mar 2025
- 2024Content-Style Learning from Unaligned Domains: Identifiability under Unknown Latent Dimensions6 Nov 2024
- 2024Transferring disentangled representations: bridging the gap between synthetic and real images26 Sep 2024
- 2024Graph Residual based Method for Molecular Property Prediction27 Jul 2024
- 2024Learning at a Glance: Towards Interpretable Data-limited Continual Semantic Segmentation via Semantic-Invariance Modelling22 Jul 2024
- 2024Generative Quanta Color Imaging28 Mar 2024
- 2024Path-GPTOmic: A Balanced Multi-modal Learning Framework for Survival Outcome Prediction18 Mar 2024
- 2024CoroNetGAN: Controlled Pruning of GANs via Hypernetworks13 Mar 2024
- 2023General Image-to-Image Translation with One-Shot Image Guidance20 Jul 2023
- 2023Domain-Scalable Unpaired Image Translation via Latent Space Anchoring26 Jun 2023
- 2023Progressive Energy-Based Cooperative Learning for Multi-Domain Image-to-Image Translation26 Jun 2023
12 newest of 30 All 30 (JSON)