mlsanityData to 7 Oct 2026

Smoothing the Disentangled Latent Style Space for Unsupervised Image-to-Image Translation

arXiv 2106.09016 ↗First posted 16 Jun 2021cs.CV cs.LGcited by 35

Not on the map. Why?

Abstract (arXiv)

Image-to-Image (I2I) multi-domain translation models are usually evaluated also using the quality of their semantic interpolation results. However, state-of-the-art models frequently show abrupt changes in the image appearance during interpolation, and usually perform poorly in interpolations across domains. In this paper, we propose a new training protocol based on three specific losses which help a translation network to learn a smooth and disentangled latent style space in which: 1) Both intra- and inter-domain interpolations correspond to gradual changes in the generated images and 2) The content of the source image is better preserved during the translation. Moreover, we propose a novel evaluation metric to properly measure the smoothness of latent style space of I2I translation models. The proposed method can be plugged into existing translation approaches, and our extensive experiments on different datasets show that it can significantly boost the quality of the generated images and the graduality of the interpolations.

Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). Builds on 38 of its 47 references that are in the map. First posted on arXiv 16 Jun 2021.

Builds on

38 of 47 references.

References · 38

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  2. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  3. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  4. 2013Auto-Encoding Variational Bayescited by 3,980
  5. 2014Deep Learning Face Attributes in the Wildcited by 3,679
  6. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  7. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  8. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
  9. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
  10. 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,095
  11. 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
  12. 2017VGGFace2: A dataset for recognising faces across pose and agecited by 911
26 more
  1. 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
  2. 2017In Defense of the Triplet Loss for Person Re-Identificationcited by 784
  3. 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
  4. 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
  5. 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 691
  6. 2017Unsupervised Image-to-Image Translation Networkscited by 602
  7. 2020In-Domain GAN Inversion for Real Image Editingcited by 420
  8. 2018Diverse Image-to-Image Translation via Disentangled Representationscited by 296
  9. 2017Toward Multimodal Image-to-Image Translationcited by 295
  10. 2017Learning to Discover Cross-Domain Relations with Generative Adversarial Networkscited by 278
  11. 2019On the "steerability" of generative adversarial networkscited by 247
  12. 2019DRIT++: Diverse Image-to-Image Translation via Disentangled Representationscited by 244
  13. 2019Few-Shot Unsupervised Image-to-Image Translationcited by 222
  14. 2018DLOW: Domain Flow for Adaptation and Generalizationcited by 176
  15. 2017Latent Space Oddity: on the Curvature of Deep Generative Modelscited by 169
  16. 2017Optimizing the Latent Space of Generative Networkscited by 157
  17. 2019Mode Seeking Generative Adversarial Networks for Diverse Image Synthesiscited by 138
  18. 2019From Variational to Deterministic Autoencoderscited by 131
  19. 2016Unsupervised Cross-Domain Image Generationcited by 125
  20. 2018Understanding and Improving Interpolation in Autoencoders via an Adversarial Regularizercited by 87
  21. 2018Unsupervised Attention-guided Image to Image Translationcited by 58
  22. 2019RelGAN: Multi-Domain Image-to-Image Translation via Relative Attributescited by 56
  23. 2020Rethinking the Truly Unsupervised Image-to-Image Translationcited by 56
  24. 2020Describe What to Change: A Text-guided Unsupervised Image-to-Image Translation Approachcited by 29
  25. 2019Appearance and Pose-Conditioned Human Image Generation using Deformable GANscited by 24
  26. 2018SMIT: Stochastic Multi-Label Image-to-Image Translationcited by 21

Built on by

Cited by year

Citing papers per year: 2021: 4; 2022: 9; 2023: 10; 2024: 9; 2025: 3.

35 papers.

Sort:

By area:

  1. 2022Disentangled Representation Learningcited by 111
  2. 2021Predict, Prevent, and Evaluate: Disentangled Text-Driven Image Manipulation Empowered by Pre-Trained Vision-Language Modelcited by 34
  3. 2023General Image-to-Image Translation with One-Shot Image Guidancecited by 31
  4. 2022InstaFormer: Instance-Aware Image-to-Image Translation with Transformercited by 28
  5. 2022A Style-aware Discriminator for Controllable Image Translationcited by 16
  6. 2021Click to Move: Controlling Video Generation with Sparse Motioncited by 11
  7. 2022Region-aware Knowledge Distillation for Efficient Image-to-Image Translationcited by 10
  8. 2023StylerDALLE: Language-Guided Style Transfer Using a Vector-Quantized Tokenizer of a Large-Scale Generative Modelcited by 10
  9. 2021Physics-informed Guided Disentanglement in Generative Networkscited by 9
  10. 2021ISF-GAN: An Implicit Style Function for High-Resolution Image-to-Image Translationcited by 9
  11. 2024Closed-Loop Unsupervised Representation Disentanglement with β-VAE Distillation and Diffusion Probabilistic Feedbackcited by 9
  12. 2025Hessian Geometry of Latent Space in Generative Modelscited by 9
23 more
  1. 2022Training and Tuning Generative Neural Radiance Fields for Attribute-Conditional 3D-Aware Face Generationcited by 8
  2. 2024C-DiffSET: Leveraging Latent Diffusion for SAR-to-EO Image Translation with Confidence-Guided Reliable Object Generationcited by 8
  3. 2023Causal Disentangled Variational Auto-Encoder for Preference Understanding in Recommendationcited by 7
  4. 2024Learning at a Glance: Towards Interpretable Data-limited Continual Semantic Segmentation via Semantic-Invariance Modellingcited by 6
  5. 2022LANIT: Language-Driven Image-to-Image Translation for Unlabeled Datacited by 5
  6. 2024Path-GPTOmic: A Balanced Multi-modal Learning Framework for Survival Outcome Predictioncited by 5
  7. 2023Fix the Noise: Disentangling Source Feature for Controllable Domain Translationcited by 4
  8. 2022A comprehensive survey on semantic facial attribute editing using generative adversarial networkscited by 3
  9. 2023SpectralCLIP: Preventing Artifacts in Text-Guided Style Transfer from a Spectral Perspectivecited by 3
  10. 2022Contrastive Monotonic Pixel-Level Modulationcited by 2
  11. 20233D-Aware Multi-Class Image-to-Image Translation with NeRFscited by 2
  12. 2023Domain-Scalable Unpaired Image Translation via Latent Space Anchoringcited by 2
  13. 2024CoroNetGAN: Controlled Pruning of GANs via Hypernetworkscited by 2
  14. 2024Content-Style Learning from Unaligned Domains: Identifiability under Unknown Latent Dimensionscited by 2
  15. 2022ChildPredictor: A Child Face Prediction Framework with Disentangled Learningcited by 1
  16. 2023Panoramic Image-to-Image Translationcited by 1
  17. 2023UTSGAN: Unseen Transition Suss GAN for Transition-Aware Image-to-image Translationcited by 1
  18. 2023Progressive Energy-Based Cooperative Learning for Multi-Domain Image-to-Image Translationcited by 1
  19. 2024Generative Quanta Color Imagingcited by 1
  20. 2024Transferring disentangled representations: bridging the gap between synthetic and real imagescited by 1
  21. 2024Graph Residual based Method for Molecular Property Predictioncited by 0
  22. 2025Adversarial Wear and Tear: Exploiting Natural Damage for Generating Physical-World Adversarial Examplescited by 0
  23. 2025Modality-Collaborative Low-Rank Decomposers for Few-Shot Video Domain Adaptationcited by 0