An Analysis for Image-to-Image Translation and Style Transfer
Not on the map. Why?
Abstract (arXiv)
With the development of generative technologies in deep learning, a large number of image-to-image translation and style transfer models have emerged at an explosive rate in recent years. These two technologies have made significant progress and can generate realistic images. However, many communities tend to confuse the two, because both generate the desired image based on the input image and both cover the two definitions of content and style. In fact, there are indeed significant differences between the two, and there is currently a lack of clear explanations to distinguish the two technologies, which is not conducive to the advancement of technology. We hope to serve the entire community by introducing the differences and connections between image-to-image translation and style transfer. The entire discussion process involves the concepts, forms, training modes, evaluation processes, and visualization results of the two technologies. Finally, we conclude that image-to-image translation divides images by domain, and the types of images in the domain are limited, and the scope involved is small, but the conversion ability is strong and can achieve strong semantic changes. Style transfer divides image types by single image, and the scope involved is large, but the transfer ability is limited, and it transfers more texture and color of the image.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 46 of its 59 references that are in the map. First posted on arXiv 12 Aug 2024.
Builds on
46 of 59 references.
References · 46
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2018Demystifying MMD GANscited by 1,268
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
- 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,095
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
34 more
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 637
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
- 2015Autoencoding beyond pixels using a learned similarity metriccited by 407
- 2019SinGAN: Learning a Generative Model from a Single Natural Imagecited by 348
- 2016A Learned Representation For Artistic Stylecited by 340
- 2018Diverse Image-to-Image Translation via Disentangled Representationscited by 296
- 2022Inversion-Based Style Transfer with Diffusion Modelscited by 290
- 2019Few-Shot Unsupervised Image-to-Image Translationcited by 222
- 2018Arbitrary Style Transfer with Style-Attentional Networkscited by 197
- 2019U-GAT-IT: Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translationcited by 186
- 2021StyTr2: Image Style Transfer with Transformerscited by 186
- 2021AdaAttN: Revisit Attention Mechanism in Arbitrary Neural Style Transfercited by 178
- 2021ArtFlow: Unbiased Image Style Transfer via Reversible Neural Flowscited by 113
- 2022Domain Enhanced Arbitrary Image Style Transfer via Contrastive Learningcited by 93
- 2017One-Sided Unsupervised Domain Mappingcited by 91
- 2021The Spatially-Correlative Loss for Various Image Translation Taskscited by 66
- 2021Image-to-image Translation via Hierarchical Style Disentanglementcited by 63
- 2021High-Resolution Photorealistic Image Translation in Real-Time: A Laplacian Pyramid Translation Networkcited by 61
- 2020Reusing Discriminators for Encoding: Towards Unsupervised Image-to-Image Translationcited by 60
- 2017Diversified Texture Synthesis with Feed-forward Networkscited by 59
- 2022CCPL: Contrastive Coherence Preserving Loss for Versatile Style Transfercited by 46
- 2021Instance-wise Hard Negative Example Generation for Contrastive Learning in Unpaired Image-to-Image Translationcited by 45
- 2022Exploring Patch-wise Semantic Relation for Contrastive Learning in Image-to-Image Translation Taskscited by 42
- 2022QS-Attn: Query-Selected Attention for Contrastive Learning in I2I Translationcited by 39
- 2019Multi-mapping Image-to-Image Translation via Learning Disentanglementcited by 35
- 2018SMIT: Stochastic Multi-Label Image-to-Image Translationcited by 21
- 2020Domain-Specific Mappings for Generative Adversarial Style Transfercited by 16
- 2022A Style-aware Discriminator for Controllable Image Translationcited by 16
- 2023InteractDiffusion: Interaction Control in Text-to-Image Diffusion Modelscited by 13
- 2022Exploring Negatives in Contrastive Learning for Unpaired Image-to-Image Translationcited by 6
- 2024Puff-Net: Efficient Style Transfer with Pure Content and Style Feature Fusion Networkcited by 5
- 2021Mutual-GAN: Towards Unsupervised Cross-Weather Adaptation with Mutual Information Constraintcited by 1
- 2021Separating Content and Style for Unsupervised Image-to-Image Translationcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.