Image-to-Image Translation with Low Resolution Conditioning
Not on the map. Why?
Abstract (arXiv)
Most image-to-image translation methods focus on learning mappings across domains with the assumption that images share content (e.g., pose) but have their own domain-specific information known as style. When conditioned on a target image, such methods aim to extract the style of the target and combine it with the content of the source image. In this work, we consider the scenario where the target image has a very low resolution. More specifically, our approach aims at transferring fine details from a high resolution (HR) source image to fit a coarse, low resolution (LR) image representation of the target. We therefore generate HR images that share features from both HR and LR inputs. This differs from previous methods that focus on translating a given image style into a target content, our translation approach being able to simultaneously imitate the style and merge the structural information of the LR target. Our approach relies on training the generative model to produce HR target images that both 1) share distinctive information of the associated source image; 2) correctly match the LR target image when downscaled. We validate our method on the CelebA-HQ and AFHQ datasets by demonstrating improvements in terms of visual quality, diversity and coverage. Qualitative and quantitative results show that when dealing with intra-domain image translation, our method generates more realistic samples compared to state-of-the-art methods such as Stargan-v2
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 38 of its 43 references that are in the map. First posted on arXiv 23 Jul 2021.
Builds on
38 of 43 references.
References · 38
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
- 2017Improved Training of Wasserstein GANscited by 2,223
- 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,031
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
26 more
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
- 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
- 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,250
- 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,095
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
- 2016Least Squares Generative Adversarial Networkscited by 1,000
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
- 2018Which Training Methods for GANs do actually Converge?cited by 672
- 2017Unsupervised Image-to-Image Translation Networkscited by 602
- 2016StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networkscited by 575
- 2020Reliable Fidelity and Diversity Metrics for Generative Modelscited by 425
- 2018Assessing Generative Models via Precision and Recallcited by 401
- 2020PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Modelscited by 358
- 2018Diverse Image-to-Image Translation via Disentangled Representationscited by 296
- 2017FSRNet: End-to-End Learning Face Super-Resolution with Facial Priorscited by 170
- 2019Mode Seeking Generative Adversarial Networks for Diverse Image Synthesiscited by 138
- 2016Energy-based Generative Adversarial Networkcited by 119
- 2019Image Super-Resolution by Neural Texture Transfercited by 119
- 2018CrossNet: An End-to-end Reference-based Super Resolution Network using Cross-scale Warpingcited by 90
- 2019Diversity-Sensitive Conditional Generative Adversarial Networkscited by 77
- 2020Instance-aware Image Colorizationcited by 76
- 2020Neural Pose Transfer by Spatially Adaptive Instance Normalizationcited by 37
- 2018Conditional Image-to-Image Translationcited by 30
- 2019Positional Normalizationcited by 28
- 2020Creating High Resolution Images with a Latent Adversarial Generatorcited by 8
Built on by
Citing papers per year: 2021: 2.
2 papers.