StyleFlow For Content-Fixed Image to Image Translation
Not on the map. Why?
Abstract (arXiv)
Image-to-image (I2I) translation is a challenging topic in computer vision. We divide this problem into three tasks: strongly constrained translation, normally constrained translation, and weakly constrained translation. The constraint here indicates the extent to which the content or semantic information in the original image is preserved. Although previous approaches have achieved good performance in weakly constrained tasks, they failed to fully preserve the content in both strongly and normally constrained tasks, including photo-realism synthesis, style transfer, and colorization, etc. To achieve content-preserving transfer in strongly constrained and normally constrained tasks, we propose StyleFlow, a new I2I translation model that consists of normalizing flows and a novel Style-Aware Normalization (SAN) module. With the invertible network structure, StyleFlow first projects input images into deep feature space in the forward pass, while the backward pass utilizes the SAN module to perform content-fixed feature transformation and then projects back to image space. Our model supports both image-guided translation and multi-modal synthesis. We evaluate our model in several I2I translation benchmarks, and the results show that the proposed model has advantages over previous methods in both strongly constrained and normally constrained tasks.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 53 of its 66 references that are in the map. First posted on arXiv 5 Jul 2022.
Builds on
53 of 66 references.
References · 53
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2016Density estimation using Real NVPcited by 2,029
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
- 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,539
- 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,176
- 2017CyCADA: Cycle-Consistent Adversarial Domain Adaptationcited by 1,079
- 2014NICE: Non-linear Independent Components Estimationcited by 1,052
- 2016Playing for Data: Ground Truth from Computer Gamescited by 816
38 more
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2018Deep Retinex Decomposition for Low-Light Enhancementcited by 720
- 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 637
- 2017Unsupervised Image-to-Image Translation Networkscited by 602
- 2018Noise2Noise: Learning Image Restoration without Clean Datacited by 526
- 2019EnlightenGAN: Deep Light Enhancement without Paired Supervisioncited by 466
- 2017Deep Laplacian Pyramid Networks for Fast and Accurate Super-Resolutioncited by 452
- 2018Invertible Residual Networkscited by 364
- 2017Universal Style Transfer via Feature Transformscited by 352
- 2017DualGAN: Unsupervised Dual Learning for Image-to-Image Translationcited by 310
- 2017Learning to Discover Cross-Domain Relations with Generative Adversarial Networkscited by 278
- 2018Toward Convolutional Blind Denoising of Real Photographscited by 274
- 2019Flow++: Improving Flow-Based Generative Models with Variational Dequantization and Architecture Designcited by 258
- 2019DRIT++: Diverse Image-to-Image Translation via Disentangled Representationscited by 244
- 2015LLNet: A Deep Autoencoder Approach to Natural Low-light Image Enhancementcited by 224
- 2017Photographic Image Synthesis with Cascaded Refinement Networkscited by 223
- 2017Attentive Generative Adversarial Network for Raindrop Removal from a Single Imagecited by 204
- 2017Deep Photo Style Transfercited by 168
- 2018Avatar-Net: Multi-scale Zero-shot Style Transfer by Feature Decorationcited by 115
- 2021ArtFlow: Unbiased Image Style Transfer via Reversible Neural Flowscited by 113
- 2019Dense Haze: A benchmark for image dehazing with dense-haze and haze-free imagescited by 107
- 2016Fast Patch-based Style Transfer of Arbitrary Stylecited by 92
- 2021Colorization Transformercited by 89
- 2018Cycle-Dehaze: Enhanced CycleGAN for Single Image Dehazingcited by 79
- 2018Arbitrary Style Transfer with Deep Feature Reshufflecited by 75
- 2021Enhancing Photorealism Enhancementcited by 74
- 2020Reusing Discriminators for Encoding: Towards Unsupervised Image-to-Image Translationcited by 60
- 2016Learning Diverse Image Colorizationcited by 43
- 2019Diversified Arbitrary Style Transfer via Deep Feature Perturbationcited by 42
- 2018Exemplar Guided Unsupervised Image-to-Image Translation with Semantic Consistencycited by 41
- 2019TransGaGa: Geometry-Aware Unsupervised Image-to-Image Translationcited by 40
- 2021Domain-Aware Universal Style Transfercited by 40
- 2019Ultrafast Photorealistic Style Transfer via Neural Architecture Searchcited by 39
- 2017PixColor: Pixel Recursive Colorizationcited by 32
- 2017Unsupervised Diverse Colorization via Generative Adversarial Networkscited by 30
- 2018Conditional Image-to-Image Translationcited by 30
- 2018Sem-GAN: Semantically-Consistent Image-to-Image Translationcited by 26
- 2020Image Colorization: A Survey and Datasetcited by 23
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2023: 1; 2024: 2.
3 papers.