ReMix: Towards Image-to-Image Translation with Limited Data
Not on the map. Why?
Abstract (arXiv)
Image-to-image (I2I) translation methods based on generative adversarial networks (GANs) typically suffer from overfitting when limited training data is available. In this work, we propose a data augmentation method (ReMix) to tackle this issue. We interpolate training samples at the feature level and propose a novel content loss based on the perceptual relations among samples. The generator learns to translate the in-between samples rather than memorizing the training set, and thereby forces the discriminator to generalize. The proposed approach effectively reduces the ambiguity of generation and renders content-preserving results. The ReMix method can be easily incorporated into existing GAN models with minor modifications. Experimental results on numerous tasks demonstrate that GAN models equipped with the ReMix method achieve significant improvements.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 38 of its 45 references that are in the map. First posted on arXiv 31 Mar 2021.
Builds on
38 of 45 references.
References · 38
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2017Improved Training of Wasserstein GANscited by 2,223
- 2014Conditional Generative Adversarial Netscited by 2,152
- 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,623
26 more
- 2019MixMatch: A Holistic Approach to Semi-Supervised Learningcited by 1,390
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
- 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
- 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,095
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
- 2016Least Squares Generative Adversarial Networkscited by 1,000
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
- 2018Which Training Methods for GANs do actually Converge?cited by 672
- 2017Wasserstein GANcited by 635
- 2017Regularizing Neural Networks by Penalizing Confident Output Distributionscited by 461
- 2020Differentiable Augmentation for Data-Efficient GAN Trainingcited by 361
- 2016Unsupervised Pixel-Level Domain Adaptation with Generative Adversarial Networkscited by 307
- 2017Dilated Residual Networkscited by 293
- 2016Learning from Simulated and Unsupervised Images through Adversarial Trainingcited by 287
- 2019DRIT++: Diverse Image-to-Image Translation via Disentangled Representationscited by 244
- 2019Few-Shot Unsupervised Image-to-Image Translationcited by 222
- 2019Consistency Regularization for Generative Adversarial Networkscited by 134
- 2015A Light CNN for Deep Face Representation with Noisy Labelscited by 126
- 2016Unsupervised Cross-Domain Image Generationcited by 125
- 2017Dataset Augmentation in Feature Spacecited by 124
- 2020Image Augmentations for GAN Trainingcited by 78
- 2020COCO-FUNIT: Few-Shot Unsupervised Image Translation with a Content Conditioned Style Encodercited by 39
- 2020On Data Augmentation for GAN Trainingcited by 25
- 2019On Adversarial Mixup Resynthesiscited by 2
- 2015HDIdx: High-Dimensional Indexing for Efficient Approximate Nearest Neighbor Searchcited by 1
Built on by
Citing papers per year: 2021: 2; 2022: 4; 2023: 2; 2024: 1.
9 papers.
- 2022Region-aware Knowledge Distillation for Efficient Image-to-Image Translationcited by 10
- 2022DigGAN: Discriminator gradIent Gap Regularization for GAN Training with Limited Datacited by 7
- 2021ManiFest: Manifold Deformation for Few-shot Image Translationcited by 6
- 2022Commonality in Natural Images Rescues GANs: Pretraining GANs with Generic and Privacy-free Synthetic Datacited by 6
- 2023UGC: Unified GAN Compression for Efficient Image-to-Image Translationcited by 3
- 2022ScoreMix: A Scalable Augmentation Strategy for Training GANs with Limited Datacited by 2
- 2024Prompt Augmentation for Self-supervised Text-guided Image Manipulationcited by 2
- 2021Leveraging Local Domains for Image-to-Image Translationcited by 1
- 2023Exploring the Power of Generative Deep Learning for Image-to-Image Translation and MRI Reconstruction: A Cross-Domain Reviewcited by 0
- 2024Prompt Augmentation for Self-supervised Text-guided Image Manipulation17 Dec 2024
- 2023UGC: Unified GAN Compression for Efficient Image-to-Image Translation17 Sep 2023
- 2023Exploring the Power of Generative Deep Learning for Image-to-Image Translation and MRI Reconstruction: A Cross-Domain Review16 Mar 2023
- 2022DigGAN: Discriminator gradIent Gap Regularization for GAN Training with Limited Data27 Nov 2022
- 2022ScoreMix: A Scalable Augmentation Strategy for Training GANs with Limited Data27 Oct 2022
- 2022Region-aware Knowledge Distillation for Efficient Image-to-Image Translation25 May 2022
- 2022Commonality in Natural Images Rescues GANs: Pretraining GANs with Generic and Privacy-free Synthetic Data11 Apr 2022
- 2021ManiFest: Manifold Deformation for Few-shot Image Translation26 Nov 2021
- 2021Leveraging Local Domains for Image-to-Image Translation9 Sep 2021