Unpaired Image-to-Image Translation with Limited Data to Reveal Subtle Phenotypes
Not on the map. Why?
Abstract (arXiv)
Unpaired image-to-image translation methods aim at learning a mapping of images from a source domain to a target domain. Recently, these methods proved to be very useful in biological applications to display subtle phenotypic cell variations otherwise invisible to the human eye. However, current models require a large number of images to be trained, while mostmicroscopy experiments remain limited in the number of images they can produce. In this work, we present an improved CycleGAN architecture that employs self-supervised discriminators to alleviate the need for numerous images. We demonstrate quantitatively and qualitatively that the proposed approach outperforms the CycleGAN baseline, including when it is combined with differentiable augmentations. We also provide results obtained with small biological datasets on obvious and non-obvious cell phenotype variations, demonstrating a straightforward application of this method.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 25 of its 31 references that are in the map. First posted on arXiv 21 Jan 2023.
Builds on
25 of 31 references.
References · 25
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2014Conditional Generative Adversarial Netscited by 2,152
- 2018Demystifying MMD GANscited by 1,268
- 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,187
- 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
- 2016Least Squares Generative Adversarial Networkscited by 1,000
- 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
- 2020Differentiable Augmentation for Data-Efficient GAN Trainingcited by 361
- 2017DualGAN: Unsupervised Dual Learning for Image-to-Image Translationcited by 310
- 2017Learning to Discover Cross-Domain Relations with Generative Adversarial Networkscited by 278
- 2019Revisiting Self-Supervised Visual Representation Learningcited by 250
13 more
- 2019Few-Shot Unsupervised Image-to-Image Translationcited by 222
- 2021Few-shot Image Generation via Cross-domain Correspondencecited by 206
- 2021Self-Supervised Representation Learning: Introduction, Advances and Challengescited by 147
- 2019Boosting Few-Shot Visual Learning with Self-Supervisioncited by 140
- 2021Towards Faster and Stabilized GAN Training for High-fidelity Few-shot Image Synthesiscited by 140
- 2018Transferring GANs: generating images from limited datacited by 134
- 2016Unsupervised Cross-Domain Image Generationcited by 125
- 2018Self-Supervised GANs via Auxiliary Rotation Losscited by 94
- 2020Image Augmentations for GAN Trainingcited by 78
- 2020Stylized Neural Paintingcited by 50
- 2019TraVeLGAN: Image-to-image Translation by Transformation Vector Learningcited by 35
- 2018Improving Shape Deformation in Unsupervised Image-to-Image Translationcited by 19
- 2020Deceiving Image-to-Image Translation Networks for Autonomous Driving with Adversarial Perturbationscited by 9
Built on by
Citing papers per year: 2023: 3; 2024: 2; 2025: 2.
7 papers.
- 2023ChAda-ViT : Channel Adaptive Attention for Joint Representation Learning of Heterogeneous Microscopy Imagescited by 15
- 2023PhenDiff: Revealing Subtle Phenotypes with Diffusion Models in Real Imagescited by 10
- 2023No Free Lunch in Self Supervised Representation Learningcited by 7
- 2024GANs Conditioning Methods: A Surveycited by 3
- 2024The Quest for Early Detection of Retinal Disease: 3D CycleGAN-based Translation of Optical Coherence Tomography into Confocal Microscopycited by 0
- 2025DiffEx: Explaining a Classifier with Diffusion Models to Identify Microscopic Cellular Variationscited by 0
- 2025Revealing Subtle Phenotypes in Small Microscopy Datasets Using Latent Diffusion Modelscited by 0
- 2025Revealing Subtle Phenotypes in Small Microscopy Datasets Using Latent Diffusion Models12 Feb 2025
- 2025DiffEx: Explaining a Classifier with Diffusion Models to Identify Microscopic Cellular Variations12 Feb 2025
- 2024GANs Conditioning Methods: A Survey28 Aug 2024
- 2024The Quest for Early Detection of Retinal Disease: 3D CycleGAN-based Translation of Optical Coherence Tomography into Confocal Microscopy7 Aug 2024
- 2023PhenDiff: Revealing Subtle Phenotypes with Diffusion Models in Real Images13 Dec 2023
- 2023ChAda-ViT : Channel Adaptive Attention for Joint Representation Learning of Heterogeneous Microscopy Images26 Nov 2023
- 2023No Free Lunch in Self Supervised Representation Learning23 Apr 2023