Few-Shot Unsupervised Image-to-Image Translation
Not on the map. Why?
Abstract (arXiv)
Unsupervised image-to-image translation methods learn to map images in a given class to an analogous image in a different class, drawing on unstructured (non-registered) datasets of images. While remarkably successful, current methods require access to many images in both source and destination classes at training time. We argue this greatly limits their use. Drawing inspiration from the human capability of picking up the essence of a novel object from a small number of examples and generalizing from there, we seek a few-shot, unsupervised image-to-image translation algorithm that works on previously unseen target classes that are specified, at test time, only by a few example images. Our model achieves this few-shot generation capability by coupling an adversarial training scheme with a novel network design. Through extensive experimental validation and comparisons to several baseline methods on benchmark datasets, we verify the effectiveness of the proposed framework. Our implementation and datasets are available at https://github.com/NVlabs/FUNIT .
Key facts. Cited by 222 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 0; 2021: 86; 2022: 60; 2023: 42; 2024: 17; 2025: 11; 2026: 5.
222 papers.
Sort:
By area:
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
- 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
- 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
- 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 222
- 2021Large Scale Image Completion via Co-Modulated Generative Adversarial Networkscited by 219
- 2022SpaText: Spatio-Textual Representation for Controllable Image Generationcited by 217
- 2023Style Aligned Image Generation via Shared Attentioncited by 214
- 2021Few-shot Image Generation via Cross-domain Correspondencecited by 206
- 2023DragonDiffusion: Enabling Drag-style Manipulation on Diffusion Modelscited by 193
- 2019Variational Mixture-of-Experts Autoencoders for Multi-Modal Deep Generative Modelscited by 177
- 2022Semantic Image Synthesis via Diffusion Modelscited by 131
38 more
- 2021Image-to-Image Translation: Methods and Applicationscited by 116
- 2021GANcraft: Unsupervised 3D Neural Rendering of Minecraft Worldscited by 98
- 2021Only a Matter of Style: Age Transformation Using a Style-Based Regression Modelcited by 92
- 2024Distilling Diffusion Models into Conditional GANscited by 78
- 2022FrePGAN: Robust Deepfake Detection Using Frequency-level Perturbationscited by 75
- 2021Region-aware Adaptive Instance Normalization for Image Harmonizationcited by 71
- 2021DG-Font: Deformable Generative Networks for Unsupervised Font Generationcited by 70
- 2021Aligning Latent and Image Spaces to Connect the Unconnectablecited by 70
- 2021Mind the Gap: Domain Gap Control for Single Shot Domain Adaptation for Generative Adversarial Networkscited by 68
- 2022Motion Puzzle: Arbitrary Motion Style Transfer by Body Partcited by 64
- 2021Image-to-image Translation via Hierarchical Style Disentanglementcited by 63
- 2021Rebooting ACGAN: Auxiliary Classifier GANs with Stable Trainingcited by 57
- 2022Few Shot Generative Model Adaption via Relaxed Spatial Structural Alignmentcited by 54
- 2021On Aliased Resizing and Surprising Subtleties in GAN Evaluationcited by 51
- 2021TextStyleBrush: Transfer of Text Aesthetics from a Single Examplecited by 48
- 2021StyleAlign: Analysis and Applications of Aligned StyleGAN Modelscited by 48
- 2023FontDiffuser: One-Shot Font Generation via Denoising Diffusion with Multi-Scale Content Aggregation and Style Contrastive Learningcited by 48
- 2021BlendGAN: Implicitly GAN Blending for Arbitrary Stylized Face Generationcited by 47
- 2021Multiple Heads are Better than One: Few-shot Font Generation with Multiple Localized Expertscited by 46
- 2021Instance-wise Hard Negative Example Generation for Contrastive Learning in Unpaired Image-to-Image Translationcited by 45
- 20223D GAN Inversion with Pose Optimizationcited by 44
- 2022FaceDancer: Pose- and Occlusion-Aware High Fidelity Face Swappingcited by 44
- 2021Rethinking Style Transfer: From Pixels to Parameterized Brushstrokescited by 42
- 2022Diff-Font: Diffusion Model for Robust One-Shot Font Generationcited by 40
- 2021DRB-GAN: A Dynamic ResBlock Generative Adversarial Network for Artistic Style Transfercited by 38
- 2022StudioGAN: A Taxonomy and Benchmark of GANs for Image Synthesiscited by 38
- 2021Sketch Your Own GANcited by 37
- 2021On the Limitations of Multimodal VAEscited by 37
- 2021Smoothing the Disentangled Latent Style Space for Unsupervised Image-to-Image Translationcited by 35
- 2022Few-Shot Font Generation by Learning Fine-Grained Local Stylescited by 34
- 2022Few-shot Image Generation via Adaptation-Aware Kernel Modulationcited by 33
- 2022Look Closer to Supervise Better: One-Shot Font Generation via Component-Based Discriminatorcited by 32
- 2022StyleTTS: A Style-Based Generative Model for Natural and Diverse Text-to-Speech Synthesiscited by 32
- 2021Dual Contrastive Loss and Attention for GANscited by 30
- 2023Beyond Privacy: Navigating the Opportunities and Challenges of Synthetic Datacited by 29
- 2021CoMoGAN: continuous model-guided image-to-image translationcited by 27
- 2022SLOGAN: Handwriting Style Synthesis for Arbitrary-Length and Out-of-Vocabulary Textcited by 26
- 2023CF-Font: Content Fusion for Few-shot Font Generationcited by 26
50 most cited of 222 All 222 (JSON)
- 2026Synthetic Thermal Image Generation for Real-Time Animal Detection Under Low-Visibility Conditions26 Sep 2026
- 2026Srijika: OpenType-Layout-Reusing Font Restyling for Nine Indic Scripts4 Sep 2026
- 2026InkDiffuser: High-Fidelity One-shot Chinese Calligraphy via Differentiable Morphological Optimization7 May 2026
- 2026DRG-Font: Dynamic Reference-Guided Few-shot Font Generation via Contrastive Style-Content Disentanglement15 Apr 2026
- 2026Can One-Shot Test-Time Data Augmentation Help with Generalization?27 Jan 2026
- 2025Incorporating Pre-trained Diffusion Models in Solving the Schr"odinger Bridge Problem25 Aug 2025
- 2025FCR: Investigating Generative AI models for Forensic Craniofacial Reconstruction25 Aug 2025
- 2025Learning Latent Representations for Image Translation using Frequency Distributed CycleGAN5 Aug 2025
- 2025Visual Language Models as Zero-Shot Deepfake Detectors30 Jul 2025
- 2025Evaluating Deepfake Detectors in the Wild29 Jul 2025
- 2025Text-Conditioned Diffusion Model for High-Fidelity Korean Font Generation30 Apr 2025
- 2025Generative Adversarial Networks with Limited Data: A Survey and Benchmarking7 Apr 2025
38 more
- 2025AnyArtisticGlyph: Multilingual Controllable Artistic Glyph Generation7 Apr 2025
- 2025Zero-Shot Visual Concept Blending Without Text Guidance27 Mar 2025
- 2025MX-Font++: Mixture of Heterogeneous Aggregation Experts for Few-shot Font Generation4 Mar 2025
- 2025Synergy Between Sufficient Changes and Sparse Mixing Procedure for Disentangled Representation Learning1 Mar 2025
- 2024TAGE: Trustworthy Attribute Group Editing for Stable Few-shot Image Generation23 Oct 2024
- 2024Neural-Polyptych: Content Controllable Painting Recreation for Diverse Genres29 Sep 2024
- 2024StructuReiser: A Structure-preserving Video Stylization Method9 Sep 2024
- 2024SurgicaL-CD: Generating Surgical Images via Unpaired Image Translation with Latent Consistency Diffusion Models19 Aug 2024
- 2024An Analysis for Image-to-Image Translation and Style Transfer12 Aug 2024
- 2024Supervised Image Translation from Visible to Infrared Domain for Object Detection3 Aug 2024
- 2024Scalable, Trustworthy Generative Model for Virtual Multi-Staining from H&E Whole Slide Images26 Jun 2024
- 2024Gene-Level Representation Learning via Interventional Style Transfer in Optical Pooled Screening11 Jun 2024
- 2024ReasonPix2Pix: Instruction Reasoning Dataset for Advanced Image Editing18 May 2024
- 2024Distilling Diffusion Models into Conditional GANs9 May 2024
- 2024ArtNeRF: A Stylized Neural Field for 3D-Aware Cartoonized Face Synthesis21 Apr 2024
- 2024AV-GAN: Attention-Based Varifocal Generative Adversarial Network for Uneven Medical Image Translation16 Apr 2024
- 2024RoNet: Rotation-oriented Continuous Image Translation6 Apr 2024
- 2024Privacy-preserving Optics for Enhancing Protection in Face De-identification31 Mar 2024
- 2024FSL-Rectifier: Rectify Outliers in Few-Shot Learning via Test-Time Augmentation28 Feb 2024
- 2024Towards Identifiable Unsupervised Domain Translation: A Diversified Distribution Matching Approach18 Jan 2024
- 2024Re:Draw -- Context Aware Translation as a Controllable Method for Artistic Production7 Jan 2024
- 2023FontDiffuser: One-Shot Font Generation via Denoising Diffusion with Multi-Scale Content Aggregation and Style Contrastive Learning19 Dec 2023
- 2023Style Aligned Image Generation via Shared Attention4 Dec 2023
- 2023S2ST: Image-to-Image Translation in the Seed Space of Latent Diffusion30 Nov 2023
- 2023Few-shot Image Generation via Style Adaptation and Content Preservation30 Nov 2023
- 2023A Somewhat Robust Image Watermark against Diffusion-based Editing Models22 Nov 2023
- 2023SCONE-GAN: Semantic Contrastive learning-based Generative Adversarial Network for an end-to-end image translation7 Nov 2023
- 2023One-for-All: Towards Universal Domain Translation with a Single StyleGAN22 Oct 2023
- 2023MedPrompt: Cross-Modal Prompting for Multi-Task Medical Image Translation4 Oct 2023
- 2023Noise-Tolerant Few-Shot Unsupervised Adapter for Vision-Language Models26 Sep 2023
- 2023Face Cartoonisation For Various Poses Using StyleGAN26 Sep 2023
- 2023AGMDT: Virtual Staining of Renal Histology Images with Adjacency-Guided Multi-Domain Transfer12 Sep 2023
- 2023Exploring Semantic Consistency in Unpaired Image Translation to Generate Data for Surgical Applications6 Sep 2023
- 2023Few shot font generation via transferring similarity guided global style and quantization local style2 Sep 2023
- 2023Improving Few-shot Image Generation by Structural Discrimination and Textural Modulation30 Aug 2023
- 2023Controllable Multi-domain Semantic Artwork Synthesis19 Aug 2023
- 2023Image Synthesis under Limited Data: A Survey and Taxonomy31 Jul 2023
- 2023EqGAN: Feature Equalization Fusion for Few-shot Image Generation27 Jul 2023
50 newest of 222 All 222 (JSON)
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
- 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
- 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 222
- 2022SpaText: Spatio-Textual Representation for Controllable Image Generationcited by 217
- 2023DragonDiffusion: Enabling Drag-style Manipulation on Diffusion Modelscited by 193
- 2022Semantic Image Synthesis via Diffusion Modelscited by 131
- 2024Distilling Diffusion Models into Conditional GANscited by 78
- 2023FontDiffuser: One-Shot Font Generation via Denoising Diffusion with Multi-Scale Content Aggregation and Style Contrastive Learningcited by 48
- 2022Diff-Font: Diffusion Model for Robust One-Shot Font Generationcited by 40
- 2023A Somewhat Robust Image Watermark against Diffusion-based Editing Modelscited by 4
- 2024SurgicaL-CD: Generating Surgical Images via Unpaired Image Translation with Latent Consistency Diffusion Modelscited by 4
12 most cited of 15 All 15 (JSON)
- 2025Incorporating Pre-trained Diffusion Models in Solving the Schr"odinger Bridge Problem25 Aug 2025
- 2025Text-Conditioned Diffusion Model for High-Fidelity Korean Font Generation30 Apr 2025
- 2024SurgicaL-CD: Generating Surgical Images via Unpaired Image Translation with Latent Consistency Diffusion Models19 Aug 2024
- 2024Distilling Diffusion Models into Conditional GANs9 May 2024
- 2023FontDiffuser: One-Shot Font Generation via Denoising Diffusion with Multi-Scale Content Aggregation and Style Contrastive Learning19 Dec 2023
- 2023S2ST: Image-to-Image Translation in the Seed Space of Latent Diffusion30 Nov 2023
- 2023A Somewhat Robust Image Watermark against Diffusion-based Editing Models22 Nov 2023
- 2023DragonDiffusion: Enabling Drag-style Manipulation on Diffusion Models5 Jul 2023
- 2022Diff-Font: Diffusion Model for Robust One-Shot Font Generation12 Dec 2022
- 2022SpaText: Spatio-Textual Representation for Controllable Image Generation25 Nov 2022
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov 2022
- 2022Semantic Image Synthesis via Diffusion Models30 Jun 2022
12 newest of 15 All 15 (JSON)
- 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
- 2021Large Scale Image Completion via Co-Modulated Generative Adversarial Networkscited by 219
- 2023Style Aligned Image Generation via Shared Attentioncited by 214
- 2021Few-shot Image Generation via Cross-domain Correspondencecited by 206
- 2021Image-to-Image Translation: Methods and Applicationscited by 116
- 2021GANcraft: Unsupervised 3D Neural Rendering of Minecraft Worldscited by 98
- 2021Only a Matter of Style: Age Transformation Using a Style-Based Regression Modelcited by 92
- 2022FrePGAN: Robust Deepfake Detection Using Frequency-level Perturbationscited by 75
- 2021Region-aware Adaptive Instance Normalization for Image Harmonizationcited by 71
- 2021DG-Font: Deformable Generative Networks for Unsupervised Font Generationcited by 70
- 2021Aligning Latent and Image Spaces to Connect the Unconnectablecited by 70
- 2021Mind the Gap: Domain Gap Control for Single Shot Domain Adaptation for Generative Adversarial Networkscited by 68
12 most cited of 203 All 203 (JSON)
- 2026Synthetic Thermal Image Generation for Real-Time Animal Detection Under Low-Visibility Conditions26 Sep 2026
- 2026Srijika: OpenType-Layout-Reusing Font Restyling for Nine Indic Scripts4 Sep 2026
- 2026InkDiffuser: High-Fidelity One-shot Chinese Calligraphy via Differentiable Morphological Optimization7 May 2026
- 2026DRG-Font: Dynamic Reference-Guided Few-shot Font Generation via Contrastive Style-Content Disentanglement15 Apr 2026
- 2026Can One-Shot Test-Time Data Augmentation Help with Generalization?27 Jan 2026
- 2025FCR: Investigating Generative AI models for Forensic Craniofacial Reconstruction25 Aug 2025
- 2025Learning Latent Representations for Image Translation using Frequency Distributed CycleGAN5 Aug 2025
- 2025Evaluating Deepfake Detectors in the Wild29 Jul 2025
- 2025Generative Adversarial Networks with Limited Data: A Survey and Benchmarking7 Apr 2025
- 2025AnyArtisticGlyph: Multilingual Controllable Artistic Glyph Generation7 Apr 2025
- 2025Zero-Shot Visual Concept Blending Without Text Guidance27 Mar 2025
- 2025Synergy Between Sufficient Changes and Sparse Mixing Procedure for Disentangled Representation Learning1 Mar 2025
12 newest of 203 All 203 (JSON)