Multimodal Unsupervised Image-to-Image Translation
Not on the map. Why?
Cited by 72 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Unsupervised image-to-image translation is an important and challenging problem in computer vision. Given an image in the source domain, the goal is to learn the conditional distribution of corresponding images in the target domain, without seeing any pairs of corresponding images. While this conditional distribution is inherently multimodal, existing approaches make an overly simplified assumption, modeling it as a deterministic one-to-one mapping. As a result, they fail to generate diverse outputs from a given source domain image. To address this limitation, we propose a Multimodal Unsupervised Image-to-image Translation (MUNIT) framework. We assume that the image representation can be decomposed into a content code that is domain-invariant, and a style code that captures domain-specific properties. To translate an image to another domain, we recombine its content code with a random style code sampled from the style space of the target domain. We analyze the proposed framework and establish several theoretical results. Extensive experiments with comparisons to the state-of-the-art approaches further demonstrates the advantage of the proposed framework. Moreover, our framework allows users to control the style of translation outputs by providing an example style image. Code and pretrained models are available at https://github.com/nvlabs/MUNIT
Key facts. Cited by 795 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Apr 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 253; 2022: 173; 2023: 168; 2024: 102; 2025: 54; 2026: 44.
795 papers.
Sort:
By area:
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
- 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
- 2023Zero-shot Image-to-Image Translationcited by 503
- 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
- 2021Dynamic Neural Networks: A Surveycited by 405
- 2021GAN Inversion: A Surveycited by 366
- 2022CelebV-HQ: A Large-Scale Video Facial Attributes Datasetcited by 246
- 2021Large Scale Image Completion via Co-Modulated Generative Adversarial Networkscited by 219
- 2022SpaText: Spatio-Textual Representation for Controllable Image Generationcited by 217
- 2023I2SB: Image-to-Image Schr"odinger Bridgecited by 214
- 2023Style Aligned Image Generation via Shared Attentioncited by 214
38 more
- 2021RobustNet: Improving Domain Generalization in Urban-Scene Segmentation via Instance Selective Whiteningcited by 213
- 2021More Control for Free! Image Synthesis with Semantic Diffusion Guidancecited by 211
- 2023DragonDiffusion: Enabling Drag-style Manipulation on Diffusion Modelscited by 193
- 2022Unsupervised Medical Image Translation with Adversarial Diffusion Modelscited by 191
- 2021StyTr2: Image Style Transfer with Transformerscited by 186
- 2021Audio-Driven Emotional Video Portraitscited by 180
- 2023UCF: Uncovering Common Features for Generalizable Deepfake Detectioncited by 177
- 2022EGSDE: Unpaired Image-to-Image Translation via Energy-Guided Stochastic Differential Equationscited by 172
- 2023StyleDiffusion: Controllable Disentangled Style Transfer via Diffusion Modelscited by 154
- 2021UNIT-DDPM: UNpaired Image Translation with Denoising Diffusion Probabilistic Modelscited by 133
- 2021Hallucinated Neural Radiance Fields in the Wildcited by 130
- 2022NeRF-Art: Text-Driven Neural Radiance Fields Stylizationcited by 126
- 2022MoVQ: Modulating Quantized Vectors for High-Fidelity Image Generationcited by 125
- 2022Neural Optimal Transportcited by 123
- 2021Image-to-Image Translation: Methods and Applicationscited by 116
- 2021Learning Debiased Representation via Disentangled Feature Augmentationcited by 116
- 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 113
- 2022Disentangled Representation Learningcited by 111
- 2024One-Step Image Translation with Text-to-Image Modelscited by 111
- 2021Audio2Gestures: Generating Diverse Gestures from Speech Audio with Conditional Variational Autoencoderscited by 109
- 2024Measuring Style Similarity in Diffusion Modelscited by 106
- 2021Regularizing Generative Adversarial Networks under Limited Datacited by 105
- 2023A Comprehensive Survey on Source-free Domain Adaptationcited by 104
- 2021Model-Based Domain Generalizationcited by 103
- 2022BigDatasetGAN: Synthesizing ImageNet with Pixel-wise Annotationscited by 99
- 2021GANcraft: Unsupervised 3D Neural Rendering of Minecraft Worldscited by 98
- 2023Unpaired Image-to-Image Translation via Neural Schr"odinger Bridgecited by 96
- 2021Unsupervised Domain Adaptation of Object Detectors: A Surveycited by 93
- 2021Only a Matter of Style: Age Transformation Using a Style-Based Regression Modelcited by 92
- 2021GAN-Control: Explicitly Controllable GANscited by 91
- 2021Towards Principled Disentanglement for Domain Generalizationcited by 91
- 2021Learning by Watching: Physical Imitation of Manipulation Skills from Human Videoscited by 87
- 2021Generalized Multimodal ELBOcited by 86
- 2021Deep Learning for Chest X-ray Analysis: A Surveycited by 84
- 2021Breaking the Dilemma of Medical Image-to-image Translationcited by 82
- 2022Learning to generate line drawings that convey geometry and semanticscited by 82
- 2024Marabou 2.0: A Versatile Formal Analyzer of Neural Networkscited by 81
- 2021PD-GAN: Probabilistic Diverse GAN for Image Inpaintingcited by 80
50 most cited of 795 All 795 (JSON)
- 2026Values as Style: Disentangling Values from Semantics with One-Way Mixing for Low-Damage LLM Steering30 Sep 2026
- 2026PredRA: Fast Medical Image Translation by Deterministic Component Extraction and Controlled Stochastic Refinement25 Sep 2026
- 2026Anatomy-Decomposed Chest Computed Tomography (CT) Projections as Scalable Supervision for Bone Suppression in Chest Radiographs21 Sep 2026
- 2026Learned Parametric Emotion Editing: Real-Time Affective Filtering for On-Device Social Media Video18 Sep 2026
- 2026One Model, Two Worlds: Bidirectional Sonar-Optical Translation5 Sep 2026
- 2026Data-Efficient Networks for Multi-Contrast MRI Reconstruction based on a Generalized Content/Style Prior2 Sep 2026
- 2026Towards Reliable AI-Based Histological Staining: A Systematic Study of Scaling and Uncertainty in Unpaired Generative Models25 Aug 2026
- 2026HistReNeRF: Historic Image Relocalisation within Contemporary Neural Radiance Field Reconstructions15 Aug 2026
- 2026Where the Cost Falls: A Deployment-Aware Adoption Order for Stability Enhancements to Cycle-Consistent Adversarial Networks14 Aug 2026
- 2026Source-Agnostic Image Translation Based on Latent Aware Adaptive Masking14 Aug 2026
- 2026UniCycleFlow: Bidirectional Unpaired Image Translation with a Shared Rectified Flow7 Aug 2026
- 2026Marginal Matching Does Not License Factorized Sampling: Auditing Conditional Style Leakage in Factorized Generative Models5 Aug 2026
38 more
- 2026DisMix: Order-Aware Mixup for Medical Imaging via Disentangling Ordinal and Non-Ordinal Features5 Aug 2026
- 2026InstancePin: Instance-Addressable Layout-to-Image Diffusion via Coordinate Pinning1 Aug 2026
- 2026Unpaired Joint Distribution Modeling via Multi-Scale Image Representations9 Jul 2026
- 2026WarpI2I: Image Warping for Image-to-Image Translation30 Jun 2026
- 2026Domain Adaptation with Adaptive Imagination for Visual Reinforcement Learning under Limited Target Data29 Jun 2026
- 2026ASTAD: Asymmetric Style Transfer for Synthetic-to-Real Adaptation in Autonomous Driving28 Jun 2026
- 2026Geometry-Aware Style Transfer in 3D Gaussian Splatting23 Jun 2026
- 2026Addressing Detail Bottlenecks in Latent Diffusion for RGB-to-SWIR Image Translation18 Jun 2026
- 2026Component-Aware Structure-Preserving Style Transfer for Satellite Visual Sim2Real Data Construction19 May 2026
- 2026Implicit Neural Optimal Transport via Fixed-Point Optimization11 May 2026
- 2026AtteConDA: Attention-Based Conflict Suppression in Multi-Condition Diffusion Models and Synthetic Data Augmentation10 May 2026
- 2026Lightweight Unpaired Smartphone ISP Transfer with Semantic Pseudo-Pairing8 May 2026
- 2026Conditional Flow-VAE for Safety-Critical Traffic Scenario Generation6 May 2026
- 2026A Target-Free Harmonization Method for MRI2 May 2026
- 2026MD-Face: MoE-Enhanced Label-Free Disentangled Representation for Interactive Facial Attribute Editing22 Apr 2026
- 2026Style-Based Neural Architectures for Real-Time Weather Classification20 Apr 2026
- 2026Cycle-Consistent Search: Question Reconstructability as a Proxy Reward for Search Agent Training14 Apr 2026
- 2026A Systematic Benchmark of GAN Architectures for MRI-to-CT Synthesis13 Mar 2026
- 2026Distribution-Conditioned Transport5 Mar 2026
- 2026DiffusionXRay: A Diffusion and GAN-Based Approach for Enhancing Digitally Reconstructed Chest Radiographs2 Mar 2026
- 2026Efficient endometrial carcinoma screening via cross-modal synthesis and gradient distillation23 Feb 2026
- 2026Unpaired Image-to-Image Translation via a Self-Supervised Semantic Bridge18 Feb 2026
- 2026Bridging Day and Night: Target-Class Hallucination Suppression in Unpaired Image Translation17 Feb 2026
- 2026SketchingReality: From Freehand Scene Sketches To Photorealistic Images16 Feb 2026
- 2026SAS-Net: Cross-Domain Image Registration as Inverse Rendering via Structure-Appearance Factorization6 Feb 2026
- 2026SRA-Seg: Synthetic to Real Alignment for Semi-Supervised Medical Image Segmentation3 Feb 2026
- 2026Structure-constrained Language-informed Diffusion Model for Unpaired Low-dose Computed Tomography Angiography Reconstruction28 Jan 2026
- 2026From Snow to Rain: Evaluating Robustness, Calibration, and Complexity of Model-Based Robust Training14 Jan 2026
- 2026Learning Domain-Invariant Representations for Cross-Domain Image Registration via Scene-Appearance Disentanglement12 Jan 2026
- 2026Language-Grounded Multi-Domain Image Translation via Semantic Difference Guidance12 Jan 2026
- 2026Few-Shot LoRA Adaptation of a Flow-Matching Foundation Model for Cross-Spectral Object Detection7 Jan 2026
- 2026Topology-aware Pathological Consistency Matching for Weakly-Paired IHC Virtual Staining6 Jan 2026
- 2025Deterministic Image-to-Image Translation via Denoising Brownian Bridge Models with Dual Approximators29 Dec 2025
- 2025Plasticine: A Traceable Diffusion Model for Medical Image Translation20 Dec 2025
- 2025Learning Common and Salient Generative Factors Between Two Image Datasets14 Dec 2025
- 2025DIST-CLIP: Arbitrary Metadata and Image Guided MRI Harmonization via Disentangled Anatomy-Contrast Representations8 Dec 2025
- 2025See More, Change Less: Anatomy-Aware Diffusion for Contrast Enhancement8 Dec 2025
- 2025TARDis: Time Attenuated Representation Disentanglement for Incomplete Multi-Modal Tumor Segmentation and Classification4 Dec 2025
50 newest of 795 All 795 (JSON)
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
- 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
- 2022SpaText: Spatio-Textual Representation for Controllable Image Generationcited by 217
- 2023I2SB: Image-to-Image Schr"odinger Bridgecited by 214
- 2021More Control for Free! Image Synthesis with Semantic Diffusion Guidancecited by 211
- 2023DragonDiffusion: Enabling Drag-style Manipulation on Diffusion Modelscited by 193
- 2022Unsupervised Medical Image Translation with Adversarial Diffusion Modelscited by 191
- 2022EGSDE: Unpaired Image-to-Image Translation via Energy-Guided Stochastic Differential Equationscited by 172
- 2023StyleDiffusion: Controllable Disentangled Style Transfer via Diffusion Modelscited by 154
- 2021UNIT-DDPM: UNpaired Image Translation with Denoising Diffusion Probabilistic Modelscited by 133
- 2024One-Step Image Translation with Text-to-Image Modelscited by 111
12 most cited of 71 All 71 (JSON)
- 2026Source-Agnostic Image Translation Based on Latent Aware Adaptive Masking14 Aug 2026
- 2026UniCycleFlow: Bidirectional Unpaired Image Translation with a Shared Rectified Flow7 Aug 2026
- 2026InstancePin: Instance-Addressable Layout-to-Image Diffusion via Coordinate Pinning1 Aug 2026
- 2026WarpI2I: Image Warping for Image-to-Image Translation30 Jun 2026
- 2026Addressing Detail Bottlenecks in Latent Diffusion for RGB-to-SWIR Image Translation18 Jun 2026
- 2026AtteConDA: Attention-Based Conflict Suppression in Multi-Condition Diffusion Models and Synthetic Data Augmentation10 May 2026
- 2026DiffusionXRay: A Diffusion and GAN-Based Approach for Enhancing Digitally Reconstructed Chest Radiographs2 Mar 2026
- 2026Structure-constrained Language-informed Diffusion Model for Unpaired Low-dose Computed Tomography Angiography Reconstruction28 Jan 2026
- 2026Few-Shot LoRA Adaptation of a Flow-Matching Foundation Model for Cross-Spectral Object Detection7 Jan 2026
- 2025Plasticine: A Traceable Diffusion Model for Medical Image Translation20 Dec 2025
- 2025TReFT: Taming Rectified Flow Models For One-Step Image Translation25 Nov 2025
- 2025Coupled Flow Matching27 Oct 2025
12 newest of 71 All 71 (JSON)
- 2023Domain Adaptive Imitation Learning with Visual Observationcited by 11
- 2020Cross-Domain Imitation Learning with a Dual Structurecited by 1
- 2023Domain Adaptive Imitation Learning with Visual Observation1 Dec 2023
- 2020Cross-Domain Imitation Learning with a Dual Structure2 Jun 2020
- 2025Long-Context State-Space Video World Modelscited by 59
- 2021Cycle-Consistent World Models for Domain Independent Latent Imaginationcited by 0
- 2025Long-Context State-Space Video World Models26 May 2025
- 2021Cycle-Consistent World Models for Domain Independent Latent Imagination2 Oct 2021
- 2023Zero-shot Image-to-Image Translationcited by 503
- 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
- 2021Dynamic Neural Networks: A Surveycited by 405
- 2021GAN Inversion: A Surveycited by 366
- 2022CelebV-HQ: A Large-Scale Video Facial Attributes Datasetcited by 246
- 2021Large Scale Image Completion via Co-Modulated Generative Adversarial Networkscited by 219
- 2023Style Aligned Image Generation via Shared Attentioncited by 214
- 2021RobustNet: Improving Domain Generalization in Urban-Scene Segmentation via Instance Selective Whiteningcited by 213
- 2021StyTr2: Image Style Transfer with Transformerscited by 186
- 2021Audio-Driven Emotional Video Portraitscited by 180
- 2023UCF: Uncovering Common Features for Generalizable Deepfake Detectioncited by 177
- 2021Hallucinated Neural Radiance Fields in the Wildcited by 130
12 most cited of 714 All 714 (JSON)
- 2026Values as Style: Disentangling Values from Semantics with One-Way Mixing for Low-Damage LLM Steering30 Sep 2026
- 2026PredRA: Fast Medical Image Translation by Deterministic Component Extraction and Controlled Stochastic Refinement25 Sep 2026
- 2026Anatomy-Decomposed Chest Computed Tomography (CT) Projections as Scalable Supervision for Bone Suppression in Chest Radiographs21 Sep 2026
- 2026Learned Parametric Emotion Editing: Real-Time Affective Filtering for On-Device Social Media Video18 Sep 2026
- 2026One Model, Two Worlds: Bidirectional Sonar-Optical Translation5 Sep 2026
- 2026Data-Efficient Networks for Multi-Contrast MRI Reconstruction based on a Generalized Content/Style Prior2 Sep 2026
- 2026Towards Reliable AI-Based Histological Staining: A Systematic Study of Scaling and Uncertainty in Unpaired Generative Models25 Aug 2026
- 2026HistReNeRF: Historic Image Relocalisation within Contemporary Neural Radiance Field Reconstructions15 Aug 2026
- 2026Where the Cost Falls: A Deployment-Aware Adoption Order for Stability Enhancements to Cycle-Consistent Adversarial Networks14 Aug 2026
- 2026Marginal Matching Does Not License Factorized Sampling: Auditing Conditional Style Leakage in Factorized Generative Models5 Aug 2026
- 2026DisMix: Order-Aware Mixup for Medical Imaging via Disentangling Ordinal and Non-Ordinal Features5 Aug 2026
- 2026Unpaired Joint Distribution Modeling via Multi-Scale Image Representations9 Jul 2026
12 newest of 714 All 714 (JSON)