DRIT++: Diverse Image-to-Image Translation via Disentangled Representations
Not on the map. Why?
Abstract (arXiv)
Image-to-image translation aims to learn the mapping between two visual domains. There are two main challenges for this task: 1) lack of aligned training pairs and 2) multiple possible outputs from a single input image. In this work, we present an approach based on disentangled representation for generating diverse outputs without paired training images. To synthesize diverse outputs, we propose to embed images onto two spaces: a domain-invariant content space capturing shared information across domains and a domain-specific attribute space. Our model takes the encoded content features extracted from a given input and attribute vectors sampled from the attribute space to synthesize diverse outputs at test time. To handle unpaired training data, we introduce a cross-cycle consistency loss based on disentangled representations. Qualitative results show that our model can generate diverse and realistic images on a wide range of tasks without paired training data. For quantitative evaluations, we measure realism with user study and Fr'echet inception distance, and measure diversity with the perceptual distance metric, Jensen-Shannon divergence, and number of statistically-different bins.
Key facts. Cited by 244 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 106; 2022: 57; 2023: 40; 2024: 22; 2025: 13; 2026: 5.
244 papers.
Sort:
By area:
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 222
- 2021GAN Prior Embedded Network for Blind Face Restoration in the Wildcited by 197
- 2022NeRF-Art: Text-Driven Neural Radiance Fields Stylizationcited by 126
- 2021Image-to-Image Translation: Methods and Applicationscited by 116
- 2021Regularizing Generative Adversarial Networks under Limited Datacited by 105
- 2022A Comprehensive Survey of Image Augmentation Techniques for Deep Learningcited by 95
- 2021Only a Matter of Style: Age Transformation Using a Style-Based Regression Modelcited by 92
- 2021Learning by Watching: Physical Imitation of Manipulation Skills from Human Videoscited by 87
- 2023ProSpect: Prompt Spectrum for Attribute-Aware Personalization of Diffusion Modelscited by 75
- 2021The Spatially-Correlative Loss for Various Image Translation Taskscited by 66
- 2021Dual Contrastive Learning for Unsupervised Image-to-Image Translationcited by 65
38 more
- 2022Motion Puzzle: Arbitrary Motion Style Transfer by Body Partcited by 64
- 2021Image-to-image Translation via Hierarchical Style Disentanglementcited by 63
- 2021InfinityGAN: Towards Infinite-Pixel Image Synthesiscited by 61
- 2022BCI: Breast Cancer Immunohistochemical Image Generation through Pyramid Pix2pixcited by 61
- 2021Reverse Engineering of Generative Models: Inferring Model Hyperparameters from Generated Imagescited by 58
- 2021Anycost GANs for Interactive Image Synthesis and Editingcited by 54
- 2021Enjoy Your Editing: Controllable GANs for Image Editing via Latent Space Navigationcited by 53
- 2021Learning the Predictability of the Futurecited by 48
- 2021StyleAlign: Analysis and Applications of Aligned StyleGAN Modelscited by 48
- 2021BlendGAN: Implicitly GAN Blending for Arbitrary Stylized Face Generationcited by 47
- 2024XoFTR: Cross-modal Feature Matching Transformercited by 45
- 2022Exploring Patch-wise Semantic Relation for Contrastive Learning in Image-to-Image Translation Taskscited by 42
- 2021Unbalanced Feature Transport for Exemplar-based Image Translationcited by 41
- 2021Fighting deepfakes by detecting GAN DCT anomaliescited by 39
- 2022QS-Attn: Query-Selected Attention for Contrastive Learning in I2I Translationcited by 39
- 2021DivCo: Diverse Conditional Image Synthesis via Contrastive Generative Adversarial Networkcited by 37
- 2021Sketch Your Own GANcited by 37
- 2023Exploiting Diffusion Prior for Generalizable Dense Predictioncited by 37
- 2021Closing the Loop: Joint Rain Generation and Removal via Disentangled Image Translationcited by 36
- 2021Bridging the Gap between Events and Frames through Unsupervised Domain Adaptationcited by 36
- 2021Smoothing the Disentangled Latent Style Space for Unsupervised Image-to-Image Translationcited by 35
- 2021Video Autoencoder: self-supervised disentanglement of static 3D structure and motioncited by 34
- 2022Neural Template: Topology-aware Reconstruction and Disentangled Generation of 3D Meshescited by 34
- 2021Structure-Preserving Multi-Domain Stain Color Augmentation using Style-Transfer with Disentangled Representationscited by 31
- 2023Edge-guided Multi-domain RGB-to-TIR image Translation for Training Vision Tasks with Challenging Labelscited by 30
- 2022InstaFormer: Instance-Aware Image-to-Image Translation with Transformercited by 28
- 2021CoMoGAN: continuous model-guided image-to-image translationcited by 27
- 2021Where and What? Examining Interpretable Disentangled Representationscited by 27
- 2021AniGAN: Style-Guided Generative Adversarial Networks for Unsupervised Anime Face Generationcited by 25
- 2021UDA-COPE: Unsupervised Domain Adaptation for Category-level Object Pose Estimationcited by 25
- 2024CharacterFactory: Sampling Consistent Characters with GANs for Diffusion Modelscited by 24
- 2021Representation Disentanglement for Multi-modal brain MR Analysiscited by 22
- 2023Controllable Inversion of Black-Box Face Recognition Models via Diffusioncited by 22
- 2021Long-Term Temporally Consistent Unpaired Video Translation from Simulated Surgical 3D Datacited by 21
- 2021Semi-supervised Synthesis of High-Resolution Editable Textures for 3D Humanscited by 21
- 2021Exemplar-Based 3D Portrait Stylizationcited by 21
- 2021Discovering Distinctive "Semantics" in Super-Resolution Networkscited by 20
- 2022Sim-to-Real Domain Adaptation for Lane Detection and Classification in Autonomous Drivingcited by 20
50 most cited of 244 All 244 (JSON)
- 2026Anatomy-Decomposed Chest Computed Tomography (CT) Projections as Scalable Supervision for Bone Suppression in Chest Radiographs21 Sep 2026
- 2026FROD: Feature Matching Residual Denoising Oracle Bone Decipher15 Sep 2026
- 2026Unpaired Joint Distribution Modeling via Multi-Scale Image Representations9 Jul 2026
- 2026Content-Style Identification via Differential Independence18 May 2026
- 2026From Snow to Rain: Evaluating Robustness, Calibration, and Complexity of Model-Based Robust Training14 Jan 2026
- 2025PADM: A Physics-aware Diffusion Model for Attenuation Correction10 Nov 2025
- 2025Unsupervised Domain Adaptation via Content Alignment for Hippocampus Segmentation15 Oct 2025
- 2025StyDeco: Unsupervised Style Transfer with Distilling Priors and Semantic Decoupling2 Aug 2025
- 2025Image Translation with Kernel Prediction Networks for Semantic Segmentation11 Jul 2025
- 2025L-VAE: Variational Auto-Encoder with Learnable Beta for Disentangled Representation3 Jul 2025
- 2025Unpaired Image-to-Image Translation for Segmentation and Signal Unmixing27 May 2025
- 2025Generative Adversarial Networks with Limited Data: A Survey and Benchmarking7 Apr 2025
38 more
- 2025EmoAgent: A Multi-Agent Framework for Diverse Affective Image Manipulation14 Mar 2025
- 2025Patch-Wise Hypergraph Contrastive Learning with Dual Normal Distribution Weighting for Multi-Domain Stain Transfer12 Mar 2025
- 2025Learning to Synthesize Compatible Fashion Items Using Semantic Alignment and Collocation Classification: An Outfit Generation Framework5 Feb 2025
- 2025BC-GAN: A Generative Adversarial Network for Synthesizing a Batch of Collocated Clothing3 Feb 2025
- 2025FCBoost-Net: A Generative Network for Synthesizing Multiple Collocated Outfits via Fashion Compatibility Boosting3 Feb 2025
- 2025Towards Intelligent Design: A Self-driven Framework for Collocated Clothing Synthesis Leveraging Fashion Styles and Textures23 Jan 2025
- 2024Mechanisms of Generative Image-to-Image Translation Networks15 Nov 2024
- 2024Content-Style Learning from Unaligned Domains: Identifiability under Unknown Latent Dimensions6 Nov 2024
- 2024CT to PET Translation: A Large-scale Dataset and Domain-Knowledge-Guided Diffusion Approach29 Oct 2024
- 2024SinoSynth: A Physics-based Domain Randomization Approach for Generalizable CBCT Image Enhancement27 Sep 2024
- 2024Image-to-Image Translation Based on Deep Generative Modeling for Radiotherapy Synthetic Dataset Creation17 Sep 2024
- 2024Enhancing Cross-Modal Medical Image Segmentation through Compositionality21 Aug 2024
- 2024Image class translation: visual inspection of class-specific hypotheticals and classification based on translation distance16 Aug 2024
- 2024Learning at a Glance: Towards Interpretable Data-limited Continual Semantic Segmentation via Semantic-Invariance Modelling22 Jul 2024
- 2024Semi-supervised reference-based sketch extraction using a contrastive learning framework19 Jul 2024
- 2024Frequency-Controlled Diffusion Model for Versatile Text-Guided Image-to-Image Translation3 Jul 2024
- 2024DifAttack++: Query-Efficient Black-Box Adversarial Attack via Hierarchical Disentangled Feature Space in Cross-Domain5 Jun 2024
- 2024Deciphering Oracle Bone Language with Diffusion Models2 Jun 2024
- 2024Sparse Domain Transfer via Elastic Net Regularization13 May 2024
- 2024CharacterFactory: Sampling Consistent Characters with GANs for Diffusion Models24 Apr 2024
- 2024XoFTR: Cross-modal Feature Matching Transformer15 Apr 2024
- 2024Unsupervised Tumor-Aware Distillation for Multi-Modal Brain Image Translation29 Mar 2024
- 2024HEMIT: H&E to Multiplex-immunohistochemistry Image Translation with Dual-Branch Pix2pix Generator27 Mar 2024
- 2024Total Disentanglement of Font Images into Style and Character Class Features19 Mar 2024
- 2024Scene Depth Estimation from Traditional Oriental Landscape Paintings6 Mar 2024
- 2024ToonAging: Face Re-Aging upon Artistic Portrait Style Transfer5 Feb 2024
- 2024Contrastive Learning and Cycle Consistency-based Transductive Transfer Learning for Target Annotation22 Jan 2024
- 2024Learning to Generalize over Subpartitions for Heterogeneity-aware Domain Adaptive Nuclei Segmentation17 Jan 2024
- 2023RainSD: Rain Style Diversification Module for Image Synthesis Enhancement using Feature-Level Style Distribution31 Dec 2023
- 2023Domain Adaptive Imitation Learning with Visual Observation1 Dec 2023
- 2023Exploiting Diffusion Prior for Generalizable Dense Prediction30 Nov 2023
- 2023One-step Diffusion with Distribution Matching Distillation30 Nov 2023
- 2023SMaRt: Improving GANs with Score Matching Regularity30 Nov 2023
- 2023SCONE-GAN: Semantic Contrastive learning-based Generative Adversarial Network for an end-to-end image translation7 Nov 2023
- 2023Nighttime Thermal Infrared Image Colorization with Feedback-based Object Appearance Learning24 Oct 2023
- 2023SemST: Semantically Consistent Multi-Scale Image Translation via Structure-Texture Alignment8 Oct 2023
- 2023Improving style transfer in dynamic contrast enhanced MRI using a spatio-temporal approach3 Oct 2023
- 2023Dark Side Augmentation: Generating Diverse Night Examples for Metric Learning28 Sep 2023
50 newest of 244 All 244 (JSON)
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 222
- 2023ProSpect: Prompt Spectrum for Attribute-Aware Personalization of Diffusion Modelscited by 75
- 2023Exploiting Diffusion Prior for Generalizable Dense Predictioncited by 37
- 2024CharacterFactory: Sampling Consistent Characters with GANs for Diffusion Modelscited by 24
- 2023Controllable Inversion of Black-Box Face Recognition Models via Diffusioncited by 22
- 2022HS-Diffusion: Semantic-Mixing Diffusion for Head Swappingcited by 12
- 2024Frequency-Controlled Diffusion Model for Versatile Text-Guided Image-to-Image Translationcited by 12
- 2023SMaRt: Improving GANs with Score Matching Regularitycited by 6
- 2024CT to PET Translation: A Large-scale Dataset and Domain-Knowledge-Guided Diffusion Approachcited by 3
- 2025StyDeco: Unsupervised Style Transfer with Distilling Priors and Semantic Decouplingcited by 1
- 2025PADM: A Physics-aware Diffusion Model for Attenuation Correctioncited by 1
12 most cited of 14 All 14 (JSON)
- 2026FROD: Feature Matching Residual Denoising Oracle Bone Decipher15 Sep 2026
- 2025PADM: A Physics-aware Diffusion Model for Attenuation Correction10 Nov 2025
- 2025StyDeco: Unsupervised Style Transfer with Distilling Priors and Semantic Decoupling2 Aug 2025
- 2024CT to PET Translation: A Large-scale Dataset and Domain-Knowledge-Guided Diffusion Approach29 Oct 2024
- 2024Frequency-Controlled Diffusion Model for Versatile Text-Guided Image-to-Image Translation3 Jul 2024
- 2024CharacterFactory: Sampling Consistent Characters with GANs for Diffusion Models24 Apr 2024
- 2023Exploiting Diffusion Prior for Generalizable Dense Prediction30 Nov 2023
- 2023One-step Diffusion with Distribution Matching Distillation30 Nov 2023
- 2023SMaRt: Improving GANs with Score Matching Regularity30 Nov 2023
- 2023Multiple Noises in Diffusion Model for Semi-Supervised Multi-Domain Translation25 Sep 2023
- 2023ProSpect: Prompt Spectrum for Attribute-Aware Personalization of Diffusion Models25 May 2023
- 2023Controllable Inversion of Black-Box Face Recognition Models via Diffusion23 Mar 2023
12 newest of 14 All 14 (JSON)
- 2023Domain Adaptive Imitation Learning with Visual Observationcited by 11
- 2020Cross-Domain Imitation Learning with a Dual Structurecited by 1
- 2023Domain Adaptive Imitation Learning with Visual Observation1 Dec 2023
- 2020Cross-Domain Imitation Learning with a Dual Structure2 Jun 2020
- 2021GAN Prior Embedded Network for Blind Face Restoration in the Wildcited by 197
- 2022NeRF-Art: Text-Driven Neural Radiance Fields Stylizationcited by 126
- 2021Image-to-Image Translation: Methods and Applicationscited by 116
- 2021Regularizing Generative Adversarial Networks under Limited Datacited by 105
- 2022A Comprehensive Survey of Image Augmentation Techniques for Deep Learningcited by 95
- 2021Only a Matter of Style: Age Transformation Using a Style-Based Regression Modelcited by 92
- 2021Learning by Watching: Physical Imitation of Manipulation Skills from Human Videoscited by 87
- 2021The Spatially-Correlative Loss for Various Image Translation Taskscited by 66
- 2021Dual Contrastive Learning for Unsupervised Image-to-Image Translationcited by 65
- 2022Motion Puzzle: Arbitrary Motion Style Transfer by Body Partcited by 64
- 2021Image-to-image Translation via Hierarchical Style Disentanglementcited by 63
- 2021InfinityGAN: Towards Infinite-Pixel Image Synthesiscited by 61
12 most cited of 228 All 228 (JSON)
- 2026Anatomy-Decomposed Chest Computed Tomography (CT) Projections as Scalable Supervision for Bone Suppression in Chest Radiographs21 Sep 2026
- 2026Unpaired Joint Distribution Modeling via Multi-Scale Image Representations9 Jul 2026
- 2026Content-Style Identification via Differential Independence18 May 2026
- 2026From Snow to Rain: Evaluating Robustness, Calibration, and Complexity of Model-Based Robust Training14 Jan 2026
- 2025Unsupervised Domain Adaptation via Content Alignment for Hippocampus Segmentation15 Oct 2025
- 2025Image Translation with Kernel Prediction Networks for Semantic Segmentation11 Jul 2025
- 2025L-VAE: Variational Auto-Encoder with Learnable Beta for Disentangled Representation3 Jul 2025
- 2025Unpaired Image-to-Image Translation for Segmentation and Signal Unmixing27 May 2025
- 2025Generative Adversarial Networks with Limited Data: A Survey and Benchmarking7 Apr 2025
- 2025EmoAgent: A Multi-Agent Framework for Diverse Affective Image Manipulation14 Mar 2025
- 2025Patch-Wise Hypergraph Contrastive Learning with Dual Normal Distribution Weighting for Multi-Domain Stain Transfer12 Mar 2025
- 2025Learning to Synthesize Compatible Fashion Items Using Semantic Alignment and Collocation Classification: An Outfit Generation Framework5 Feb 2025
12 newest of 228 All 228 (JSON)