Diverse Image-to-Image Translation via Disentangled Representations
Not on the map. Why?
Cited by 20 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Image-to-image translation aims to learn the mapping between two visual domains. There are two main challenges for many applications: 1) the lack of aligned training pairs and 2) multiple possible outputs from a single input image. In this work, we present an approach based on disentangled representation for producing diverse outputs without paired training images. To achieve diversity, we propose to embed images onto two spaces: a domain-invariant content space capturing shared information across domains and a domain-specific attribute space. Our model takes the encoded content features extracted from a given input and the attribute vectors sampled from the attribute space to produce diverse outputs at test time. To handle unpaired training data, we introduce a novel cross-cycle consistency loss based on disentangled representations. Qualitative results show that our model can generate diverse and realistic images on a wide range of tasks without paired training data. For quantitative comparisons, we measure realism with user study and diversity with a perceptual distance metric. We apply the proposed model to domain adaptation and show competitive performance when compared to the state-of-the-art on the MNIST-M and the LineMod datasets.
Key facts. Cited by 296 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Aug 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 1; 2021: 83; 2022: 58; 2023: 68; 2024: 33; 2025: 29; 2026: 23.
296 papers.
Sort:
By area:
- 2023Zero-shot Image-to-Image Translationcited by 503
- 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
- 2021GAN Inversion: A Surveycited by 366
- 2021RobustNet: Improving Domain Generalization in Urban-Scene Segmentation via Instance Selective Whiteningcited by 213
- 2021Audio-Driven Emotional Video Portraitscited by 180
- 2022EGSDE: Unpaired Image-to-Image Translation via Energy-Guided Stochastic Differential Equationscited by 172
- 2023Multi-modal Learning with Missing Modality via Shared-Specific Feature Modellingcited by 159
- 2023StyleDiffusion: Controllable Disentangled Style Transfer via Diffusion Modelscited by 154
- 2021UNIT-DDPM: UNpaired Image Translation with Denoising Diffusion Probabilistic Modelscited by 133
- 2022Semantic Image Synthesis via Diffusion Modelscited by 131
- 2021Hallucinated Neural Radiance Fields in the Wildcited by 130
- 2021Learning Debiased Representation via Disentangled Feature Augmentationcited by 116
38 more
- 2022Disentangled Representation Learningcited by 111
- 2024One-Step Image Translation with Text-to-Image Modelscited by 111
- 2022A Comprehensive Survey of Image Augmentation Techniques for Deep Learningcited by 95
- 2023DisenBooth: Identity-Preserving Disentangled Tuning for Subject-Driven Text-to-Image Generationcited by 75
- 2021Enhancing Photorealism Enhancementcited by 74
- 2021Dual Contrastive Learning for Unsupervised Image-to-Image Translationcited by 65
- 2022DearKD: Data-Efficient Early Knowledge Distillation for Vision Transformerscited by 65
- 2021High-Resolution Photorealistic Image Translation in Real-Time: A Laplacian Pyramid Translation Networkcited by 61
- 2021In&Out : Diverse Image Outpainting via GAN Inversioncited by 55
- 2022Few Shot Generative Model Adaption via Relaxed Spatial Structural Alignmentcited by 54
- 2021Deceive D: Adaptive Pseudo Augmentation for GAN Training with Limited Datacited by 53
- 2021Multimodal Image Synthesis and Editing: The Generative AI Eracited by 52
- 2022STPLS3D: A Large-Scale Synthetic and Real Aerial Photogrammetry 3D Point Cloud Datasetcited by 52
- 2023C-SFDA: A Curriculum Learning Aided Self-Training Framework for Efficient Source Free Domain Adaptationcited by 49
- 2021Vector-Decomposed Disentanglement for Domain-Invariant Object Detectioncited by 47
- 2021BlendGAN: Implicitly GAN Blending for Arbitrary Stylized Face Generationcited by 47
- 2022A survey of multimodal deep generative modelscited by 47
- 2021Style Normalization and Restitution for Domain Generalization and Adaptationcited by 46
- 2021Learning Disentangled Representations in the Imaging Domaincited by 46
- 2022CCPL: Contrastive Coherence Preserving Loss for Versatile Style Transfercited by 46
- 2021Vision Transformers with Patch Diversificationcited by 45
- 2021Instance-wise Hard Negative Example Generation for Contrastive Learning in Unpaired Image-to-Image Translationcited by 45
- 2021Pose with Style: Detail-Preserving Pose-Guided Image Synthesis with Conditional StyleGANcited by 45
- 2022UVCGAN: UNet Vision Transformer cycle-consistent GAN for unpaired image-to-image translationcited by 42
- 2022Adaptively-Realistic Image Generation from Stroke and Sketch with Diffusion Modelcited by 39
- 2022StudioGAN: A Taxonomy and Benchmark of GANs for Image Synthesiscited by 38
- 2021Understanding Latent Correlation-Based Multiview Learning and Self-Supervision: An Identifiability Perspectivecited by 37
- 2023Exploiting Diffusion Prior for Generalizable Dense Predictioncited by 37
- 2021Smoothing the Disentangled Latent Style Space for Unsupervised Image-to-Image Translationcited by 35
- 2022Do better ImageNet classifiers assess perceptual similarity better?cited by 34
- 2022Occlusion-Aware Self-Supervised Monocular 6D Object Pose Estimationcited by 34
- 2023DiffFashion: Reference-based Fashion Design with Structure-aware Transfer by Diffusion Modelscited by 33
- 2021Self-Adversarial Disentangling for Specific Domain Adaptationcited by 29
- 2021StyleFusion: A Generative Model for Disentangling Spatial Segmentscited by 28
- 2023Primitive Generation and Semantic-related Alignment for Universal Zero-Shot Segmentationcited by 28
- 2023MaLP: Manipulation Localization Using a Proactive Schemecited by 26
- 2021Adversarial Open Domain Adaptation for Sketch-to-Photo Synthesiscited by 24
- 2021Conditional Invertible Neural Networks for Diverse Image-to-Image Translationcited by 24
50 most cited of 296 All 296 (JSON)
- 2026Revisiting Cross-Reconstruction for Generalizable Deepfake Detection1 Oct 2026
- 2026Values as Style: Disentangling Values from Semantics with One-Way Mixing for Low-Damage LLM Steering30 Sep 2026
- 2026Synthetic Thermal Image Generation for Real-Time Animal Detection Under Low-Visibility Conditions26 Sep 2026
- 2026Learned Parametric Emotion Editing: Real-Time Affective Filtering for On-Device Social Media Video18 Sep 2026
- 2026Flexible Motion Generation from Language and Style References7 Sep 2026
- 2026Marginal Matching Does Not License Factorized Sampling: Auditing Conditional Style Leakage in Factorized Generative Models5 Aug 2026
- 2026The Devil Is in the Leakage: A Disentangled Dual-Purification Framework for High-Fidelity Hairstyle Transfer13 Jul 2026
- 2026Geometry-Aware Style Transfer in 3D Gaussian Splatting23 Jun 2026
- 2026An Attention-based Model for Robust Forecasting with Missing Modality11 Jun 2026
- 2026Balancing Fidelity and Diversity in Diffusion Models via Symmetric Attention Decomposition: Hopfield Perspective26 May 2026
- 2026Component-Aware Structure-Preserving Style Transfer for Satellite Visual Sim2Real Data Construction19 May 2026
- 2026Discriminative Span as a Predictor of Synthetic Data Utility via Classifier Reconstruction10 May 2026
38 more
- 2026DBMSolver: A Training-free Diffusion Bridge Sampler for High-Quality Image-to-Image Translation7 May 2026
- 2026Bridging Day and Night: Target-Class Hallucination Suppression in Unpaired Image Translation17 Feb 2026
- 2026SIGMA: Selective-Interleaved Generation with Multi-Attribute Tokens7 Feb 2026
- 2026SAS-Net: Cross-Domain Image Registration as Inverse Rendering via Structure-Appearance Factorization6 Feb 2026
- 2026Unsupervised Synthetic Image Attribution: Alignment and Disentanglement30 Jan 2026
- 2026ProMist-5K: A Comprehensive Dataset for Digital Emulation of Cinematic Pro-Mist Filter Effects27 Jan 2026
- 2026Enhancing Visual In-Context Learning by Multi-Faceted Fusion15 Jan 2026
- 2026Bipartite Mode Matching for Vision Training Set Search from a Hierarchical Data Server14 Jan 2026
- 2026Learning Domain-Invariant Representations for Cross-Domain Image Registration via Scene-Appearance Disentanglement12 Jan 2026
- 2026Language-Grounded Multi-Domain Image Translation via Semantic Difference Guidance12 Jan 2026
- 2026Topology-aware Pathological Consistency Matching for Weakly-Paired IHC Virtual Staining6 Jan 2026
- 2025Deterministic Image-to-Image Translation via Denoising Brownian Bridge Models with Dual Approximators29 Dec 2025
- 2025Learning Common and Salient Generative Factors Between Two Image Datasets14 Dec 2025
- 2025TARDis: Time Attenuated Representation Disentanglement for Incomplete Multi-Modal Tumor Segmentation and Classification4 Dec 2025
- 2025Structure-Preserving Unpaired Image Translation to Photometrically Calibrate JunoCam with Hubble Data27 Nov 2025
- 2025TReFT: Taming Rectified Flow Models For One-Step Image Translation25 Nov 2025
- 2025UniMedVL: Unifying Medical Multimodal Understanding and Generation through Observation-Knowledge-Analysis17 Oct 2025
- 2025A Framework for Low-Effort Training Data Generation for Urban Semantic Segmentation13 Oct 2025
- 2025Contrastive-SDE: Guiding Stochastic Differential Equations with Contrastive Learning for Unpaired Image-to-Image Translation4 Oct 2025
- 2025Increasing the Diversity in RGB-to-Thermal Image Translation for Automotive Applications27 Sep 2025
- 2025MedShift: Implicit Conditional Transport for X-Ray Domain Adaptation29 Aug 2025
- 2025FCR: Investigating Generative AI models for Forensic Craniofacial Reconstruction25 Aug 2025
- 2025CycleDiff: Cycle Diffusion Models for Unpaired Image-to-image Translation8 Aug 2025
- 2025TimeNeRF: Building Generalizable Neural Radiance Fields across Time from Few-Shot Input Views18 Jul 2025
- 2025Image Translation with Kernel Prediction Networks for Semantic Segmentation11 Jul 2025
- 2025CycleVAR: Repurposing Autoregressive Model for Unsupervised One-Step Image Translation29 Jun 2025
- 2025Self-Paced Collaborative and Adversarial Network for Unsupervised Domain Adaptation24 Jun 2025
- 2025SSIMBaD: Sigma Scaling with SSIM-Guided Balanced Diffusion for AnimeFace Colorization4 Jun 2025
- 2025CryoCCD: Conditional Cycle-consistent Diffusion with Biophysical Modeling for Cryo-EM Synthesis29 May 2025
- 2025DC-Seg: Disentangled Contrastive Learning for Brain Tumor Segmentation with Missing Modalities17 May 2025
- 2025Generative Adversarial Networks with Limited Data: A Survey and Benchmarking7 Apr 2025
- 2025SCFANet: Style Distribution Constraint Feature Alignment Network For Pathological Staining Translation1 Apr 2025
- 2025Unpaired Translation of Chest X-ray Images for Lung Opacity Diagnosis via Adaptive Activation Masks and Cross-Domain Alignment25 Mar 2025
- 2025DiffV2IR: Visible-to-Infrared Diffusion Model via Vision-Language Understanding24 Mar 2025
- 2025Language-Guided Visual Perception Disentanglement for Image Quality Assessment and Conditional Image Generation4 Mar 2025
- 2025Learning to Synthesize Compatible Fashion Items Using Semantic Alignment and Collocation Classification: An Outfit Generation Framework5 Feb 2025
- 2025BC-GAN: A Generative Adversarial Network for Synthesizing a Batch of Collocated Clothing3 Feb 2025
- 2025FCBoost-Net: A Generative Network for Synthesizing Multiple Collocated Outfits via Fashion Compatibility Boosting3 Feb 2025
50 newest of 296 All 296 (JSON)
- 2022EGSDE: Unpaired Image-to-Image Translation via Energy-Guided Stochastic Differential Equationscited by 172
- 2023StyleDiffusion: Controllable Disentangled Style Transfer via Diffusion Modelscited by 154
- 2021UNIT-DDPM: UNpaired Image Translation with Denoising Diffusion Probabilistic Modelscited by 133
- 2022Semantic Image Synthesis via Diffusion Modelscited by 131
- 2024One-Step Image Translation with Text-to-Image Modelscited by 111
- 2022Adaptively-Realistic Image Generation from Stroke and Sketch with Diffusion Modelcited by 39
- 2023Exploiting Diffusion Prior for Generalizable Dense Predictioncited by 37
- 2023DiffFashion: Reference-based Fashion Design with Structure-aware Transfer by Diffusion Modelscited by 33
- 2025DiffV2IR: Visible-to-Infrared Diffusion Model via Vision-Language Understandingcited by 16
- 2023SDDM: Score-Decomposed Diffusion Models on Manifolds for Unpaired Image-to-Image Translationcited by 13
- 2024Closed-Loop Unsupervised Representation Disentanglement with β-VAE Distillation and Diffusion Probabilistic Feedbackcited by 9
- 2023Enhanced Controllability of Diffusion Models via Feature Disentanglement and Realism-Enhanced Sampling Methodscited by 7
12 most cited of 20 All 20 (JSON)
- 2026Balancing Fidelity and Diversity in Diffusion Models via Symmetric Attention Decomposition: Hopfield Perspective26 May 2026
- 2026DBMSolver: A Training-free Diffusion Bridge Sampler for High-Quality Image-to-Image Translation7 May 2026
- 2026SIGMA: Selective-Interleaved Generation with Multi-Attribute Tokens7 Feb 2026
- 2025TReFT: Taming Rectified Flow Models For One-Step Image Translation25 Nov 2025
- 2025CycleDiff: Cycle Diffusion Models for Unpaired Image-to-image Translation8 Aug 2025
- 2025CryoCCD: Conditional Cycle-consistent Diffusion with Biophysical Modeling for Cryo-EM Synthesis29 May 2025
- 2025DiffV2IR: Visible-to-Infrared Diffusion Model via Vision-Language Understanding24 Mar 2025
- 2024One-Step Image Translation with Text-to-Image Models18 Mar 2024
- 2024Closed-Loop Unsupervised Representation Disentanglement with β-VAE Distillation and Diffusion Probabilistic Feedback4 Feb 2024
- 2023Exploiting Diffusion Prior for Generalizable Dense Prediction30 Nov 2023
- 2023VI-Diff: Unpaired Visible-Infrared Translation Diffusion Model for Single Modality Labeled Visible-Infrared Person Re-identification6 Oct 2023
- 2023Multiple Noises in Diffusion Model for Semi-Supervised Multi-Domain Translation25 Sep 2023
12 newest of 20 All 20 (JSON)
- 2023Zero-shot Image-to-Image Translationcited by 503
- 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
- 2021GAN Inversion: A Surveycited by 366
- 2021RobustNet: Improving Domain Generalization in Urban-Scene Segmentation via Instance Selective Whiteningcited by 213
- 2021Audio-Driven Emotional Video Portraitscited by 180
- 2023Multi-modal Learning with Missing Modality via Shared-Specific Feature Modellingcited by 159
- 2021Hallucinated Neural Radiance Fields in the Wildcited by 130
- 2021Learning Debiased Representation via Disentangled Feature Augmentationcited by 116
- 2022Disentangled Representation Learningcited by 111
- 2022A Comprehensive Survey of Image Augmentation Techniques for Deep Learningcited by 95
- 2023DisenBooth: Identity-Preserving Disentangled Tuning for Subject-Driven Text-to-Image Generationcited by 75
- 2021Enhancing Photorealism Enhancementcited by 74
12 most cited of 269 All 269 (JSON)
- 2026Revisiting Cross-Reconstruction for Generalizable Deepfake Detection1 Oct 2026
- 2026Values as Style: Disentangling Values from Semantics with One-Way Mixing for Low-Damage LLM Steering30 Sep 2026
- 2026Synthetic Thermal Image Generation for Real-Time Animal Detection Under Low-Visibility Conditions26 Sep 2026
- 2026Learned Parametric Emotion Editing: Real-Time Affective Filtering for On-Device Social Media Video18 Sep 2026
- 2026Flexible Motion Generation from Language and Style References7 Sep 2026
- 2026Marginal Matching Does Not License Factorized Sampling: Auditing Conditional Style Leakage in Factorized Generative Models5 Aug 2026
- 2026The Devil Is in the Leakage: A Disentangled Dual-Purification Framework for High-Fidelity Hairstyle Transfer13 Jul 2026
- 2026Geometry-Aware Style Transfer in 3D Gaussian Splatting23 Jun 2026
- 2026An Attention-based Model for Robust Forecasting with Missing Modality11 Jun 2026
- 2026Component-Aware Structure-Preserving Style Transfer for Satellite Visual Sim2Real Data Construction19 May 2026
- 2026Bridging Day and Night: Target-Class Hallucination Suppression in Unpaired Image Translation17 Feb 2026
- 2026SAS-Net: Cross-Domain Image Registration as Inverse Rendering via Structure-Appearance Factorization6 Feb 2026
12 newest of 269 All 269 (JSON)