Dual Contrastive Learning for Unsupervised Image-to-Image Translation
Not on the map. Why?
Abstract (arXiv)
Unsupervised image-to-image translation tasks aim to find a mapping between a source domain X and a target domain Y from unpaired training data. Contrastive learning for Unpaired image-to-image Translation (CUT) yields state-of-the-art results in modeling unsupervised image-to-image translation by maximizing mutual information between input and output patches using only one encoder for both domains. In this paper, we propose a novel method based on contrastive learning and a dual learning setting (exploiting two encoders) to infer an efficient mapping between unpaired data. Additionally, while CUT suffers from mode collapse, a variant of our method efficiently addresses this issue. We further demonstrate the advantage of our approach through extensive ablation studies demonstrating superior performance comparing to recent approaches in multiple challenging image translation tasks. Lastly, we demonstrate that the gap between unsupervised methods and supervised methods can be efficiently closed.
Key facts. Cited by 65 papers in the map (data through 7 Oct 2026). Builds on 39 of its 48 references that are in the map. First posted on arXiv 15 Apr 2021.
Builds on
39 of 48 references.
References · 39
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2016Improved Techniques for Training GANscited by 2,938
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
- 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,187
27 more
- 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,176
- 2016Colorful Image Colorizationcited by 1,113
- 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,095
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
- 2016Least Squares Generative Adversarial Networkscited by 1,000
- 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 902
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
- 2019Data-Efficient Image Recognition with Contrastive Predictive Codingcited by 672
- 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 637
- 2017Unsupervised Image-to-Image Translation Networkscited by 602
- 2017DualGAN: Unsupervised Dual Learning for Image-to-Image Translationcited by 310
- 2018Diverse Image-to-Image Translation via Disentangled Representationscited by 296
- 2017Learning to Discover Cross-Domain Relations with Generative Adversarial Networkscited by 278
- 2019DRIT++: Diverse Image-to-Image Translation via Disentangled Representationscited by 244
- 2017Geometric GANcited by 232
- 2020Self-supervised Co-training for Video Representation Learningcited by 232
- 2017Photographic Image Synthesis with Cascaded Refinement Networkscited by 223
- 2018Unsupervised Image Super-Resolution using Cycle-in-Cycle Generative Adversarial Networkscited by 133
- 2018Geometry-Consistent Generative Adversarial Networks for One-Sided Unsupervised Domain Mappingcited by 113
- 2017One-Sided Unsupervised Domain Mappingcited by 91
- 2020Reusing Discriminators for Encoding: Towards Unsupervised Image-to-Image Translationcited by 60
- 2020Unpaired Image-to-Image Translation using Adversarial Consistency Losscited by 43
- 2019Breaking the cycle -- Colleagues are all you needcited by 40
- 2017ALICE: Towards Understanding Adversarial Learning for Joint Distribution Matchingcited by 32
- 2021Single Underwater Image Restoration by Contrastive Learningcited by 11
- 2017Discriminative Region Proposal Adversarial Networks for High-Quality Image-to-Image Translationcited by 8
Built on by
Citing papers per year: 2021: 8; 2022: 9; 2023: 15; 2024: 16; 2025: 9; 2026: 8.
65 papers.
Sort:
By area:
- 2024One-Step Image Translation with Text-to-Image Modelscited by 111
- 2022Domain Enhanced Arbitrary Image Style Transfer via Contrastive Learningcited by 93
- 2021Multimodal Conditional Image Synthesis with Product-of-Experts GANscited by 75
- 2021Unpaired Deep Image Deraining Using Dual Contrastive Learningcited by 60
- 2024RainMamba: Enhanced Locality Learning with State Space Models for Video Derainingcited by 56
- 2021Contrastive Learning for Neural Topic Modelcited by 48
- 2024XoFTR: Cross-modal Feature Matching Transformercited by 45
- 2023Disentangling Writer and Character Styles for Handwriting Generationcited by 35
- 2021A Practical Contrastive Learning Framework for Single-Image Super-Resolutioncited by 30
- 2023Edge-guided Multi-domain RGB-to-TIR image Translation for Training Vision Tasks with Challenging Labelscited by 30
- 2022You Only Cut Once: Boosting Data Augmentation with a Single Cutcited by 22
- 2022Unpaired Deep Image Dehazing Using Contrastive Disentanglement Learningcited by 21
38 more
- 2023Self-supervised Learning for Pre-Training 3D Point Clouds: A Surveycited by 21
- 2021Blind Image Decompositioncited by 18
- 2022Feature Distribution Matching for Federated Domain Generalizationcited by 18
- 2023AGTGAN: Unpaired Image Translation for Photographic Ancient Character Generationcited by 17
- 2023Synthetic optical coherence tomography angiographs for detailed retinal vessel segmentation without human annotationscited by 16
- 2021Underwater Image Restoration via Contrastive Learning and a Real-world Datasetcited by 15
- 2023Spectral Normalization and Dual Contrastive Regularization for Image-to-Image Translationcited by 11
- 2024Unpaired Photo-realistic Image Deraining with Energy-informed Diffusion Modelcited by 11
- 2023A Unified Arbitrary Style Transfer Framework via Adaptive Contrastive Learningcited by 10
- 2022ContraReg: Contrastive Learning of Multi-modality Unsupervised Deformable Image Registrationcited by 9
- 2024CARLA2Real: a tool for reducing the sim2real appearance gap in CARLA simulatorcited by 8
- 2024The Dawn of KAN in Image-to-Image (I2I) Translation: Integrating Kolmogorov-Arnold Networks with GANs for Unpaired I2I Translationcited by 7
- 2022Exploring Negatives in Contrastive Learning for Unpaired Image-to-Image Translationcited by 6
- 2025CycleDiff: Cycle Diffusion Models for Unpaired Image-to-image Translationcited by 6
- 2023Multi-cropping Contrastive Learning and Domain Consistency for Unsupervised Image-to-Image Translationcited by 5
- 2025Deterministic Image-to-Image Translation via Denoising Brownian Bridge Models with Dual Approximatorscited by 5
- 2023NoiseTransfer: Image Noise Generation with Contrastive Embeddingscited by 4
- 2024Spectrum Translation for Refinement of Image Generation (STIG) Based on Contrastive Learning and Spectral Filter Profilecited by 4
- 2024Bridging the Gap between Real-world and Synthetic Images for Testing Autonomous Driving Systemscited by 4
- 2023Hate Speech Detection via Dual Contrastive Learningcited by 3
- 2023Incorporating Domain Knowledge Graph into Multimodal Movie Genre Classification with Self-Supervised Attention and Contrastive Learningcited by 3
- 2024Rethink Arbitrary Style Transfer with Transformer and Contrastive Learningcited by 3
- 2024Unsupervised Variational Translator for Bridging Image Restoration and High-Level Vision Taskscited by 3
- 2025REGEN: Real-Time Photorealism Enhancement in Games via a Dual-Stage Generative Network Frameworkcited by 3
- 2024Contrastive Learning and Cycle Consistency-based Transductive Transfer Learning for Target Annotationcited by 2
- 2024I2I-Galip: Unsupervised Medical Image Translation Using Generative Adversarial CLIPcited by 2
- 2025CM-Diff: A Single Generative Network for Bidirectional Cross-Modality Translation Diffusion Model Between Infrared and Visible Imagescited by 2
- 2021Separating Content and Style for Unsupervised Image-to-Image Translationcited by 1
- 2022Image Harmonization with Region-wise Contrastive Learningcited by 1
- 2023SAR-to-Optical Image Translation via Thermodynamics-inspired Networkcited by 1
- 2025crossMoDA Challenge: Evolution of Cross-Modality Domain Adaptation Techniques for Vestibular Schwannoma and Cochlea Segmentation from 2021 to 2023cited by 1
- 2025CycleVAR: Repurposing Autoregressive Model for Unsupervised One-Step Image Translationcited by 1
- 2025MedShift: Implicit Conditional Transport for X-Ray Domain Adaptationcited by 1
- 2025WeatherCycle: Unpaired Multi-Weather Restoration via Color Space Decoupled Cycle Learningcited by 1
- 2025TReFT: Taming Rectified Flow Models For One-Step Image Translationcited by 1
- 2026HyPER-GAN: Hybrid Patch-Based Image-to-Image Translation for Real-Time Photorealism Enhancement in Game Enginescited by 1
- 2021Image-to-image Translation as a Unique Source of Knowledgecited by 0
- 2022Enhancing Generative Networks for Chest Anomaly Localization through Automatic Registration-Based Unpaired-to-Pseudo-Paired Training Data Translationcited by 0
50 most cited of 65 All 65 (JSON)
- 2026Anatomy-Decomposed Chest Computed Tomography (CT) Projections as Scalable Supervision for Bone Suppression in Chest Radiographs21 Sep 2026
- 2026GAN-Based Semantic Communication for Image Transmission in IoV28 Aug 2026
- 2026Towards Reliable AI-Based Histological Staining: A Systematic Study of Scaling and Uncertainty in Unpaired Generative Models25 Aug 2026
- 2026Source-Agnostic Image Translation Based on Latent Aware Adaptive Masking14 Aug 2026
- 2026UniCycleFlow: Bidirectional Unpaired Image Translation with a Shared Rectified Flow7 Aug 2026
- 2026Unpaired Joint Distribution Modeling via Multi-Scale Image Representations9 Jul 2026
- 2026HyPER-GAN: Hybrid Patch-Based Image-to-Image Translation for Real-Time Photorealism Enhancement in Game Engines11 Mar 2026
- 2026Efficient endometrial carcinoma screening via cross-modal synthesis and gradient distillation23 Feb 2026
- 2025Deterministic Image-to-Image Translation via Denoising Brownian Bridge Models with Dual Approximators29 Dec 2025
- 2025TReFT: Taming Rectified Flow Models For One-Step Image Translation25 Nov 2025
- 2025WeatherCycle: Unpaired Multi-Weather Restoration via Color Space Decoupled Cycle Learning27 Sep 2025
- 2025MedShift: Implicit Conditional Transport for X-Ray Domain Adaptation29 Aug 2025
38 more
- 2025REGEN: Real-Time Photorealism Enhancement in Games via a Dual-Stage Generative Network Framework23 Aug 2025
- 2025CycleDiff: Cycle Diffusion Models for Unpaired Image-to-image Translation8 Aug 2025
- 2025CycleVAR: Repurposing Autoregressive Model for Unsupervised One-Step Image Translation29 Jun 2025
- 2025crossMoDA Challenge: Evolution of Cross-Modality Domain Adaptation Techniques for Vestibular Schwannoma and Cochlea Segmentation from 2021 to 202313 Jun 2025
- 2025CM-Diff: A Single Generative Network for Bidirectional Cross-Modality Translation Diffusion Model Between Infrared and Visible Images12 Mar 2025
- 2024NijiGAN: Transform What You See into Anime with Contrastive Semi-Supervised Learning and Neural Ordinary Differential Equations27 Dec 2024
- 2024CARLA2Real: a tool for reducing the sim2real appearance gap in CARLA simulator23 Oct 2024
- 2024Enhanced Unsupervised Image-to-Image Translation Using Contrastive Learning and Histogram of Oriented Gradients24 Sep 2024
- 2024I2I-Galip: Unsupervised Medical Image Translation Using Generative Adversarial CLIP19 Sep 2024
- 2024Embedded Image-to-Image Translation for Efficient Sim-to-Real Transfer in Learning-based Robot-Assisted Soft Manipulation16 Sep 2024
- 2024Bridging the Gap between Real-world and Synthetic Images for Testing Autonomous Driving Systems25 Aug 2024
- 2024The Dawn of KAN in Image-to-Image (I2I) Translation: Integrating Kolmogorov-Arnold Networks with GANs for Unpaired I2I Translation15 Aug 2024
- 2024Unsupervised Variational Translator for Bridging Image Restoration and High-Level Vision Tasks15 Aug 2024
- 2024RainMamba: Enhanced Locality Learning with State Space Models for Video Deraining31 Jul 2024
- 2024Unpaired Photo-realistic Image Deraining with Energy-informed Diffusion Model24 Jul 2024
- 2024Rethink Arbitrary Style Transfer with Transformer and Contrastive Learning21 Apr 2024
- 2024XoFTR: Cross-modal Feature Matching Transformer15 Apr 2024
- 2024Separated Attention: An Improved Cycle GAN Based Under Water Image Enhancement Method11 Apr 2024
- 2024One-Step Image Translation with Text-to-Image Models18 Mar 2024
- 2024Spectrum Translation for Refinement of Image Generation (STIG) Based on Contrastive Learning and Spectral Filter Profile8 Mar 2024
- 2024Contrastive Learning and Cycle Consistency-based Transductive Transfer Learning for Target Annotation22 Jan 2024
- 2023Incorporating Domain Knowledge Graph into Multimodal Movie Genre Classification with Self-Supervised Attention and Contrastive Learning12 Oct 2023
- 2023Disentangled Contrastive Image Translation for Nighttime Surveillance11 Jul 2023
- 2023Hate Speech Detection via Dual Contrastive Learning10 Jul 2023
- 2023Synthetic optical coherence tomography angiographs for detailed retinal vessel segmentation without human annotations19 Jun 2023
- 2023Zero shot framework for satellite image restoration5 Jun 2023
- 2023SAR-to-Optical Image Translation via Thermodynamics-inspired Network23 May 2023
- 2023Self-supervised Learning for Pre-Training 3D Point Clouds: A Survey8 May 2023
- 2023ContraNeRF: 3D-Aware Generative Model via Contrastive Learning with Unsupervised Implicit Pose Embedding27 Apr 2023
- 2023Multi-cropping Contrastive Learning and Domain Consistency for Unsupervised Image-to-Image Translation24 Apr 2023
- 2023Spectral Normalization and Dual Contrastive Regularization for Image-to-Image Translation22 Apr 2023
- 2023Disentangling Writer and Character Styles for Handwriting Generation26 Mar 2023
- 2023AGTGAN: Unpaired Image Translation for Photographic Ancient Character Generation13 Mar 2023
- 2023A Unified Arbitrary Style Transfer Framework via Adaptive Contrastive Learning9 Mar 2023
- 2023NoiseTransfer: Image Noise Generation with Contrastive Embeddings31 Jan 2023
- 2023Edge-guided Multi-domain RGB-to-TIR image Translation for Training Vision Tasks with Challenging Labels30 Jan 2023
- 2022Enhanced artificial intelligence-based diagnosis using CBCT with internal denoising: Clinical validation for discrimination of fungal ball, sinusitis, and normal cases in the maxillary sinus29 Nov 2022
- 2022Enhancing Generative Networks for Chest Anomaly Localization through Automatic Registration-Based Unpaired-to-Pseudo-Paired Training Data Translation21 Jul 2022
50 newest of 65 All 65 (JSON)
- 2024One-Step Image Translation with Text-to-Image Modelscited by 111
- 2024Unpaired Photo-realistic Image Deraining with Energy-informed Diffusion Modelcited by 11
- 2025CycleDiff: Cycle Diffusion Models for Unpaired Image-to-image Translationcited by 6
- 2024Spectrum Translation for Refinement of Image Generation (STIG) Based on Contrastive Learning and Spectral Filter Profilecited by 4
- 2025CM-Diff: A Single Generative Network for Bidirectional Cross-Modality Translation Diffusion Model Between Infrared and Visible Imagescited by 2
- 2025TReFT: Taming Rectified Flow Models For One-Step Image Translationcited by 1
- 2026UniCycleFlow: Bidirectional Unpaired Image Translation with a Shared Rectified Flowcited by 0
- 2026Source-Agnostic Image Translation Based on Latent Aware Adaptive Maskingcited by 0
- 2026Source-Agnostic Image Translation Based on Latent Aware Adaptive Masking14 Aug 2026
- 2026UniCycleFlow: Bidirectional Unpaired Image Translation with a Shared Rectified Flow7 Aug 2026
- 2025TReFT: Taming Rectified Flow Models For One-Step Image Translation25 Nov 2025
- 2025CycleDiff: Cycle Diffusion Models for Unpaired Image-to-image Translation8 Aug 2025
- 2025CM-Diff: A Single Generative Network for Bidirectional Cross-Modality Translation Diffusion Model Between Infrared and Visible Images12 Mar 2025
- 2024Unpaired Photo-realistic Image Deraining with Energy-informed Diffusion Model24 Jul 2024
- 2024One-Step Image Translation with Text-to-Image Models18 Mar 2024
- 2024Spectrum Translation for Refinement of Image Generation (STIG) Based on Contrastive Learning and Spectral Filter Profile8 Mar 2024
- 2022Domain Enhanced Arbitrary Image Style Transfer via Contrastive Learningcited by 93
- 2021Multimodal Conditional Image Synthesis with Product-of-Experts GANscited by 75
- 2021Unpaired Deep Image Deraining Using Dual Contrastive Learningcited by 60
- 2021Contrastive Learning for Neural Topic Modelcited by 48
- 2024XoFTR: Cross-modal Feature Matching Transformercited by 45
- 2023Disentangling Writer and Character Styles for Handwriting Generationcited by 35
- 2021A Practical Contrastive Learning Framework for Single-Image Super-Resolutioncited by 30
- 2023Edge-guided Multi-domain RGB-to-TIR image Translation for Training Vision Tasks with Challenging Labelscited by 30
- 2022You Only Cut Once: Boosting Data Augmentation with a Single Cutcited by 22
- 2022Unpaired Deep Image Dehazing Using Contrastive Disentanglement Learningcited by 21
- 2023Self-supervised Learning for Pre-Training 3D Point Clouds: A Surveycited by 21
- 2021Blind Image Decompositioncited by 18
12 most cited of 56 All 56 (JSON)
- 2026Anatomy-Decomposed Chest Computed Tomography (CT) Projections as Scalable Supervision for Bone Suppression in Chest Radiographs21 Sep 2026
- 2026GAN-Based Semantic Communication for Image Transmission in IoV28 Aug 2026
- 2026Towards Reliable AI-Based Histological Staining: A Systematic Study of Scaling and Uncertainty in Unpaired Generative Models25 Aug 2026
- 2026Unpaired Joint Distribution Modeling via Multi-Scale Image Representations9 Jul 2026
- 2026HyPER-GAN: Hybrid Patch-Based Image-to-Image Translation for Real-Time Photorealism Enhancement in Game Engines11 Mar 2026
- 2026Efficient endometrial carcinoma screening via cross-modal synthesis and gradient distillation23 Feb 2026
- 2025Deterministic Image-to-Image Translation via Denoising Brownian Bridge Models with Dual Approximators29 Dec 2025
- 2025WeatherCycle: Unpaired Multi-Weather Restoration via Color Space Decoupled Cycle Learning27 Sep 2025
- 2025MedShift: Implicit Conditional Transport for X-Ray Domain Adaptation29 Aug 2025
- 2025REGEN: Real-Time Photorealism Enhancement in Games via a Dual-Stage Generative Network Framework23 Aug 2025
- 2025CycleVAR: Repurposing Autoregressive Model for Unsupervised One-Step Image Translation29 Jun 2025
- 2025crossMoDA Challenge: Evolution of Cross-Modality Domain Adaptation Techniques for Vestibular Schwannoma and Cochlea Segmentation from 2021 to 202313 Jun 2025
12 newest of 56 All 56 (JSON)