Contrastive Learning for Unpaired Image-to-Image Translation
Not on the map. Why?
Cited by 74 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
In image-to-image translation, each patch in the output should reflect the content of the corresponding patch in the input, independent of domain. We propose a straightforward method for doing so -- maximizing mutual information between the two, using a framework based on contrastive learning. The method encourages two elements (corresponding patches) to map to a similar point in a learned feature space, relative to other elements (other patches) in the dataset, referred to as negatives. We explore several critical design choices for making contrastive learning effective in the image synthesis setting. Notably, we use a multilayer, patch-based approach, rather than operate on entire images. Furthermore, we draw negatives from within the input image itself, rather than from the rest of the dataset. We demonstrate that our framework enables one-sided translation in the unpaired image-to-image translation setting, while improving quality and reducing training time. In addition, our method can even be extended to the training setting where each "domain" is only a single image.
Key facts. Cited by 637 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 98; 2022: 143; 2023: 148; 2024: 100; 2025: 85; 2026: 63.
637 papers.
Sort:
By area:
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
- 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
- 2023Zero-shot Image-to-Image Translationcited by 503
- 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
- 2021Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysiscited by 418
- 2021Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representationcited by 288
- 2021Cross-Modal Contrastive Learning for Text-to-Image Generationcited by 259
- 2021Contrastive Learning for Compact Single Image Dehazingcited by 219
- 2021GRAM: Generative Radiance Manifolds for 3D-Aware Image Generationcited by 216
- 2022Splicing ViT Features for Semantic Appearance Transfercited by 209
- 2021StyTr2: Image Style Transfer with Transformerscited by 186
- 2021Unsupervised Degradation Representation Learning for Blind Super-Resolutioncited by 177
38 more
- 2022EGSDE: Unpaired Image-to-Image Translation via Energy-Guided Stochastic Differential Equationscited by 172
- 2021A Good Image Generator Is What You Need for High-Resolution Video Synthesiscited by 162
- 2022Diffusion-based Image Translation using Disentangled Style and Content Representationcited by 148
- 2023Cross-Image Attention for Zero-Shot Appearance Transfercited by 135
- 2024Implicit Style-Content Separation using B-LoRAcited by 135
- 2022NeRF-Art: Text-Driven Neural Radiance Fields Stylizationcited by 126
- 2021CLIFF: Contrastive Learning for Improving Faithfulness and Factuality in Abstractive Summarizationcited by 120
- 2021Image-to-Image Translation: Methods and Applicationscited by 116
- 2024One-Step Image Translation with Text-to-Image Modelscited by 111
- 2023Artificial Intelligence for Digital and Computational Pathologycited by 106
- 2021SiT: Self-supervised vIsion Transformercited by 99
- 2023Unpaired Image-to-Image Translation via Neural Schr"odinger Bridgecited by 96
- 2021SPG: Unsupervised Domain Adaptation for 3D Object Detection via Semantic Point Generationcited by 93
- 2022Domain Enhanced Arbitrary Image Style Transfer via Contrastive Learningcited by 93
- 2021Divide and Contrast: Self-supervised Learning from Uncurated Datacited by 85
- 2021Multimodal Conditional Image Synthesis with Product-of-Experts GANscited by 75
- 2021Enhancing Photorealism Enhancementcited by 74
- 2022Back to the Source: Diffusion-Driven Test-Time Adaptationcited by 71
- 2022Unifying Diffusion Models' Latent Space, with Applications to CycleDiffusion and Guidancecited by 67
- 2021The Spatially-Correlative Loss for Various Image Translation Taskscited by 66
- 2021Dual Contrastive Learning for Unsupervised Image-to-Image Translationcited by 65
- 2021Unpaired Deep Image Deraining Using Dual Contrastive Learningcited by 60
- 2021Data-Efficient Instance Generation from Instance Discriminationcited by 58
- 2022CrossMoDA 2021 challenge: Benchmark of Cross-Modality Domain Adaptation techniques for Vestibular Schwannoma and Cochlea Segmentationcited by 58
- 2023A survey on deep learning in medical image registration: new technologies, uncertainty, evaluation metrics, and beyondcited by 55
- 2022TAPE: Task-Agnostic Prior Embedding for Image Restorationcited by 54
- 2021Distilling Audio-Visual Knowledge by Compositional Contrastive Learningcited by 53
- 2021Multimodal Image Synthesis and Editing: The Generative AI Eracited by 52
- 2022STPLS3D: A Large-Scale Synthetic and Real Aerial Photogrammetry 3D Point Cloud Datasetcited by 52
- 2022A Closer Look at Few-shot Image Generationcited by 49
- 2023Contrastive Denoising Score for Text-guided Latent Diffusion Image Editingcited by 49
- 2021StyleAlign: Analysis and Applications of Aligned StyleGAN Modelscited by 48
- 2021Learning Disentangled Representations in the Imaging Domaincited by 46
- 2022CCPL: Contrastive Coherence Preserving Loss for Versatile Style Transfercited by 46
- 2023Regularized Vector Quantization for Tokenized Image Synthesiscited by 46
- 2021Instance-wise Hard Negative Example Generation for Contrastive Learning in Unpaired Image-to-Image Translationcited by 45
- 2021The Emergence of Objectness: Learning Zero-Shot Segmentation from Videoscited by 45
- 2022DiffStyler: Controllable Dual Diffusion for Text-Driven Image Stylizationcited by 45
50 most cited of 637 All 637 (JSON)
- 2026The Domain Is a Residue: Adapting Self-Supervised Features, Not Generators29 Sep 2026
- 2026DRHeC: Differentiable Rendering for Hand-Eye Calibration with RGB-Based Gradients29 Sep 2026
- 2026ContraFM-S2O: Flow Matching-Based One-step SAR-to-Optical Image Translation Model with Contrastive Learning25 Sep 2026
- 2026Anatomy-Decomposed Chest Computed Tomography (CT) Projections as Scalable Supervision for Bone Suppression in Chest Radiographs21 Sep 2026
- 2026ViT3Flow: A Test-Time Training Transformer MeanFlow for Postoperative Radiograph Synthesis in Scoliosis4 Sep 2026
- 2026Semi-Supervised Virtual Staining via Morphology Preservation and Histopathological Realism Constraints1 Sep 2026
- 2026VeCAS: Vessel-Focused Contrast-Free Angiogram Synthesis for Vascular Interventions24 Aug 2026
- 2026Through the Schr"odinger Bridge: Benchmarking Antemortem Image Restoration from Postmortem Autolysis to Enhance Forensic Diagnostics22 Aug 2026
- 2026HistReNeRF: Historic Image Relocalisation within Contemporary Neural Radiance Field Reconstructions15 Aug 2026
- 2026Where the Cost Falls: A Deployment-Aware Adoption Order for Stability Enhancements to Cycle-Consistent Adversarial Networks14 Aug 2026
- 2026Source-Agnostic Image Translation Based on Latent Aware Adaptive Masking14 Aug 2026
- 2026FlowForm: Synergizing Fluid Physics with Topological Consistency for Satellite Flood Synthesis4 Aug 2026
38 more
- 2026Towards Reliable Stain Transfer: An Iterative Data-Model Co-Optimization Framework Based on Multimodal Expert-Guided Assessment28 Jul 2026
- 2026Spectral Consistent Flow for One-step 3D Medical Image Translation12 Jul 2026
- 2026Unpaired Joint Distribution Modeling via Multi-Scale Image Representations9 Jul 2026
- 2026PRISM: Latent Composition Consistency for Single-Image Reflection Removal30 Jun 2026
- 2026WarpI2I: Image Warping for Image-to-Image Translation30 Jun 2026
- 2026ASTAD: Asymmetric Style Transfer for Synthetic-to-Real Adaptation in Autonomous Driving28 Jun 2026
- 2026Cross-Sensor SAR Data Generation Using Diffusion Models and Feature Migration27 Jun 2026
- 2026Two-Stage Cross-Domain Cervical Abnormality Screening with Cytopathological Image Synthesis and Knowledge Distillation26 Jun 2026
- 2026Residual-Space Evolutionary Optimization via Flow-based Generative Models18 Jun 2026
- 2026Geometry-Consistent Endoscopic Representations for Image-Guided Navigation via Structured Foundation Model Adaptation15 Jun 2026
- 2026Fi-Gaussian: Frequency-Aware Implicit Gaussian Splatting for Single Image Dehazing15 Jun 2026
- 2026Dehaze-GaussianImage: Zero-Shot Dehazing via Efficient 2D Gaussian Splatting Representation15 Jun 2026
- 2026MariData: One-Step Unpaired Image Translation for Maritime Environments2 Jun 2026
- 2026DefSynUS: Real-time Patient-specific Intrahepatic Vessel Identification via Deformation-Aware CT-US Domain Adaptation28 May 2026
- 2026MetaEarth-MM: Unified Multimodal Remote Sensing Image Generation with Scene-centered Joint Modeling19 May 2026
- 2026Component-Aware Structure-Preserving Style Transfer for Satellite Visual Sim2Real Data Construction19 May 2026
- 2026Domain Transfer Becomes Identifiable via a Single Alignment18 May 2026
- 2026Multispectral Blind Image Super-Resolution for Standing Dead Tree Segmentation4 May 2026
- 2026When To Adapt? Adapting the Model or Data in Federated Medical Imaging27 Apr 2026
- 2026Style-Based Neural Architectures for Real-Time Weather Classification20 Apr 2026
- 2026Stylistic-STORM (ST-STORM) : Perceiving the Semantic Nature of Appearance17 Apr 2026
- 2026Heuristic Style Transfer for Real-Time, Efficient Weather Attribute Detection15 Apr 2026
- 2026Bridging Restoration and Diagnosis: A Comprehensive Benchmark for Retinal Fundus Enhancement4 Apr 2026
- 2026A Generative Foundation Model for Multimodal Histopathology4 Apr 2026
- 2026DiReCT: Disentangled Regularization of Contrastive Trajectories for Physics-Refined Video Generation26 Mar 2026
- 2026Uncertainty-Aware Distribution-to-Distribution Flow Matching for Scientific Imaging23 Mar 2026
- 2026MERIT: Multi-domain Efficient RAW Image Translation21 Mar 2026
- 2026SA-CycleGAN-2.5D: Self-Attention CycleGAN with Tri-Planar Context for Multi-Site MRI Harmonization17 Mar 2026
- 2026Unpaired Cross-Domain Calibration of DMSP to VIIRS Nighttime Light Data Based on CUT Network17 Mar 2026
- 2026One CT Unified Model Training Framework to Rule All Scanning Protocols16 Mar 2026
- 2026UNIStainNet: Foundation-Model-Guided Virtual Staining of H&E to IHC13 Mar 2026
- 2026HyPER-GAN: Hybrid Patch-Based Image-to-Image Translation for Real-Time Photorealism Enhancement in Game Engines11 Mar 2026
- 2026EndoSERV: A Vision-based Endoluminal Robot Navigation System9 Mar 2026
- 2026EarthBridge: A Solution for 4th Multi-modal Aerial View Image Challenge Translation Track6 Mar 2026
- 2026Degradation-based augmented training for robust individual animal re-identification4 Mar 2026
- 2026DMD-augmented Unpaired Neural Schr"odinger Bridge for Ultra-Low Field MRI Enhancement4 Mar 2026
- 2026RAFM: Retrieval-Augmented Flow Matching for Unpaired CBCT-to-CT Translation28 Feb 2026
- 2026PGVMS: A Prompt-Guided Unified Framework for Virtual Multiplex IHC Staining with Pathological Semantic Learning26 Feb 2026
50 newest of 637 All 637 (JSON)
- 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
- 2022EGSDE: Unpaired Image-to-Image Translation via Energy-Guided Stochastic Differential Equationscited by 172
- 2022Diffusion-based Image Translation using Disentangled Style and Content Representationcited by 148
- 2024One-Step Image Translation with Text-to-Image Modelscited by 111
- 2023Unpaired Image-to-Image Translation via Neural Schr"odinger Bridgecited by 96
- 2022Unifying Diffusion Models' Latent Space, with Applications to CycleDiffusion and Guidancecited by 67
- 2023Contrastive Denoising Score for Text-guided Latent Diffusion Image Editingcited by 49
- 2023CycleNet: Rethinking Cycle Consistency in Text-Guided Diffusion for Image Manipulationcited by 41
- 2023ControlStyle: Text-Driven Stylized Image Generation Using Diffusion Priorscited by 40
- 2023Zero-shot Medical Image Translation via Frequency-Guided Diffusion Modelscited by 39
- 2023Debias Coarsely, Sample Conditionally: Statistical Downscaling through Optimal Transport and Probabilistic Diffusion Modelscited by 33
- 2024Cross-conditioned Diffusion Model for Medical Image to Image Translationcited by 26
12 most cited of 74 All 74 (JSON)
- 2026ContraFM-S2O: Flow Matching-Based One-step SAR-to-Optical Image Translation Model with Contrastive Learning25 Sep 2026
- 2026Source-Agnostic Image Translation Based on Latent Aware Adaptive Masking14 Aug 2026
- 2026WarpI2I: Image Warping for Image-to-Image Translation30 Jun 2026
- 2026Cross-Sensor SAR Data Generation Using Diffusion Models and Feature Migration27 Jun 2026
- 2026DiReCT: Disentangled Regularization of Contrastive Trajectories for Physics-Refined Video Generation26 Mar 2026
- 2026Uncertainty-Aware Distribution-to-Distribution Flow Matching for Scientific Imaging23 Mar 2026
- 2026RAFM: Retrieval-Augmented Flow Matching for Unpaired CBCT-to-CT Translation28 Feb 2026
- 2026See and Fix the Flaws: Enabling VLMs and Diffusion Models to Comprehend Visual Artifacts via Agentic Data Synthesis24 Feb 2026
- 2026Driving with DINO: Vision Foundation Features as a Unified Bridge for Sim-to-Real Generation in Autonomous Driving5 Feb 2026
- 2026FBSDiff++: Improved Frequency Band Substitution of Diffusion Features for Efficient and Highly Controllable Text-Driven Image-to-Image Translation27 Jan 2026
- 2025A Scalable Pipeline Combining Procedural 3D Graphics and Guided Diffusion for Photorealistic Synthetic Training Data Generation in White Button Mushroom Segmentation9 Dec 2025
- 2025TReFT: Taming Rectified Flow Models For One-Step Image Translation25 Nov 2025
12 newest of 74 All 74 (JSON)
- 2026StyMam: A Mamba-Based Generator for Artistic Style Transfer19 Jan 2026
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
- 2023Zero-shot Image-to-Image Translationcited by 503
- 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
- 2021Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysiscited by 418
- 2021Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representationcited by 288
- 2021Cross-Modal Contrastive Learning for Text-to-Image Generationcited by 259
- 2021Contrastive Learning for Compact Single Image Dehazingcited by 219
- 2021GRAM: Generative Radiance Manifolds for 3D-Aware Image Generationcited by 216
- 2022Splicing ViT Features for Semantic Appearance Transfercited by 209
- 2021StyTr2: Image Style Transfer with Transformerscited by 186
- 2021Unsupervised Degradation Representation Learning for Blind Super-Resolutioncited by 177
- 2021A Good Image Generator Is What You Need for High-Resolution Video Synthesiscited by 162
12 most cited of 559 All 559 (JSON)
- 2026The Domain Is a Residue: Adapting Self-Supervised Features, Not Generators29 Sep 2026
- 2026DRHeC: Differentiable Rendering for Hand-Eye Calibration with RGB-Based Gradients29 Sep 2026
- 2026Anatomy-Decomposed Chest Computed Tomography (CT) Projections as Scalable Supervision for Bone Suppression in Chest Radiographs21 Sep 2026
- 2026ViT3Flow: A Test-Time Training Transformer MeanFlow for Postoperative Radiograph Synthesis in Scoliosis4 Sep 2026
- 2026Semi-Supervised Virtual Staining via Morphology Preservation and Histopathological Realism Constraints1 Sep 2026
- 2026VeCAS: Vessel-Focused Contrast-Free Angiogram Synthesis for Vascular Interventions24 Aug 2026
- 2026Through the Schr"odinger Bridge: Benchmarking Antemortem Image Restoration from Postmortem Autolysis to Enhance Forensic Diagnostics22 Aug 2026
- 2026HistReNeRF: Historic Image Relocalisation within Contemporary Neural Radiance Field Reconstructions15 Aug 2026
- 2026Where the Cost Falls: A Deployment-Aware Adoption Order for Stability Enhancements to Cycle-Consistent Adversarial Networks14 Aug 2026
- 2026FlowForm: Synergizing Fluid Physics with Topological Consistency for Satellite Flood Synthesis4 Aug 2026
- 2026Towards Reliable Stain Transfer: An Iterative Data-Model Co-Optimization Framework Based on Multimodal Expert-Guided Assessment28 Jul 2026
- 2026Spectral Consistent Flow for One-step 3D Medical Image Translation12 Jul 2026
12 newest of 559 All 559 (JSON)