Cross-domain Correspondence Learning for Exemplar-based Image Translation
Not on the map. Why?
Abstract (arXiv)
We present a general framework for exemplar-based image translation, which synthesizes a photo-realistic image from the input in a distinct domain (e.g., semantic segmentation mask, or edge map, or pose keypoints), given an exemplar image. The output has the style (e.g., color, texture) in consistency with the semantically corresponding objects in the exemplar. We propose to jointly learn the crossdomain correspondence and the image translation, where both tasks facilitate each other and thus can be learned with weak supervision. The images from distinct domains are first aligned to an intermediate domain where dense correspondence is established. Then, the network synthesizes images based on the appearance of semantically corresponding patches in the exemplar. We demonstrate the effectiveness of our approach in several image translation tasks. Our method is superior to state-of-the-art methods in terms of image quality significantly, with the image style faithful to the exemplar with semantic consistency. Moreover, we show the utility of our method for several applications
Key facts. Cited by 116 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 34; 2022: 40; 2023: 27; 2024: 12; 2025: 1; 2026: 2.
116 papers.
Sort:
By area:
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
- 2021Prototypical Pseudo Label Denoising and Target Structure Learning for Domain Adaptive Semantic Segmentationcited by 268
- 2022EGSDE: Unpaired Image-to-Image Translation via Energy-Guided Stochastic Differential Equationscited by 172
- 2022Pretraining is All You Need for Image-to-Image Translationcited by 160
- 2021Image-to-Image Translation: Methods and Applicationscited by 116
- 2022Person Image Synthesis via Denoising Diffusion Modelcited by 104
- 2021Breaking the Dilemma of Medical Image-to-image Translationcited by 82
- 2021PD-GAN: Probabilistic Diverse GAN for Image Inpaintingcited by 80
- 2023Prompt-Free Diffusion: Taking "Text" out of Text-to-Image Diffusion Modelscited by 62
- 2023ImageBrush: Learning Visual In-Context Instructions for Exemplar-Based Image Manipulationcited by 59
- 2021Towards Vivid and Diverse Image Colorization with Generative Color Priorcited by 55
38 more
- 2022Neural Texture Extraction and Distribution for Controllable Person Image Synthesiscited by 55
- 2021Multimodal Image Synthesis and Editing: The Generative AI Eracited by 52
- 2023Going Denser with Open-Vocabulary Part Segmentationcited by 51
- 2021Diverse Semantic Image Synthesis via Probability Distribution Modelingcited by 49
- 2023Photoswap: Personalized Subject Swapping in Imagescited by 47
- 2022Cross Attention Based Style Distribution for Controllable Person Image Synthesiscited by 45
- 2021Unbalanced Feature Transport for Exemplar-based Image Translationcited by 41
- 2023GenHowTo: Learning to Generate Actions and State Transformations from Instructional Videoscited by 39
- 2023GlyphDraw: Seamlessly Rendering Text with Intricate Spatial Structures in Text-to-Image Generationcited by 34
- 2023Towards Garment Sewing Pattern Reconstruction from a Single Imagecited by 33
- 2021SketchEdit: Mask-Free Local Image Manipulation with Partial Sketchescited by 32
- 2023General Image-to-Image Translation with One-Shot Image Guidancecited by 31
- 20213D Pose Transfer with Correspondence Learning and Mesh Refinementcited by 30
- 2022InstaFormer: Instance-Aware Image-to-Image Translation with Transformercited by 28
- 2022Multi-Granularity Alignment Domain Adaptation for Object Detectioncited by 28
- 2023MaskSketch: Unpaired Structure-guided Masked Image Generationcited by 27
- 2021ICON: Learning Regular Maps Through Inverse Consistencycited by 26
- 2022Eliminating Gradient Conflict in Reference-based Line-Art Colorizationcited by 25
- 2023Zero-Shot Everything Sketch-Based Image Retrieval, and in Explainable Stylecited by 25
- 2022DynaST: Dynamic Sparse Transformer for Exemplar-Guided Image Generationcited by 24
- 2021SSAT: A Symmetric Semantic-Aware Transformer Network for Makeup Transfer and Removalcited by 22
- 2022MIDMs: Matching Interleaved Diffusion Models for Exemplar-based Image Translationcited by 22
- 2023Exploring the Naturalness of AI-Generated Imagescited by 22
- 2021Semi-supervised Synthesis of High-Resolution Editable Textures for 3D Humanscited by 21
- 2022Unsupervised 3D Pose Transfer with Cross Consistency and Dual Reconstructioncited by 21
- 2023Diffusion Model for Dense Matchingcited by 21
- 2021Bi-level Feature Alignment for Versatile Image Translation and Manipulationcited by 20
- 2022Few-Shot Head Swapping in the Wildcited by 20
- 2022Marginal Contrastive Correspondence for Guided Image Generationcited by 19
- 2023DiGA: Distil to Generalize and then Adapt for Domain Adaptive Semantic Segmentationcited by 19
- 2021CT-Net: Complementary Transfering Network for Garment Transfer with Arbitrary Geometric Changescited by 17
- 2022All-to-key Attention for Arbitrary Style Transfercited by 16
- 2024Geometry Transfer for Stylizing Radiance Fieldscited by 16
- 2021Learning Realistic Human Reposing using Cyclic Self-Supervision with 3D Shape, Pose, and Appearance Consistencycited by 15
- 2022UnGANable: Defending Against GAN-based Face Manipulationcited by 15
- 2021Facial-Sketch Synthesis: A New Challengecited by 13
- 2024SwapAnything: Enabling Arbitrary Object Swapping in Personalized Visual Editingcited by 13
- 2021Total Generate: Cycle in Cycle Generative Adversarial Networks for Generating Human Faces, Hands, Bodies, and Natural Scenescited by 12
50 most cited of 116 All 116 (JSON)
- 2026Image-to-Image Translation Framework Embedded with Rotation Symmetry Priors14 Apr 2026
- 2026Face Normal Estimation from Rags to Riches5 Jan 2026
- 2025MimiCAT: Mimic with Correspondence-Aware Cascade-Transformer for Category-Free 3D Pose Transfer23 Nov 2025
- 2024Edicho: Consistent Image Editing in the Wild30 Dec 2024
- 2024One-shot Human Motion Transfer via Occlusion-Robust Flow Prediction and Neural Texturing9 Dec 2024
- 2024Towards High-fidelity Head Blending with Chroma Keying for Industrial Applications1 Nov 2024
- 2024EBDM: Exemplar-guided Image Translation with Brownian-bridge Diffusion Models13 Oct 2024
- 2024FAMOUS: High-Fidelity Monocular 3D Human Digitization Using View Synthesis13 Oct 2024
- 2024Tuning-Free Visual Customization via View Iterative Self-Attention Control10 Jun 2024
- 2024Customize Your Own Paired Data via Few-shot Way21 May 2024
- 2024Structure-Aware Human Body Reshaping with Adaptive Affinity-Graph Network22 Apr 2024
- 2024SwapAnything: Enabling Arbitrary Object Swapping in Personalized Visual Editing8 Apr 2024
38 more
- 2024Semantic Image Synthesis with Unconditional Generator22 Feb 2024
- 2024Geometry Transfer for Stylizing Radiance Fields1 Feb 2024
- 2024Learning to Manipulate Artistic Images25 Jan 2024
- 2023GenHowTo: Learning to Generate Actions and State Transformations from Instructional Videos12 Dec 2023
- 2023Exploring the Naturalness of AI-Generated Images9 Dec 2023
- 2023SARA: Controllable Makeup Transfer with Spatial Alignment and Region-Adaptive Normalization28 Nov 2023
- 2023DI-Net : Decomposed Implicit Garment Transfer Network for Digital Clothed 3D Human28 Nov 2023
- 2023Towards Garment Sewing Pattern Reconstruction from a Single Image7 Nov 2023
- 2023E4S: Fine-grained Face Swapping via Editing With Regional GAN Inversion23 Oct 2023
- 2023Human-Inspired Facial Sketch Synthesis with Dynamic Adaptation1 Sep 2023
- 2023ImageBrush: Learning Visual In-Context Instructions for Exemplar-Based Image Manipulation2 Aug 2023
- 2023General Image-to-Image Translation with One-Shot Image Guidance20 Jul 2023
- 2023Domain-Scalable Unpaired Image Translation via Latent Space Anchoring26 Jun 2023
- 2023Referenceless User Controllable Semantic Image Synthesis18 Jun 2023
- 2023Using Unreliable Pseudo-Labels for Label-Efficient Semantic Segmentation4 Jun 2023
- 2023Diffusion Model for Dense Matching30 May 2023
- 2023Photoswap: Personalized Subject Swapping in Images29 May 2023
- 2023Prompt-Free Diffusion: Taking "Text" out of Text-to-Image Diffusion Models25 May 2023
- 2023Going Denser with Open-Vocabulary Part Segmentation18 May 2023
- 2023Face Transformer: Towards High Fidelity and Accurate Face Swapping5 Apr 2023
- 2023DiGA: Distil to Generalize and then Adapt for Domain Adaptive Semantic Segmentation5 Apr 2023
- 2023GlyphDraw: Seamlessly Rendering Text with Intricate Spatial Structures in Text-to-Image Generation31 Mar 2023
- 2023Masked and Adaptive Transformer for Exemplar Based Image Translation30 Mar 2023
- 2023Zero-Shot Everything Sketch-Based Image Retrieval, and in Explainable Style25 Mar 2023
- 2023Keypoint-Guided Optimal Transport: Models, Algorithms, and Applications23 Mar 2023
- 2023AnimeDiffusion: Anime Face Line Drawing Colorization via Diffusion Models20 Mar 2023
- 2023Guided Image-to-Image Translation by Discriminator-Generator Communication7 Mar 2023
- 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb 2023
- 2023MaskSketch: Unpaired Structure-guided Masked Image Generation10 Feb 2023
- 2023CFFT-GAN: Cross-domain Feature Fusion Transformer for Exemplar-based Image Translation3 Feb 2023
- 2022DSI2I: Dense Style for Unpaired Image-to-Image Translation26 Dec 2022
- 2022Attention-Aware Anime Line Drawing Colorization21 Dec 2022
- 2022All-to-key Attention for Arbitrary Style Transfer8 Dec 2022
- 2022Towards Hard-pose Virtual Try-on via 3D-aware Global Correspondence Learning25 Nov 2022
- 2022Paint by Example: Exemplar-based Image Editing with Diffusion Models23 Nov 2022
- 2022Semantic-aware One-shot Face Re-enactment with Dense Correspondence Estimation23 Nov 2022
- 2022Person Image Synthesis via Denoising Diffusion Model22 Nov 2022
- 2022LoopDA: Constructing Self-loops to Adapt Nighttime Semantic Segmentation21 Nov 2022
50 newest of 116 All 116 (JSON)
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
- 2022EGSDE: Unpaired Image-to-Image Translation via Energy-Guided Stochastic Differential Equationscited by 172
- 2022Pretraining is All You Need for Image-to-Image Translationcited by 160
- 2022Person Image Synthesis via Denoising Diffusion Modelcited by 104
- 2023Prompt-Free Diffusion: Taking "Text" out of Text-to-Image Diffusion Modelscited by 62
- 2022MIDMs: Matching Interleaved Diffusion Models for Exemplar-based Image Translationcited by 22
- 2023Diffusion Model for Dense Matchingcited by 21
- 2023AnimeDiffusion: Anime Face Line Drawing Colorization via Diffusion Modelscited by 9
- 2024EBDM: Exemplar-guided Image Translation with Brownian-bridge Diffusion Modelscited by 8
- 2024Tuning-Free Visual Customization via View Iterative Self-Attention Controlcited by 2
- 2024EBDM: Exemplar-guided Image Translation with Brownian-bridge Diffusion Models13 Oct 2024
- 2024Tuning-Free Visual Customization via View Iterative Self-Attention Control10 Jun 2024
- 2023Diffusion Model for Dense Matching30 May 2023
- 2023Prompt-Free Diffusion: Taking "Text" out of Text-to-Image Diffusion Models25 May 2023
- 2023AnimeDiffusion: Anime Face Line Drawing Colorization via Diffusion Models20 Mar 2023
- 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb 2023
- 2022Paint by Example: Exemplar-based Image Editing with Diffusion Models23 Nov 2022
- 2022Person Image Synthesis via Denoising Diffusion Model22 Nov 2022
- 2022MIDMs: Matching Interleaved Diffusion Models for Exemplar-based Image Translation22 Sep 2022
- 2022EGSDE: Unpaired Image-to-Image Translation via Energy-Guided Stochastic Differential Equations14 Jul 2022
- 2022Pretraining is All You Need for Image-to-Image Translation25 May 2022
- 2021Prototypical Pseudo Label Denoising and Target Structure Learning for Domain Adaptive Semantic Segmentationcited by 268
- 2021Image-to-Image Translation: Methods and Applicationscited by 116
- 2021Breaking the Dilemma of Medical Image-to-image Translationcited by 82
- 2021PD-GAN: Probabilistic Diverse GAN for Image Inpaintingcited by 80
- 2023ImageBrush: Learning Visual In-Context Instructions for Exemplar-Based Image Manipulationcited by 59
- 2021Towards Vivid and Diverse Image Colorization with Generative Color Priorcited by 55
- 2022Neural Texture Extraction and Distribution for Controllable Person Image Synthesiscited by 55
- 2021Multimodal Image Synthesis and Editing: The Generative AI Eracited by 52
- 2023Going Denser with Open-Vocabulary Part Segmentationcited by 51
- 2021Diverse Semantic Image Synthesis via Probability Distribution Modelingcited by 49
- 2023Photoswap: Personalized Subject Swapping in Imagescited by 47
- 2022Cross Attention Based Style Distribution for Controllable Person Image Synthesiscited by 45
12 most cited of 105 All 105 (JSON)
- 2026Image-to-Image Translation Framework Embedded with Rotation Symmetry Priors14 Apr 2026
- 2026Face Normal Estimation from Rags to Riches5 Jan 2026
- 2025MimiCAT: Mimic with Correspondence-Aware Cascade-Transformer for Category-Free 3D Pose Transfer23 Nov 2025
- 2024Edicho: Consistent Image Editing in the Wild30 Dec 2024
- 2024One-shot Human Motion Transfer via Occlusion-Robust Flow Prediction and Neural Texturing9 Dec 2024
- 2024Towards High-fidelity Head Blending with Chroma Keying for Industrial Applications1 Nov 2024
- 2024FAMOUS: High-Fidelity Monocular 3D Human Digitization Using View Synthesis13 Oct 2024
- 2024Customize Your Own Paired Data via Few-shot Way21 May 2024
- 2024Structure-Aware Human Body Reshaping with Adaptive Affinity-Graph Network22 Apr 2024
- 2024SwapAnything: Enabling Arbitrary Object Swapping in Personalized Visual Editing8 Apr 2024
- 2024Semantic Image Synthesis with Unconditional Generator22 Feb 2024
- 2024Geometry Transfer for Stylizing Radiance Fields1 Feb 2024
12 newest of 105 All 105 (JSON)