# Image-to-Image Translation with Multi-Path Consistency Regularization

arXiv: https://arxiv.org/abs/1905.12498 · HTML: https://mlsanity.com/paper/1905.12498/

## Key facts

- Cited by 6 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 29 May 2019.

## Built on by (most cited first, 6 of 6)

- [Image-to-Image Translation: Methods and Applications](https://mlsanity.com/paper/2101.08629/) (2021)
- [AGTGAN: Unpaired Image Translation for Photographic Ancient Character Generation](https://mlsanity.com/paper/2303.07012/) (2023)
- [GAN-based Facial Attribute Manipulation](https://mlsanity.com/paper/2210.12683/) (2022)
- [Diff-Oracle: Deciphering Oracle Bone Scripts with Controllable Diffusion Model](https://mlsanity.com/paper/2312.13631/) (2023)
- [UTSGAN: Unseen Transition Suss GAN for Transition-Aware Image-to-image Translation](https://mlsanity.com/paper/2304.11955/) (2023)
- [A Survey on Adversarial Image Synthesis](https://mlsanity.com/paper/2106.16056/) (2021)

## Abstract (arXiv)

Image translation across different domains has attracted much attention in both machine learning and computer vision communities. Taking the translation from source domain Ds to target domain Dt as an example, existing algorithms mainly rely on two kinds of loss for training: One is the discrimination loss, which is used to differentiate images generated by the models and natural images; the other is the reconstruction loss, which measures the difference between an original image and the reconstructed version through Ds→Dt→Ds translation. In this work, we introduce a new kind of loss, multi-path consistency loss, which evaluates the differences between direct translation Ds→Dt and indirect translation Ds→Da→Dt with Da as an auxiliary domain, to regularize training. For multi-domain translation (at least, three) which focuses on building translation models between any two domains, at each training iteration, we randomly select three domains, set them respectively as the source, auxiliary and target domains, build the multi-path consistency loss and optimize the network. For two-domain translation, we need to introduce an additional auxiliary domain and construct the multi-path consistency loss. We conduct various experiments to demonstrate the effectiveness of our proposed methods, including face-to-face translation, paint-to-photo translation, and de-raining/de-noising translation.