# TransGaGa: Geometry-Aware Unsupervised Image-to-Image Translation

arXiv: https://arxiv.org/abs/1904.09571 · HTML: https://mlsanity.com/paper/1904.09571/

## Key facts

- Cited by 40 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 21 Apr 2019.

## Built on by (most cited first, 30 of 40)

- [EGSDE: Unpaired Image-to-Image Translation via Energy-Guided Stochastic Differential Equations](https://mlsanity.com/paper/2207.06635/) (2022)
- [Semantic Image Synthesis via Diffusion Models](https://mlsanity.com/paper/2207.00050/) (2022)
- [Image-to-Image Translation: Methods and Applications](https://mlsanity.com/paper/2101.08629/) (2021)
- [DG-Font: Deformable Generative Networks for Unsupervised Font Generation](https://mlsanity.com/paper/2104.03064/) (2021)
- [Instance-wise Hard Negative Example Generation for Contrastive Learning in Unpaired Image-to-Image Translation](https://mlsanity.com/paper/2108.04547/) (2021)
- [GANSeg: Learning to Segment by Unsupervised Hierarchical Image Generation](https://mlsanity.com/paper/2112.01036/) (2021)
- [AutoLink: Self-supervised Learning of Human Skeletons and Object Outlines by Linking Keypoints](https://mlsanity.com/paper/2205.10636/) (2022)
- [Unsupervised Image-to-Image Translation with Generative Prior](https://mlsanity.com/paper/2204.03641/) (2022)
- [Unaligned Image-to-Image Translation by Learning to Reweight](https://mlsanity.com/paper/2109.11736/) (2021)
- [Everything's Talkin': Pareidolia Face Reenactment](https://mlsanity.com/paper/2104.03061/) (2021)
- [Physics-informed Guided Disentanglement in Generative Networks](https://mlsanity.com/paper/2107.14229/) (2021)
- [GP-UNIT: Generative Prior for Versatile Unsupervised Image-to-Image Translation](https://mlsanity.com/paper/2306.04636/) (2023)
- [USIS: Unsupervised Semantic Image Synthesis](https://mlsanity.com/paper/2109.14715/) (2021)
- [A Domain Gap Aware Generative Adversarial Network for Multi-domain Image Translation](https://mlsanity.com/paper/2110.10837/) (2021)
- [Rethinking Content and Style: Exploring Bias for Unsupervised Disentanglement](https://mlsanity.com/paper/2102.10544/) (2021)
- [TransferI2I: Transfer Learning for Image-to-Image Translation from Small Datasets](https://mlsanity.com/paper/2105.06219/) (2021)
- [ManiFest: Manifold Deformation for Few-shot Image Translation](https://mlsanity.com/paper/2111.13681/) (2021)
- [LatentKeypointGAN: Controlling Images via Latent Keypoints](https://mlsanity.com/paper/2103.15812/) (2021)
- [Towards Identifiable Unsupervised Domain Translation: A Diversified Distribution Matching Approach](https://mlsanity.com/paper/2401.09671/) (2024)
- [AE-NeRF: Auto-Encoding Neural Radiance Fields for 3D-Aware Object Manipulation](https://mlsanity.com/paper/2204.13426/) (2022)
- [A2V: A Semi-Supervised Domain Adaptation Framework for Brain Vessel Segmentation via Two-Phase Training Angiography-to-Venography Translation](https://mlsanity.com/paper/2309.06075/) (2023)
- [JOKR: Joint Keypoint Representation for Unsupervised Cross-Domain Motion Retargeting](https://mlsanity.com/paper/2106.09679/) (2021)
- [Polymorphic-GAN: Generating Aligned Samples across Multiple Domains with Learned Morph Maps](https://mlsanity.com/paper/2206.02903/) (2022)
- [StyleFlow For Content-Fixed Image to Image Translation](https://mlsanity.com/paper/2207.01909/) (2022)
- [FCR: Investigating Generative AI models for Forensic Craniofacial Reconstruction](https://mlsanity.com/paper/2508.18031/) (2025)
- [DGFont++: Robust Deformable Generative Networks for Unsupervised Font Generation](https://mlsanity.com/paper/2212.14742/) (2022)
- [Sketch Beautification: Learning Part Beautification and Structure Refinement for Sketches of Man-made Objects](https://mlsanity.com/paper/2306.05832/) (2023)
- [Content-Style Learning from Unaligned Domains: Identifiability under Unknown Latent Dimensions](https://mlsanity.com/paper/2411.03755/) (2024)
- [Leveraging Local Domains for Image-to-Image Translation](https://mlsanity.com/paper/2109.04468/) (2021)
- [Separating Content and Style for Unsupervised Image-to-Image Translation](https://mlsanity.com/paper/2110.14404/) (2021)

## Abstract (arXiv)

Unsupervised image-to-image translation aims at learning a mapping between two visual domains. However, learning a translation across large geometry variations always ends up with failure. In this work, we present a novel disentangle-and-translate framework to tackle the complex objects image-to-image translation task. Instead of learning the mapping on the image space directly, we disentangle image space into a Cartesian product of the appearance and the geometry latent spaces. Specifically, we first introduce a geometry prior loss and a conditional VAE loss to encourage the network to learn independent but complementary representations. The translation is then built on appearance and geometry space separately. Extensive experiments demonstrate the superior performance of our method to other state-of-the-art approaches, especially in the challenging near-rigid and non-rigid objects translation tasks. In addition, by taking different exemplars as the appearance references, our method also supports multimodal translation. Project page: https://wywu.github.io/projects/TGaGa/TGaGa.html
