# Structure-aware Unsupervised Tagged-to-Cine MRI Synthesis with Self Disentanglement

arXiv: https://arxiv.org/abs/2202.12474 · HTML: https://mlsanity.com/paper/2202.12474/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- Builds on 16 of its 26 references that are in the map.
- First posted on arXiv 25 Feb 2022.

## Builds on (most cited first, 16 of 16)

- [Image-to-Image Translation with Conditional Adversarial Networks](https://mlsanity.com/paper/1611.07004/) (2016)
- [DualGAN: Unsupervised Dual Learning for Image-to-Image Translation](https://mlsanity.com/paper/1704.02510/) (2017)
- [Learning to Discover Cross-Domain Relations with Generative Adversarial Networks](https://mlsanity.com/paper/1703.05192/) (2017)
- [Translating and Segmenting Multimodal Medical Volumes with Cycle- and Shape-Consistency Generative Adversarial Network](https://mlsanity.com/paper/1802.09655/) (2018)
- [Self-Supervised GANs via Auxiliary Rotation Loss](https://mlsanity.com/paper/1811.11212/) (2018)
- [Adversarial Unsupervised Domain Adaptation with Conditional and Label Shift: Infer, Align and Iterate](https://mlsanity.com/paper/2107.13469/) (2021)
- [Importance-Aware Semantic Segmentation in Self-Driving with Discrete Wasserstein Training](https://mlsanity.com/paper/2010.12440/) (2020)
- [A Unified Conditional Disentanglement Framework for Multimodal Brain MR Image Translation](https://mlsanity.com/paper/2101.05434/) (2021)
- [Generative Self-training for Cross-domain Unsupervised Tagged-to-Cine MRI Synthesis](https://mlsanity.com/paper/2106.12499/) (2021)
- [Subtype-aware Unsupervised Domain Adaptation for Medical Diagnosis](https://mlsanity.com/paper/2101.00318/) (2021)
- [AUTO3D: Novel view synthesis through unsupervisely learned variational viewpoint and global 3D representation](https://mlsanity.com/paper/2007.06620/) (2020)
- [Dual-cycle Constrained Bijective VAE-GAN For Tagged-to-Cine Magnetic Resonance Image Synthesis](https://mlsanity.com/paper/2101.05439/) (2021)
- [Unsupervised learning for cross-domain medical image synthesis using deformation invariant cycle consistency networks](https://mlsanity.com/paper/1808.03944/) (2018)
- [Mutual Information Regularized Identity-aware Facial ExpressionRecognition in Compressed Video](https://mlsanity.com/paper/2010.10637/) (2020)
- [Recursively Conditional Gaussian for Ordinal Unsupervised Domain Adaptation](https://mlsanity.com/paper/2107.13467/) (2021)
- [Segmentation of Cardiac Structures via Successive Subspace Learning with Saab Transform from Cine MRI](https://mlsanity.com/paper/2107.10718/) (2021)

## Built on by (most cited first, 2 of 2)

- [Deep Unsupervised Domain Adaptation: A Review of Recent Advances and Perspectives](https://mlsanity.com/paper/2208.07422/) (2022)
- [Tagged-MRI Sequence to Audio Synthesis via Self Residual Attention Guided Heterogeneous Translator](https://mlsanity.com/paper/2206.02284/) (2022)

## Abstract (arXiv)

Cycle reconstruction regularized adversarial training -- e.g., CycleGAN, DiscoGAN, and DualGAN -- has been widely used for image style transfer with unpaired training data. Several recent works, however, have shown that local distortions are frequent, and structural consistency cannot be guaranteed. Targeting this issue, prior works usually relied on additional segmentation or consistent feature extraction steps that are task-specific. To counter this, this work aims to learn a general add-on structural feature extractor, by explicitly enforcing the structural alignment between an input and its synthesized image. Specifically, we propose a novel input-output image patches self-training scheme to achieve a disentanglement of underlying anatomical structures and imaging modalities. The translator and structure encoder are updated, following an alternating training protocol. In addition, the information w.r.t. imaging modality can be eliminated with an asymmetric adversarial game. We train, validate, and test our network on 1,768, 416, and 1,560 unpaired subject-independent slices of tagged and cine magnetic resonance imaging from a total of twenty healthy subjects, respectively, demonstrating superior performance over competing methods.