# Unified cross-modality feature disentangler for unsupervised multi-domain MRI abdomen organs segmentation

arXiv: https://arxiv.org/abs/2007.09669 · HTML: https://mlsanity.com/paper/2007.09669/

## Key facts

- Cited by 16 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 19 Jul 2020.

## Built on by (most cited first, 16 of 16)

- [CrossMoDA 2021 challenge: Benchmark of Cross-Modality Domain Adaptation techniques for Vestibular Schwannoma and Cochlea Segmentation](https://mlsanity.com/paper/2201.02831/) (2022)
- [Learning Disentangled Representations in the Imaging Domain](https://mlsanity.com/paper/2108.12043/) (2021)
- [Deep learning for unsupervised domain adaptation in medical imaging: Recent advancements and future perspectives](https://mlsanity.com/paper/2308.01265/) (2023)
- [A Unified Hyper-GAN Model for Unpaired Multi-contrast MR Image Translation](https://mlsanity.com/paper/2107.11945/) (2021)
- [Multimodal Machine Learning in Image-Based and Clinical Biomedicine: Survey and Prospects](https://mlsanity.com/paper/2311.02332/) (2023)
- [Adversarial Continual Learning for Multi-Domain Hippocampal Segmentation](https://mlsanity.com/paper/2107.08751/) (2021)
- [FedNorm: Modality-Based Normalization in Federated Learning for Multi-Modal Liver Segmentation](https://mlsanity.com/paper/2205.11096/) (2022)
- [An Optimal Control Framework for Joint-channel Parallel MRI Reconstruction without Coil Sensitivities](https://mlsanity.com/paper/2109.09738/) (2021)
- [Brain Structure-Function Fusing Representation Learning using Adversarial Decomposed-VAE for Analyzing MCI](https://mlsanity.com/paper/2305.14404/) (2023)
- [Navigating Distribution Shifts in Medical Image Analysis: A Survey](https://mlsanity.com/paper/2411.05824/) (2024)
- [Multi-organ segmentation: a progressive exploration of learning paradigms under scarce annotation](https://mlsanity.com/paper/2302.03296/) (2023)
- [Non-Adversarial Learning: Vector-Quantized Common Latent Space for Multi-Sequence MRI](https://mlsanity.com/paper/2407.02911/) (2024)
- [Semantic-guided Disentangled Representation for Unsupervised Cross-modality Medical Image Segmentation](https://mlsanity.com/paper/2203.14025/) (2022)
- [Deep Angiogram: Trivializing Retinal Vessel Segmentation](https://mlsanity.com/paper/2307.00245/) (2023)
- [M3DA: Benchmark for Unsupervised Domain Adaptation in 3D Medical Image Segmentation](https://mlsanity.com/paper/2502.17029/) (2025)
- [An Adaptive, Disentangled Representation for Multidimensional MRI Reconstruction](https://mlsanity.com/paper/2512.24674/) (2025)

## Abstract (arXiv)

Our contribution is a unified cross-modality feature disentagling approach for multi-domain image translation and multiple organ segmentation. Using CT as the labeled source domain, our approach learns to segment multi-modal (T1-weighted and T2-weighted) MRI having no labeled data. Our approach uses a variational auto-encoder (VAE) to disentangle the image content from style. The VAE constrains the style feature encoding to match a universal prior (Gaussian) that is assumed to span the styles of all the source and target modalities. The extracted image style is converted into a latent style scaling code, which modulates the generator to produce multi-modality images according to the target domain code from the image content features. Finally, we introduce a joint distribution matching discriminator that combines the translated images with task-relevant segmentation probability maps to further constrain and regularize image-to-image (I2I) translations. We performed extensive comparisons to multiple state-of-the-art I2I translation and segmentation methods. Our approach resulted in the lowest average multi-domain image reconstruction error of 1.34±0.04. Our approach produced an average Dice similarity coefficient (DSC) of 0.85 for T1w and 0.90 for T2w MRI for multi-organ segmentation, which was highly comparable to a fully supervised MRI multi-organ segmentation network (DSC of 0.86 for T1w and 0.90 for T2w MRI).