MeDUET: Disentangled Unified Pretraining for 3D Medical Image Synthesis and Analysis
On the map: Diffusion models → Medical imaging and segmentation
Abstract (arXiv)
Self-supervised learning (SSL) and diffusion models have respectively advanced representation learning and generative modeling for high-dimensional 3D visual data, yet they are often developed as separate paradigms. Their unification remains challenging under multi-source heterogeneity, as anatomical content must be preserved for analysis while acquisition-related style varies across centers and affects synthesis. In this paper, we propose MeDUET, a 3D Medical image Disentangled UnifiEd PreTraining framework in the variational autoencoder latent space. MeDUET formulates unified pretraining as an empirical factor identifiability problem, aiming to learn domain-invariant content factors for anatomy and domain-specific style factors for appearance. To improve factor separation, MeDUET first uses token demixing with a standard adversarial domain regularizer to establish basic content-style specialization, and further introduces Mixed Factor Token Distillation and Swap-invariance Quadruplet Contrast to reduce mixed-region factor leakage and organize factor spaces with factor-wise invariance and discriminability. With these learned factors, MeDUET transfers effectively to both synthesis and analysis, yielding higher fidelity, faster convergence, and better controllability for synthesis, while achieving competitive or superior domain generalization and label efficiency on diverse datasets, tasks, and modalities. Overall, MeDUET shows that multi-source heterogeneity can serve as useful supervision, with disentanglement providing an effective interface for unifying 3D medical image synthesis and analysis. Our code is available at https://github.com/JK-Liu7/MeDUET.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 88 of its 128 references that are in the map. First posted on arXiv 19 Feb 2026.
Builds on
88 of 128 references.
Closest ancestors · 9
Same direction, newest first
- 2024Latent Drifting in Diffusion Models for Counterfactual Medical Image Synthesis30 Dec
- 20243D MedDiffusion: A 3D Medical Latent Diffusion Model for Controllable and High-quality Medical Image Generation17 Dec
- 2024MAISI: Medical AI for Synthetic Imaging13 Sep
- 2024FlowSDF: Flow Matching for Medical Image Segmentation Using Distance Transforms28 May
- 2024Style-Extracting Diffusion Models for Semi-Supervised Histopathology Segmentation21 Mar
- 2024WDM: 3D Wavelet Diffusion Models for High-Resolution Medical Image Synthesis29 Feb
- 2023Diffusion Model is Secretly a Training-free Open Vocabulary Semantic Segmenter6 Sep
- 2023GenerateCT: Text-Conditional Generation of 3D Chest CT Volumes25 May
- 2023DisC-Diff: Disentangled Conditional Diffusion Model for Multi-Contrast MRI Super-Resolution24 Mar
Other references · 79
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2015Domain-Adversarial Training of Neural Networkscited by 3,023
- 2020Supervised Contrastive Learningcited by 2,803
38 more
- 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,147
- 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 954
- 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 929
- 2022Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Imagescited by 823
- 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 762
- 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 707
- 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 666
- 2018Disentangling by Factorisingcited by 614
- 2022TotalSegmentator: robust segmentation of 104 anatomical structures in CT imagescited by 597
- 2021The RSNA-ASNR-MICCAI BraTS 2021 Benchmark on Brain Tumor Segmentation and Radiogenomic Classificationcited by 507
- 2022MONAI: An open-source framework for deep learning in healthcarecited by 438
- 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Modelscited by 376
- 2019A large annotated medical image dataset for the development and evaluation of segmentation algorithmscited by 371
- 2022AMOS: A Large-Scale Abdominal Multi-Organ Benchmark for Versatile Medical Image Segmentationcited by 347
- 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 334
- 2022Masked Siamese Networks for Label-Efficient Learningcited by 301
- 2018Towards a Definition of Disentangled Representationscited by 294
- 2018nnU-Net: Self-adapting Framework for U-Net-Based Medical Image Segmentationcited by 291
- 2019Med3D: Transfer Learning for 3D Medical Image Analysiscited by 282
- 2023MDTv2: Masked Diffusion Transformer is a Strong Image Synthesizercited by 260
- 2016Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: the LUNA16 challengecited by 198
- 2023Fast Training of Diffusion Models with Masked Transformerscited by 172
- 2016Multivariate mixture model for myocardium segmentation combining multi-source imagescited by 133
- 2023Decomposed Diffusion Sampler for Accelerating Large-Scale Inverse Problemscited by 129
- 2023Denoising Diffusion Autoencoders are Unified Self-supervised Learnerscited by 128
- 2022Disentangled Representation Learningcited by 111
- 2024Deconstructing Denoising Diffusion Models for Self-Supervised Learningcited by 89
- 2021Exploiting Domain-Specific Features to Enhance Domain Generalizationcited by 86
- 2023SODA: Bottleneck Diffusion Models for Representation Learningcited by 76
- 2022Masked Image Modeling Advances 3D Medical Image Analysiscited by 71
- 2023Diffusion Models as Masked Autoencoderscited by 71
- 2024VoCo: A Simple-yet-Effective Volume Contrastive Learning Framework for 3D Medical Image Analysiscited by 71
- 2024Towards Generalizable Tumor Synthesiscited by 65
- 2024The 2024 Brain Tumor Segmentation (BraTS) Challenge: Glioma Segmentation on Post-treatment MRIcited by 65
- 2021Learning Disentangled Representations in the Imaging Domaincited by 46
- 2022MixMAE: Mixed and Masked Autoencoder for Efficient Pretraining of Hierarchical Vision Transformerscited by 46
- 2023MedSyn: Text-guided Anatomy-aware Synthesis of High-Fidelity 3D CT Imagescited by 41
- 2023Mixed Autoencoder for Self-supervised Visual Representation Learningcited by 38
50 most cited of 79 All 79 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Language-Guided Trajectory Traversal in Disentangled Stable Diffusion Latent Space for Factorized Medical Image Generation
- 2026The Learnability Gap in Medical Latent Diffusion
- 2026CONFLUX: A Latent Diffusion Model for 3D Chest-CT Synthesis with RL Post-Training
- 2023MedGen3D: A Deep Generative Framework for Paired 3D Image and Mask Generation
- 2025Medical Semantic Segmentation with Diffusion Pretrain
- 2022Adapting Pretrained Vision-Language Foundational Models to Medical Imaging Domains
- 2026Visually-Guided Controllable Medical Image Generation via Fine-Grained Semantic Disentanglement
- 2025Enhancing 3D Medical Image Understanding with Pretraining Aided by 2D Multimodal Large Language Models