Towards Personalized Multi-Modal MRI Synthesis across Heterogeneous Datasets
Not on the map. Why?
Abstract (arXiv)
Synthesizing missing modalities in multi-modal magnetic resonance imaging (MRI) is vital for ensuring diagnostic completeness, particularly when full acquisitions are infeasible due to time constraints, motion artifacts, and patient tolerance. Recent unified synthesis models have enabled flexible synthesis tasks by accommodating various input-output configurations. However, their training and evaluation are typically restricted to a single dataset, limiting their generalizability across diverse clinical datasets and impeding practical deployment. To address this limitation, we propose PMM-Synth, a personalized MRI synthesis framework that not only supports various synthesis tasks but also generalizes effectively across heterogeneous datasets. PMM-Synth is jointly trained on multiple multi-modal MRI datasets that differ in modality coverage, disease types, and intensity distributions. It achieves cross-dataset generalization through three core innovations: a Personalized Feature Modulation module that dynamically adapts feature representations based on dataset identifier to mitigate the impact of distributional shifts; a Modality-Consistent Batch Scheduler that facilitates stable and efficient batch training under inconsistent modality conditions; and a selective supervision loss to ensure effective learning when ground truth modalities are partially missing. Evaluated on four clinical multi-modal MRI datasets, PMM-Synth consistently outperforms state-of-the-art methods in both one-to-one and many-to-one synthesis tasks, achieving superior PSNR and SSIM scores. Qualitative results further demonstrate improved preservation of anatomical structures and pathological details. Additionally, downstream tumor segmentation and radiological reporting studies suggest that PMM-Synth holds potential for supporting reliable diagnosis under real-world modality-missing scenarios.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 49 references that are in the map. First posted on arXiv 23 Feb 2026.
Builds on
22 of 49 references.
References · 22
- 2022Generative Adversarial Networkscited by 5,603
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
- 2017Generative Adversarial Networks: An Overviewcited by 588
- 2018Identifying the Best Machine Learning Algorithms for Brain Tumor Segmentation, Progression Assessment, and Overall Survival Prediction in the BRATS Challengecited by 508
- 2022Unsupervised Medical Image Translation with Adversarial Diffusion Modelscited by 191
- 2021ResViT: Residual vision transformers for multi-modal medical image synthesiscited by 177
- 2018Image Synthesis in Multi-Contrast MRI with Conditional Generative Adversarial Networkscited by 131
- 2022ISLES 2022: A multi-center magnetic resonance imaging stroke lesion segmentation datasetcited by 104
- 2019Missing MRI Pulse Sequence Synthesis using Multi-Modal Generative Adversarial Networkcited by 98
- 2016Medical Image Synthesis with Context-Aware Generative Adversarial Networkscited by 91
- 2020Hi-Net: Hybrid-fusion Network for Multi-modal MR Image Synthesiscited by 86
- 2023CoLa-Diff: Conditional Latent Diffusion Model for Multi-Modal MRI Synthesiscited by 64
10 more
- 2022One Model to Synthesize Them All: Multi-contrast Multi-scale Transformer for Missing Data Imputationcited by 40
- 2023Unified Multi-Modal Image Synthesis for Missing Modality Imputationcited by 39
- 2019DiamondGAN: Unified Multi-Modal Generative Adversarial Networks for MRI Sequences Synthesiscited by 36
- 2019CollaGAN : Collaborative GAN for Missing Image Data Imputationcited by 33
- 2020Multi-Domain Image Completion for Random Missing Input Datacited by 30
- 2024Cross-conditioned Diffusion Model for Medical Image to Image Translationcited by 26
- 2022One Model to Unite Them All: Personalized Federated Learning of Multi-Contrast MRI Synthesiscited by 22
- 2018Generative Adversarial Training for MRA Image Synthesis Using Multi-Contrast MRIcited by 10
- 2023FedFTN: Personalized Federated Learning with Deep Feature Transformation Network for Multi-institutional Low-count PET Denoisingcited by 3
- 2023Bi-Modality Medical Image Synthesis Using Semi-Supervised Sequential Generative Adversarial Networkscited by 3
Built on by
Not cited yet.