Any-to-All MRI Synthesis: A Unified Foundation Model for Nasopharyngeal Carcinoma and Its Downstream Applications
Not on the map. Why?
Abstract (arXiv)
Magnetic resonance imaging (MRI) is essential for nasopharyngeal carcinoma (NPC) radiotherapy (RT), but practical constraints, such as patient discomfort, long scan times, and high costs often lead to incomplete modalities in clinical practice, compromising RT planning accuracy. Traditional MRI synthesis methods are modality-specific, limited in anatomical adaptability, and lack clinical interpretability-failing to meet NPC's RT needs. Here, we developed a unified foundation model integrating contrastive visual representation learning and vision-language alignment (VLA) to enable any-to-all MRI synthesis. The model uses a contrastive encoder for modality-invariant representations and a CLIP-based text-informed decoder for semantically consistent synthesis, supporting any-to-all MRI synthesis via one unified foundation model. Trained on 40,825 images from 13 institutions, it achieves consistently high performance (average SSIM 0.90, PSNR 27) across 26 internal/external validation sites (15,748 images), with superior synthesis fidelity and robustness to noise and domain shifts. Meanwhile, its unified representation enhances downstream RT-relevant tasks (e.g., segmentation). This work advances digital medicine solutions for NPC care by leveraging foundation models to bridge technical synthesis and clinical utility.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 54 references that are in the map. First posted on arXiv 9 Feb 2026.
Builds on
21 of 54 references.
References · 21
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,552
- 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,218
- 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 954
- 2022Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Imagescited by 823
- 2022MedCLIP: Contrastive Learning from Unpaired Medical Images and Textcited by 564
- 2021SynthSeg: Segmentation of brain MRI scans of any contrast and resolution without retrainingcited by 235
- 2021ResViT: Residual vision transformers for multi-modal medical image synthesiscited by 177
- 2018Image Synthesis in Multi-Contrast MRI with Conditional Generative Adversarial Networkscited by 131
- 2023Unified Multi-Modal Image Synthesis for Missing Modality Imputationcited by 39
9 more
- 2019mustGAN: Multi-Stream Generative Adversarial Networks for MR Image Synthesiscited by 34
- 2024I2I-Mamba: Multi-modal medical image synthesis via selective state space modelingcited by 26
- 2024Multi-modal Vision Pre-training for Medical Image Analysiscited by 22
- 2024MedM2G: Unifying Medical Multi-Modal Generation via Cross-Guided Diffusion with Visual Invariantcited by 21
- 2023Cycle-guided Denoising Diffusion Probability Model for 3D Cross-modality MRI Synthesiscited by 18
- 2022Significantly improving zero-shot X-ray pathology classification via fine-tuning pre-trained image-text encoderscited by 15
- 2024RadCLIP: Enhancing Radiologic Image Analysis through Contrastive Language-Image Pre-trainingcited by 8
- 2024Diff5T: Benchmarking Human Brain Diffusion MRI with an Extensive 5.0 Tesla K-Space and Spatial Datasetcited by 5
- 2024A dataset of primary nasopharyngeal carcinoma MRI with multi-modalities segmentationcited by 2
Built on by
Not cited yet.