One Model to Unite Them All: Personalized Federated Learning of Multi-Contrast MRI Synthesis
Not on the map. Why?
Abstract (arXiv)
Multi-institutional collaborations are key for learning generalizable MRI synthesis models that translate source- onto target-contrast images. To facilitate collaboration, federated learning (FL) adopts decentralized training and mitigates privacy concerns by avoiding sharing of imaging data. However, FL-trained synthesis models can be impaired by the inherent heterogeneity in the data distribution, with domain shifts evident when common or variable translation tasks are prescribed across sites. Here we introduce the first personalized FL method for MRI Synthesis (pFLSynth) to improve reliability against domain shifts. pFLSynth is based on an adversarial model that produces latents specific to individual sites and source-target contrasts, and leverages novel personalization blocks to adaptively tune the statistics and weighting of feature maps across the generator stages given latents. To further promote site specificity, partial model aggregation is employed over downstream layers of the generator while upstream layers are retained locally. As such, pFLSynth enables training of a unified synthesis model that can reliably generalize across multiple sites and translation tasks. Comprehensive experiments on multi-site datasets clearly demonstrate the enhanced performance of pFLSynth against prior federated methods in multi-contrast MRI synthesis.
Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). Builds on 55 of its 108 references that are in the map. First posted on arXiv 13 Jul 2022.
Builds on
55 of 108 references.
References · 55
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2022Generative Adversarial Networkscited by 5,627
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
- 2019Federated Learning: Challenges, Methods, and Future Directionscited by 1,538
- 2020The Future of Digital Health with Federated Learningcited by 633
- 2021FedBN: Federated Learning on Non-IID Features via Local Batch Normalizationcited by 571
- 2017Opening the Black Box of Deep Neural Networks via Informationcited by 503
- 2021Towards Personalized Federated Learningcited by 464
- 2021A Field Guide to Federated Optimizationcited by 315
38 more
- 2021FedDG: Federated Domain Generalization on Medical Image Segmentation via Episodic Learning in Continuous Frequency Spacecited by 287
- 2018Attention Gated Networks: Learning to Leverage Salient Regions in Medical Imagescited by 272
- 2021SynthSeg: Segmentation of brain MRI scans of any contrast and resolution without retrainingcited by 237
- 2021Federated Learning with Buffered Asynchronous Aggregationcited by 190
- 2021ResViT: Residual vision transformers for multi-modal medical image synthesiscited by 177
- 2019Privacy-preserving Federated Brain Tumour Segmentationcited by 169
- 2018MedGAN: Medical Image Translation using GANscited by 152
- 2018Multi-Institutional Deep Learning Modeling Without Sharing Patient Data: A Feasibility Study on Brain Tumor Segmentationcited by 149
- 2018Image Synthesis in Multi-Contrast MRI with Conditional Generative Adversarial Networkscited by 132
- 2020Multi-site fMRI Analysis Using Privacy-preserving Federated Learning and Domain Adaptation: ABIDE Resultscited by 122
- 2020Deep Multimodal Fusion by Channel Exchangingcited by 118
- 2022Adaptive Diffusion Priors for Accelerated MRI Reconstructioncited by 118
- 2019Missing MRI Pulse Sequence Synthesis using Multi-Modal Generative Adversarial Networkcited by 98
- 2021Asynchronous Federated Learning on Heterogeneous Devices: A Surveycited by 93
- 2020FedGAN: Federated Generative Adversarial Networks for Distributed Datacited by 90
- 2017Deep MR to CT Synthesis using Unpaired Datacited by 86
- 2020Hi-Net: Hybrid-fusion Network for Multi-modal MR Image Synthesiscited by 86
- 2021Multi-institutional Collaborations for Improving Deep Learning-based Magnetic Resonance Image Reconstruction Using Federated Learningcited by 78
- 2019Association of genomic subtypes of lower-grade gliomas with shape features automatically extracted by a deep learning algorithmcited by 77
- 2021Unsupervised MRI Reconstruction via Zero-Shot Learned Adversarial Transformerscited by 77
- 2020Federated Learning for Breast Density Classification: A Real-World Implementationcited by 62
- 2019Unsupervised Domain Adaptation via Disentangled Representations: Application to Cross-Modality Liver Segmentationcited by 50
- 2021The Federated Tumor Segmentation (FeTS) Challengecited by 50
- 2022One Model to Synthesize Them All: Multi-contrast Multi-scale Transformer for Missing Data Imputationcited by 40
- 2019DiamondGAN: Unified Multi-Modal Generative Adversarial Networks for MRI Sequences Synthesiscited by 36
- 2021Specificity-Preserving Federated Learning for MR Image Reconstructioncited by 35
- 2019mustGAN: Multi-Stream Generative Adversarial Networks for MR Image Synthesiscited by 34
- 2022When do GANs replicate? On the choice of dataset sizecited by 34
- 2019CollaGAN : Collaborative GAN for Missing Image Data Imputationcited by 33
- 2022Federated Learning of Generative Image Priors for MRI Reconstructioncited by 33
- 2018Deep CT to MR Synthesis using Paired and Unpaired Datacited by 31
- 2021Unsupervised Domain Adaptation with Variational Approximation for Cardiac Segmentationcited by 28
- 2021FedDPGAN: Federated Differentially Private Generative Adversarial Networks Framework for the Detection of COVID-19 Pneumoniacited by 22
- 2022FedMed-GAN: Federated Domain Translation on Unsupervised Cross-Modality Brain Image Synthesiscited by 21
- 2020Layer-wise Characterization of Latent Information Leakage in Federated Learningcited by 19
- 2021FedDis: Disentangled Federated Learning for Unsupervised Brain Pathology Segmentationcited by 19
- 2021TranSMS: Transformers for Super-Resolution Calibration in Magnetic Particle Imagingcited by 18
- 2018High-resolution medical image synthesis using progressively grown generative adversarial networkscited by 17
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2023: 6; 2024: 7; 2025: 6; 2026: 3.
22 papers.
Sort:
By area:
- 2023Unified Multi-Modal Image Synthesis for Missing Modality Imputationcited by 40
- 2024I2I-Mamba: Multi-modal medical image synthesis via selective state space modelingcited by 26
- 2024From Challenges and Pitfalls to Recommendations and Opportunities: Implementing Federated Learning in Healthcarecited by 16
- 2023Learning Fourier-Constrained Diffusion Bridges for MRI Reconstructioncited by 14
- 2023Multimodal Federated Learning in Healthcare: a Reviewcited by 13
- 2024DenoMamba: A fused state-space model for low-dose CT denoisingcited by 11
- 2024Privacy Preserving Federated Learning in Medical Imaging with Uncertainty Estimationcited by 9
- 2024FedSynthCT-Brain: A Federated Learning Framework for Multi-Institutional Brain MRI-to-CT Synthesiscited by 6
- 2023Federated Pseudo Modality Generation for Incomplete Multi-Modal MRI Reconstructioncited by 5
- 2025Generative Autoregressive Transformers for Model-Agnostic Federated MRI Reconstructioncited by 5
- 2025Virtual Full-stack Scanning of Brain MRI via Imputing Any Quantised Codecited by 4
- 2023FedFTN: Personalized Federated Learning with Deep Feature Transformation Network for Multi-institutional Low-count PET Denoisingcited by 3
10 more
- 2023Adapting model-based deep learning to multiple acquisition conditions: Ada-MoDLcited by 3
- 2025Adaptation of Foundation Models for Medical Image Analysis: Strategies, Challenges, and Future Directionscited by 3
- 2025Enhancing the Convergence of Federated Learning Aggregation Strategies with Limited Datacited by 2
- 2025Federated Learning for Large Models in Medical Imaging: A Comprehensive Reviewcited by 2
- 2025A Privacy-Preserving Federated Learning Framework for Generalizable CBCT to Synthetic CT Translation in Head and Neckcited by 1
- 2024Improving Multi-Center Generalizability of GAN-Based Fat Suppression using Federated Learningcited by 0
- 2024Machine Learning Techniques for MRI Data Processing at Expanding Scalecited by 0
- 2026NeuroSSM: Multiscale Differential State-Space Modeling for Context-Aware fMRI Analysiscited by 0
- 2026Towards Personalized Multi-Modal MRI Synthesis across Heterogeneous Datasetscited by 0
- 2026FedCoRe: Target-Adaptive Completion for Missing Modalities in Healthcare Federated Learningcited by 0
- 2026FedCoRe: Target-Adaptive Completion for Missing Modalities in Healthcare Federated Learning18 Aug 2026
- 2026Towards Personalized Multi-Modal MRI Synthesis across Heterogeneous Datasets23 Feb 2026
- 2026NeuroSSM: Multiscale Differential State-Space Modeling for Context-Aware fMRI Analysis3 Jan 2026
- 2025Adaptation of Foundation Models for Medical Image Analysis: Strategies, Challenges, and Future Directions3 Nov 2025
- 2025Federated Learning for Large Models in Medical Imaging: A Comprehensive Review28 Aug 2025
- 2025A Privacy-Preserving Federated Learning Framework for Generalizable CBCT to Synthetic CT Translation in Head and Neck10 Jun 2025
- 2025Generative Autoregressive Transformers for Model-Agnostic Federated MRI Reconstruction6 Feb 2025
- 2025Virtual Full-stack Scanning of Brain MRI via Imputing Any Quantised Code30 Jan 2025
- 2025Enhancing the Convergence of Federated Learning Aggregation Strategies with Limited Data27 Jan 2025
- 2024FedSynthCT-Brain: A Federated Learning Framework for Multi-Institutional Brain MRI-to-CT Synthesis9 Dec 2024
- 2024DenoMamba: A fused state-space model for low-dose CT denoising19 Sep 2024
- 2024From Challenges and Pitfalls to Recommendations and Opportunities: Implementing Federated Learning in Healthcare15 Sep 2024
10 more
- 2024Privacy Preserving Federated Learning in Medical Imaging with Uncertainty Estimation18 Jun 2024
- 2024I2I-Mamba: Multi-modal medical image synthesis via selective state space modeling22 May 2024
- 2024Machine Learning Techniques for MRI Data Processing at Expanding Scale22 Apr 2024
- 2024Improving Multi-Center Generalizability of GAN-Based Fat Suppression using Federated Learning10 Apr 2024
- 2023Multimodal Federated Learning in Healthcare: a Review14 Oct 2023
- 2023Federated Pseudo Modality Generation for Incomplete Multi-Modal MRI Reconstruction20 Aug 2023
- 2023Learning Fourier-Constrained Diffusion Bridges for MRI Reconstruction2 Aug 2023
- 2023Adapting model-based deep learning to multiple acquisition conditions: Ada-MoDL21 Apr 2023
- 2023Unified Multi-Modal Image Synthesis for Missing Modality Imputation11 Apr 2023
- 2023FedFTN: Personalized Federated Learning with Deep Feature Transformation Network for Multi-institutional Low-count PET Denoising2 Apr 2023
- 2023Unified Multi-Modal Image Synthesis for Missing Modality Imputationcited by 40
- 2024From Challenges and Pitfalls to Recommendations and Opportunities: Implementing Federated Learning in Healthcarecited by 16
- 2023Multimodal Federated Learning in Healthcare: a Reviewcited by 13
- 2024DenoMamba: A fused state-space model for low-dose CT denoisingcited by 11
- 2024Privacy Preserving Federated Learning in Medical Imaging with Uncertainty Estimationcited by 9
- 2024FedSynthCT-Brain: A Federated Learning Framework for Multi-Institutional Brain MRI-to-CT Synthesiscited by 6
- 2023Federated Pseudo Modality Generation for Incomplete Multi-Modal MRI Reconstructioncited by 5
- 2025Generative Autoregressive Transformers for Model-Agnostic Federated MRI Reconstructioncited by 5
- 2025Virtual Full-stack Scanning of Brain MRI via Imputing Any Quantised Codecited by 4
- 2023FedFTN: Personalized Federated Learning with Deep Feature Transformation Network for Multi-institutional Low-count PET Denoisingcited by 3
- 2023Adapting model-based deep learning to multiple acquisition conditions: Ada-MoDLcited by 3
- 2025Adaptation of Foundation Models for Medical Image Analysis: Strategies, Challenges, and Future Directionscited by 3
12 most cited of 19 All 19 (JSON)
- 2026FedCoRe: Target-Adaptive Completion for Missing Modalities in Healthcare Federated Learning18 Aug 2026
- 2026Towards Personalized Multi-Modal MRI Synthesis across Heterogeneous Datasets23 Feb 2026
- 2025Adaptation of Foundation Models for Medical Image Analysis: Strategies, Challenges, and Future Directions3 Nov 2025
- 2025Federated Learning for Large Models in Medical Imaging: A Comprehensive Review28 Aug 2025
- 2025A Privacy-Preserving Federated Learning Framework for Generalizable CBCT to Synthetic CT Translation in Head and Neck10 Jun 2025
- 2025Generative Autoregressive Transformers for Model-Agnostic Federated MRI Reconstruction6 Feb 2025
- 2025Virtual Full-stack Scanning of Brain MRI via Imputing Any Quantised Code30 Jan 2025
- 2025Enhancing the Convergence of Federated Learning Aggregation Strategies with Limited Data27 Jan 2025
- 2024FedSynthCT-Brain: A Federated Learning Framework for Multi-Institutional Brain MRI-to-CT Synthesis9 Dec 2024
- 2024DenoMamba: A fused state-space model for low-dose CT denoising19 Sep 2024
- 2024From Challenges and Pitfalls to Recommendations and Opportunities: Implementing Federated Learning in Healthcare15 Sep 2024
- 2024Privacy Preserving Federated Learning in Medical Imaging with Uncertainty Estimation18 Jun 2024
12 newest of 19 All 19 (JSON)