mlsanityData to 14 Oct 2026

FedDP-PALD: A Privacy-Preserving Federated Latent Diffusion Framework with Prototype Aggregation for Medical Data Synthesis

arXiv 2607.16300 ↗First posted 13 Jul 2026cs.CVcited by 0

On the map: Diffusion models → Robustness, privacy and adversarial aspects

Abstract (arXiv)

Medical images and physiological signals provide valuable information for accurate diagnosis. Developing diagnostic models often requires patient data from multiple institutions, although strict privacy regulations limit the sharing of sensitive clinical records. Federated learning enables multiple hospitals to train a shared model without exchanging raw data. However, existing methods face two problems: the information exchanged during training can reveal whether a patient's data were used, and synthetic data meant to replace real records often fail to preserve their predictive structure, which limits clinical use. To address this issue, we propose FedDP-PALD, a privacy-preserving federated latent diffusion framework for multimodal medical data synthesis under formal privacy guarantees. It jointly processes chest X-ray images and electrocardiogram (ECG) signals through gated multi-head attention with modality-availability masks, remaining effective even when a modality is missing. We also introduce Differentially Private Prototype Mixture Aggregation (DP-PMA), which clips class-level latent prototypes and adds calibrated Gaussian noise before combining them on the server to maintain (ε, δ) differential privacy. We evaluate FedDP-PALD on PneumoniaMNIST, ChestMNIST, and MIT-BIH datasets, where differential privacy reduced summary-level attack AUROC from 0.6229 ± 0.0026 to between 0.5016 and 0.5093 for privacy budgets from ε = 1 to ε = 8. On the test data, synthetic-latent training achieved an F1 score of 0.8993 ± 0.0006 and an AUROC of 0.9057 ± 0.0503, close to the 0.9747 ± 0.0132 real-latent training. These results show that FedDP-PALD generates private synthetic representations that preserve useful decision performance while strongly resisting membership inference.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 32 of its 55 references that are in the map. First posted on arXiv 13 Jul 2026.

Builds on

32 of 55 references.

References · 32

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2020Denoising Diffusion Implicit Modelscited by 9,781
  5. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  6. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
  7. 2022Classifier-Free Diffusion Guidancecited by 5,847
  8. 2016Layer Normalizationcited by 5,669
  9. 2017On Calibration of Modern Neural Networkscited by 4,960
  10. 2016Gaussian Error Linear Units (GELUs)cited by 3,502
  11. 2019Advances and Open Problems in Federated Learningcited by 3,046
  12. 2018Federated Optimization in Heterogeneous Networkscited by 2,987
20 more
  1. 2016Deep Learning with Differential Privacycited by 2,728
  2. 2016Membership Inference Attacks against Machine Learning Modelscited by 2,281
  3. 2021MedMNIST v2 -- A large-scale lightweight benchmark for 2D and 3D biomedical image classificationcited by 690
  4. 2020The Future of Digital Health with Federated Learningcited by 633
  5. 2013Network In Networkcited by 605
  6. 2020Reliable Fidelity and Diversity Metrics for Generative Modelscited by 434
  7. 2021FedProto: Federated Prototype Learning across Heterogeneous Clientscited by 352
  8. 2021Enhanced Membership Inference Attacks against Machine Learning Modelscited by 248
  9. 2018Improving the Gaussian Mechanism for Differential Privacy: Analytical Calibration and Optimal Denoisingcited by 218
  10. 2020Differentially Private Synthetic Medical Data Generation using Convolutional GANscited by 52
  11. 2024Cross-Modal Prototype based Multimodal Federated Learning under Severely Missing Modalitycited by 21
  12. 2023FedMEKT: Distillation-based Embedding Knowledge Transfer for Multimodal Federated Learningcited by 17
  13. 2023Multimodal Federated Learning with Missing Modality via Prototype Mask and Contrastcited by 17
  14. 2020Federating Recommendations Using Differentially Private Prototypescited by 13
  15. 2025Multimodal Federated Learning With Missing Modalities through Feature Imputation Networkcited by 8
  16. 2024On Differentially Private 3D Medical Image Synthesis with Controllable Latent Diffusion Modelscited by 7
  17. 2023SelfFed: Self-Supervised Federated Learning for Data Heterogeneity and Label Scarcity in Medical Imagescited by 4
  18. 2025FlexiD-Fuse: Flexible number of inputs multi-modal medical image fusion based on diffusion modelcited by 4
  19. 2024Differentially Private Prototypes for Imbalanced Transfer Learningcited by 2
  20. 2026An Explainable Vision-Language Model Framework with Adaptive PID-Tversky Loss for Lumbar Spinal Stenosis Diagnosiscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2022Federated Learning with Privacy-Preserving Ensemble Attention Distillation
  2. 2026MuCALD-SplitFed: Causal-Latent Diffusion for Privacy-Preserving Multi-Task Split-Federated Medical Image Segmentation
  3. 2023Federated Learning with Diffusion Models for Privacy-Sensitive Vision Tasks
  4. 2024CCVA-FL: Cross-Client Variations Adaptive Federated Learning for Medical Imaging
  5. 2025Few-Shot Generation of Brain Tumors for Secure and Fair Data Sharing
  6. 2024Federated Data Model
  7. 2024FedTabDiff: Federated Learning of Diffusion Probabilistic Models for Synthetic Mixed-Type Tabular Data Generation
  8. 2024EchoNet-Synthetic: Privacy-preserving Video Generation for Safe Medical Data Sharing