Do Gradient Inversion Attacks Make Federated Learning Unsafe?
Not on the map. Why?
Abstract (arXiv)
Federated learning (FL) allows the collaborative training of AI models without needing to share raw data. This capability makes it especially interesting for healthcare applications where patient and data privacy is of utmost concern. However, recent works on the inversion of deep neural networks from model gradients raised concerns about the security of FL in preventing the leakage of training data. In this work, we show that these attacks presented in the literature are impractical in FL use-cases where the clients' training involves updating the Batch Normalization (BN) statistics and provide a new baseline attack that works for such scenarios. Furthermore, we present new ways to measure and visualize potential data leakage in FL. Our work is a step towards establishing reproducible methods of measuring data leakage in FL and could help determine the optimal tradeoffs between privacy-preserving techniques, such as differential privacy, and model accuracy based on quantifiable metrics. Code is available at https://nvidia.github.io/NVFlare/research/quantifying-data-leakage.
Key facts. Cited by 44 papers in the map (data through 14 Oct 2026). Builds on 33 of its 58 references that are in the map. First posted on arXiv 14 Feb 2022.
Builds on
33 of 58 references.
References · 33
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2016Densely Connected Convolutional Networkscited by 6,720
- 2019Advances and Open Problems in Federated Learningcited by 3,046
- 2018Federated Optimization in Heterogeneous Networkscited by 2,987
- 2016Deep Learning with Differential Privacycited by 2,728
- 2020Adaptive Federated Optimizationcited by 1,046
- 2019Deep Leakage from Gradientscited by 1,021
- 2020Inverting Gradients -- How easy is it to break privacy in federated learning?cited by 712
- 2020The Future of Digital Health with Federated Learningcited by 633
- 2021FedBN: Federated Learning on Non-IID Features via Local Batch Normalizationcited by 571
21 more
- 2019Dreaming to Distill: Data-free Knowledge Transfer via DeepInversioncited by 423
- 2019Federated Machine Learning: Concept and Applicationscited by 412
- 2017Deep Models Under the GAN: Information Leakage from Collaborative Deep Learningcited by 334
- 2021See through Gradients: Image Batch Recovery via GradInversioncited by 326
- 2019Differential Privacy Has Disparate Impact on Model Accuracycited by 316
- 2020Systematic Evaluation of Privacy Risks of Machine Learning Modelscited by 292
- 2018Beyond Inferring Class Representatives: User-Level Privacy Leakage From Federated Learningcited by 246
- 2020Can AI help in screening Viral and COVID-19 pneumonia?cited by 200
- 2020FetchSGD: Communication-Efficient Federated Learning with Sketchingcited by 179
- 2019Privacy-preserving Federated Brain Tumour Segmentationcited by 169
- 2018Multi-Institutional Deep Learning Modeling Without Sharing Patient Data: A Feasibility Study on Brain Tumor Segmentationcited by 149
- 2020Provable Defense against Privacy Leakage in Federated Learning from Representation Perspectivecited by 94
- 2018A General Approach to Adding Differential Privacy to Iterative Training Procedurescited by 84
- 2020Local and Central Differential Privacy for Robustness and Privacy in Federated Learningcited by 78
- 2020Federated Learning for Breast Density Classification: A Real-World Implementationcited by 62
- 2020Siloed Federated Learning for Multi-Centric Histopathology Datasetscited by 61
- 2020Local Differential Privacy and Its Applications: A Comprehensive Surveycited by 41
- 2016Understanding the Sparse Vector Technique for Differential Privacycited by 27
- 2020Federated Learning and Differential Privacy: Software tools analysis, the Sherpa.ai FL framework and methodological guidelines for preserving data privacycited by 22
- 2019P3SGD: Patient Privacy Preserving SGD for Regularizing Deep CNNs in Pathological Image Classificationcited by 14
- 2020Differentially Private Federated Learning with Laplacian Smoothingcited by 8
Built on by
Citing papers per year: 2022: 6; 2023: 8; 2024: 17; 2025: 10; 2026: 3.
44 papers.
Sort:
By area:
- 2022NVIDIA FLARE: Federated Learning from Simulation to Real-Worldcited by 80
- 2023Federated Learning for Medical Image Analysis: A Surveycited by 78
- 2022Structural Pruning via Latency-Saliency Knapsackcited by 41
- 2024Advances in APPFL: A Comprehensive and Extensible Federated Learning Frameworkcited by 19
- 2023Private, fair and accurate: Training large-scale, privacy-preserving AI models in medical imagingcited by 17
- 2024From Challenges and Pitfalls to Recommendations and Opportunities: Implementing Federated Learning in Healthcarecited by 16
- 2024The Federation Strikes Back: A Survey of Federated Learning Privacy Attacks, Defenses, Applications, and Policy Landscapecited by 13
- 2023Gradient-Free Privacy Leakage in Federated Language Models through Selective Weight Tamperingcited by 9
- 2025Exploring the Vulnerabilities of Federated Learning: A Deep Dive into Gradient Inversion Attackscited by 9
- 2022Beyond Gradients: Exploiting Adversarial Priors in Model Inversion Attackscited by 7
- 2025Differential privacy for medical deep learning: methods, tradeoffs, and deployment implicationscited by 7
- 2023Personalized and privacy-preserving federated heterogeneous medical image analysis with PPPML-HMIcited by 6
32 more
- 2024CGI-DM: Digital Copyright Authentication for Diffusion Models via Contrasting Gradient Inversioncited by 6
- 2024Secure Aggregation is Not Private Against Membership Inference Attackscited by 6
- 2023Private Federated Learning with Autotuned Compressioncited by 5
- 2024A Systematic Review of Federated Generative Modelscited by 5
- 2024Federated brain tumor segmentation: an extensive benchmarkcited by 5
- 2025A Thorough Assessment of the Non-IID Data Impact in Federated Learningcited by 5
- 2022Class Impression for Data-free Incremental Learningcited by 4
- 2022Split-U-Net: Preventing Data Leakage in Split Learning for Collaborative Multi-Modal Brain Tumor Segmentationcited by 4
- 2024Differential privacy enables fair and accurate AI-based analysis of speech disorders while protecting patient datacited by 4
- 2023SRATTA : Sample Re-ATTribution Attack of Secure Aggregation in Federated Learningcited by 3
- 2024Federated and Transfer Learning for Cancer Detection Based on Image Analysiscited by 3
- 2024A Federated Learning Platform as a Service for Advancing Stroke Management in European Clinical Centerscited by 3
- 2024AFGI: Towards Accurate and Fast-convergent Gradient Inversion Attack in Federated Learningcited by 2
- 2024GI-SMN: Gradient Inversion Attack against Federated Learning without Prior Knowledgecited by 2
- 2024Dealing Doubt: Unveiling Threat Models in Gradient Inversion Attacks under Federated Learning, A Survey and Taxonomycited by 2
- 2024CCSI: Continual Class-Specific Impression for Data-free Class Incremental Learningcited by 2
- 2025Shadow defense against gradient inversion attack in federated learningcited by 2
- 2025On the Security and Privacy of Federated Learning: A Survey with Attacks, Defenses, Frameworks, Applications, and Future Directionscited by 2
- 2025Practical Feasibility of Gradient Inversion Attacks in Federated Learningcited by 2
- 2024MGIC: A Multi-Label Gradient Inversion Attack based on Canny Edge Detection on Federated Learningcited by 1
- 2025Differentially Private 2D Human Pose Estimationcited by 1
- 2025PC-MoE: Memory-Efficient and Privacy-Preserving Collaborative Training for Mixture-of-Experts LLMscited by 1
- 2025Load-Aware Training Scheduling for Model Circulation-based Decentralized Federated Learningcited by 1
- 2025SHeRL-FL: When Representation Learning Meets Split Learning in Hierarchical Federated Learningcited by 1
- 2022Secure & Private Federated Neuroimagingcited by 0
- 2023Single-round Self-supervised Distributed Learning using Vision Transformercited by 0
- 2023Foreseeing Reconstruction Quality of Gradient Inversion: An Optimization Perspectivecited by 0
- 2024Survey of Privacy Threats and Countermeasures in Federated Learningcited by 0
- 2024Privacy Attack in Federated Learning is Not Easy: An Experimental Studycited by 0
- 2026Privacy Leakage in Federated Learning in Radiology Reports: A Comparative Evaluation of Tokenizer-Driven Privacy Riskscited by 0
- 2026When Topology Betrays Privacy: Lattice-Based Reconstruction Attacks on Secure Aggregation in Decentralized Federated Learningcited by 0
- 2026Differentially Private EEG Feature Anonymization: A Privacy-Utility Case Study in Clinical Neurophysiologycited by 0
- 2026Differentially Private EEG Feature Anonymization: A Privacy-Utility Case Study in Clinical Neurophysiology10 Sep 2026
- 2026When Topology Betrays Privacy: Lattice-Based Reconstruction Attacks on Secure Aggregation in Decentralized Federated Learning8 Sep 2026
- 2026Privacy Leakage in Federated Learning in Radiology Reports: A Comparative Evaluation of Tokenizer-Driven Privacy Risks15 Jul 2026
- 2025Practical Feasibility of Gradient Inversion Attacks in Federated Learning27 Aug 2025
- 2025On the Security and Privacy of Federated Learning: A Survey with Attacks, Defenses, Frameworks, Applications, and Future Directions19 Aug 2025
- 2025SHeRL-FL: When Representation Learning Meets Split Learning in Hierarchical Federated Learning11 Aug 2025
- 2025Load-Aware Training Scheduling for Model Circulation-based Decentralized Federated Learning11 Jun 2025
- 2025PC-MoE: Memory-Efficient and Privacy-Preserving Collaborative Training for Mixture-of-Experts LLMs3 Jun 2025
- 2025Differential privacy for medical deep learning: methods, tradeoffs, and deployment implications31 May 2025
- 2025Shadow defense against gradient inversion attack in federated learning30 May 2025
- 2025Differentially Private 2D Human Pose Estimation14 Apr 2025
- 2025A Thorough Assessment of the Non-IID Data Impact in Federated Learning21 Mar 2025
32 more
- 2025Exploring the Vulnerabilities of Federated Learning: A Deep Dive into Gradient Inversion Attacks13 Mar 2025
- 2024Federated brain tumor segmentation: an extensive benchmark7 Oct 2024
- 2024A Federated Learning Platform as a Service for Advancing Stroke Management in European Clinical Centers2 Oct 2024
- 2024Privacy Attack in Federated Learning is Not Easy: An Experimental Study28 Sep 2024
- 2024Differential privacy enables fair and accurate AI-based analysis of speech disorders while protecting patient data27 Sep 2024
- 2024Advances in APPFL: A Comprehensive and Extensible Federated Learning Framework17 Sep 2024
- 2024From Challenges and Pitfalls to Recommendations and Opportunities: Implementing Federated Learning in Healthcare15 Sep 2024
- 2024CCSI: Continual Class-Specific Impression for Data-free Class Incremental Learning9 Jun 2024
- 2024Federated and Transfer Learning for Cancer Detection Based on Image Analysis30 May 2024
- 2024A Systematic Review of Federated Generative Models26 May 2024
- 2024Dealing Doubt: Unveiling Threat Models in Gradient Inversion Attacks under Federated Learning, A Survey and Taxonomy16 May 2024
- 2024The Federation Strikes Back: A Survey of Federated Learning Privacy Attacks, Defenses, Applications, and Policy Landscape6 May 2024
- 2024GI-SMN: Gradient Inversion Attack against Federated Learning without Prior Knowledge6 May 2024
- 2024Secure Aggregation is Not Private Against Membership Inference Attacks26 Mar 2024
- 2024CGI-DM: Digital Copyright Authentication for Diffusion Models via Contrasting Gradient Inversion17 Mar 2024
- 2024AFGI: Towards Accurate and Fast-convergent Gradient Inversion Attack in Federated Learning13 Mar 2024
- 2024MGIC: A Multi-Label Gradient Inversion Attack based on Canny Edge Detection on Federated Learning13 Mar 2024
- 2024Survey of Privacy Threats and Countermeasures in Federated Learning1 Feb 2024
- 2023Foreseeing Reconstruction Quality of Gradient Inversion: An Optimization Perspective19 Dec 2023
- 2023Gradient-Free Privacy Leakage in Federated Language Models through Selective Weight Tampering24 Oct 2023
- 2023Private Federated Learning with Autotuned Compression20 Jul 2023
- 2023SRATTA : Sample Re-ATTribution Attack of Secure Aggregation in Federated Learning13 Jun 2023
- 2023Federated Learning for Medical Image Analysis: A Survey9 Jun 2023
- 2023Personalized and privacy-preserving federated heterogeneous medical image analysis with PPPML-HMI20 Feb 2023
- 2023Private, fair and accurate: Training large-scale, privacy-preserving AI models in medical imaging3 Feb 2023
- 2023Single-round Self-supervised Distributed Learning using Vision Transformer5 Jan 2023
- 2022NVIDIA FLARE: Federated Learning from Simulation to Real-World24 Oct 2022
- 2022Structural Pruning via Latency-Saliency Knapsack13 Oct 2022
- 2022Split-U-Net: Preventing Data Leakage in Split Learning for Collaborative Multi-Modal Brain Tumor Segmentation22 Aug 2022
- 2022Class Impression for Data-free Incremental Learning26 Jun 2022
- 2022Secure & Private Federated Neuroimaging11 May 2022
- 2022Beyond Gradients: Exploiting Adversarial Priors in Model Inversion Attacks1 Mar 2022
- 2022NVIDIA FLARE: Federated Learning from Simulation to Real-Worldcited by 80
- 2023Federated Learning for Medical Image Analysis: A Surveycited by 78
- 2022Structural Pruning via Latency-Saliency Knapsackcited by 41
- 2024Advances in APPFL: A Comprehensive and Extensible Federated Learning Frameworkcited by 19
- 2023Private, fair and accurate: Training large-scale, privacy-preserving AI models in medical imagingcited by 17
- 2024From Challenges and Pitfalls to Recommendations and Opportunities: Implementing Federated Learning in Healthcarecited by 16
- 2024The Federation Strikes Back: A Survey of Federated Learning Privacy Attacks, Defenses, Applications, and Policy Landscapecited by 13
- 2023Gradient-Free Privacy Leakage in Federated Language Models through Selective Weight Tamperingcited by 9
- 2025Exploring the Vulnerabilities of Federated Learning: A Deep Dive into Gradient Inversion Attackscited by 9
- 2022Beyond Gradients: Exploiting Adversarial Priors in Model Inversion Attackscited by 7
- 2025Differential privacy for medical deep learning: methods, tradeoffs, and deployment implicationscited by 7
- 2023Personalized and privacy-preserving federated heterogeneous medical image analysis with PPPML-HMIcited by 6
12 most cited of 41 All 41 (JSON)
- 2026Differentially Private EEG Feature Anonymization: A Privacy-Utility Case Study in Clinical Neurophysiology10 Sep 2026
- 2026When Topology Betrays Privacy: Lattice-Based Reconstruction Attacks on Secure Aggregation in Decentralized Federated Learning8 Sep 2026
- 2026Privacy Leakage in Federated Learning in Radiology Reports: A Comparative Evaluation of Tokenizer-Driven Privacy Risks15 Jul 2026
- 2025Practical Feasibility of Gradient Inversion Attacks in Federated Learning27 Aug 2025
- 2025On the Security and Privacy of Federated Learning: A Survey with Attacks, Defenses, Frameworks, Applications, and Future Directions19 Aug 2025
- 2025SHeRL-FL: When Representation Learning Meets Split Learning in Hierarchical Federated Learning11 Aug 2025
- 2025Load-Aware Training Scheduling for Model Circulation-based Decentralized Federated Learning11 Jun 2025
- 2025Differential privacy for medical deep learning: methods, tradeoffs, and deployment implications31 May 2025
- 2025Shadow defense against gradient inversion attack in federated learning30 May 2025
- 2025Differentially Private 2D Human Pose Estimation14 Apr 2025
- 2025A Thorough Assessment of the Non-IID Data Impact in Federated Learning21 Mar 2025
- 2025Exploring the Vulnerabilities of Federated Learning: A Deep Dive into Gradient Inversion Attacks13 Mar 2025
12 newest of 41 All 41 (JSON)