Source Inference Attacks in Federated Learning
Not on the map. Why?
Abstract (arXiv)
Federated learning (FL) has emerged as a promising privacy-aware paradigm that allows multiple clients to jointly train a model without sharing their private data. Recently, many studies have shown that FL is vulnerable to membership inference attacks (MIAs) that can distinguish the training members of the given model from the non-members. However, existing MIAs ignore the source of a training member, i.e., the information of which client owns the training member, while it is essential to explore source privacy in FL beyond membership privacy of examples from all clients. The leakage of source information can lead to severe privacy issues. For example, identification of the hospital contributing to the training of an FL model for COVID-19 pandemic can render the owner of a data record from this hospital more prone to discrimination if the hospital is in a high risk region. In this paper, we propose a new inference attack called source inference attack (SIA), which can derive an optimal estimation of the source of a training member. Specifically, we innovatively adopt the Bayesian perspective to demonstrate that an honest-but-curious server can launch an SIA to steal non-trivial source information of the training members without violating the FL protocol. The server leverages the prediction loss of local models on the training members to achieve the attack effectively and non-intrusively. We conduct extensive experiments on one synthetic and five real datasets to evaluate the key factors in an SIA, and the results show the efficacy of the proposed source inference attack.
Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). Builds on 25 of its 40 references that are in the map. First posted on arXiv 13 Sep 2021.
Builds on
25 of 40 references.
References · 25
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2018Federated Optimization in Heterogeneous Networkscited by 2,971
- 2016Membership Inference Attacks against Machine Learning Modelscited by 2,221
- 2019Federated Learning: Challenges, Methods, and Future Directionscited by 1,531
- 2019On the Convergence of FedAvg on Non-IID Datacited by 1,220
- 2018Federated Learning with Non-IID Datacited by 1,099
- 2019Deep Leakage from Gradientscited by 1,004
- 2018The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networkscited by 847
- 2018How To Backdoor Federated Learningcited by 745
- 2020Ensemble Distillation for Robust Model Fusion in Federated Learningcited by 678
- 2018Exploiting Unintended Feature Leakage in Collaborative Learningcited by 509
- 2019FedMD: Heterogenous Federated Learning via Model Distillationcited by 454
13 more
- 2017Differentially Private Federated Learning: A Client Level Perspectivecited by 451
- 2017Deep Models Under the GAN: Information Leakage from Collaborative Deep Learningcited by 326
- 2021Membership Inference Attacks on Machine Learning: A Surveycited by 306
- 2020FedML: A Research Library and Benchmark for Federated Machine Learningcited by 298
- 2018Beyond Inferring Class Representatives: User-Level Privacy Leakage From Federated Learningcited by 242
- 2018A Hybrid Approach to Privacy-Preserving Federated Learningcited by 208
- 2017Machine Learning Models that Remember Too Muchcited by 165
- 2018Protection Against Reconstruction and Its Applications in Private Federated Learningcited by 127
- 2020LDP-FL: Practical Private Aggregation in Federated Learning with Local Differential Privacycited by 63
- 2020Federated Model Distillation with Noise-Free Differential Privacycited by 40
- 2018Towards Demystifying Membership Inference Attackscited by 39
- 2020Secure Deep Graph Generation with Link Differential Privacycited by 24
- 2021Membership Inference Attacks on Knowledge Graphscited by 11
Built on by
Citing papers per year: 2021: 1; 2022: 6; 2023: 5; 2024: 5; 2025: 7; 2026: 7.
31 papers.
Sort:
By area:
- 2022M^4I: Multi-modal Models Membership Inferencecited by 30
- 2023FedSecurity: Benchmarking Attacks and Defenses in Federated Learning and Federated LLMscited by 19
- 2021Attribute Inference Attack of Speech Emotion Recognition in Federated Learning Settingscited by 12
- 2023FedDWA: Personalized Federated Learning with Dynamic Weight Adjustmentcited by 9
- 2022Flow: Per-Instance Personalized Federated Learning Through Dynamic Routingcited by 6
- 2023Personalized and privacy-preserving federated heterogeneous medical image analysis with PPPML-HMIcited by 6
- 2023MIA-BAD: An Approach for Enhancing Membership Inference Attack and its Mitigation with Federated Learningcited by 4
- 2022Emerging Threats in Deep Learning-Based Autonomous Driving: A Comprehensive Surveycited by 3
- 2023On Knowledge Editing in Federated Learning: Perspectives, Challenges, and Future Directionscited by 3
- 2025Equitable Federated Learning with NCAcited by 3
- 2022Perfectly Accurate Membership Inference by a Dishonest Central Server in Federated Learningcited by 2
- 2022Local Model Reconstruction Attacks in Federated Learning and their Usescited by 2
19 more
- 2024No Vandalism: Privacy-Preserving and Byzantine-Robust Federated Learningcited by 2
- 2024Inference Attacks: A Taxonomy, Survey, and Promising Directionscited by 2
- 2025FinP: Fairness-in-Privacy in Federated Learning by Addressing Disparities in Privacy Riskcited by 2
- 2024Enhancing Security and Privacy in Federated Learning using Low-Dimensional Update Representation and Proximity-Based Defensecited by 1
- 2024SoK: Towards Security and Safety of Edge AIcited by 1
- 2026SoK: Challenges in Tabular Membership Inference Attackscited by 1
- 2026CQSA: Byzantine-robust Clustered Quantum Secure Aggregation in Federated Learningcited by 1
- 2022Efficient and Privacy Preserving Group Signature for Federated Learningcited by 0
- 2024Unraveling Attacks in Machine Learning-based IoT Ecosystems: A Survey and the Open Libraries Behind Themcited by 0
- 2025Mitigating Membership Inference Vulnerability in Personalized Federated Learningcited by 0
- 2025Evaluating Query Efficiency and Accuracy of Transfer Learning-based Model Extraction Attack in Federated Learningcited by 0
- 2025Enhancing Privacy in Decentralized Min-Max Optimization: A Differentially Private Approachcited by 0
- 2025Multi-Hop Privacy Propagation for Differentially Private Federated Learning in Social Networkscited by 0
- 2025Accurate and Private Diagnosis of Rare Genetic Syndromes from Facial Images with Federated Deep Learningcited by 0
- 2026ERIS: Enhancing Privacy and Scalability in Federated Learning via Federated Shard Aggregationcited by 0
- 2026IntraShuffler: A Privacy Preserving Framework for Heterogeneous DP Federated Learningcited by 0
- 2026PRoVeFL: Private Robust and Verifiable Aggregation in Federated Learningcited by 0
- 2026Protecting patient privacy in clinical foundation models: Technical and legal perspectivescited by 0
- 2026Upholding Robustness in Federated Learning: Trends, Emerging Strategies, and Research Opportunitiescited by 0
- 2026Upholding Robustness in Federated Learning: Trends, Emerging Strategies, and Research Opportunities23 Sep 2026
- 2026Protecting patient privacy in clinical foundation models: Technical and legal perspectives7 Aug 2026
- 2026PRoVeFL: Private Robust and Verifiable Aggregation in Federated Learning7 Jul 2026
- 2026IntraShuffler: A Privacy Preserving Framework for Heterogeneous DP Federated Learning1 Jun 2026
- 2026CQSA: Byzantine-robust Clustered Quantum Secure Aggregation in Federated Learning25 Feb 2026
- 2026ERIS: Enhancing Privacy and Scalability in Federated Learning via Federated Shard Aggregation9 Feb 2026
- 2026SoK: Challenges in Tabular Membership Inference Attacks22 Jan 2026
- 2025Accurate and Private Diagnosis of Rare Genetic Syndromes from Facial Images with Federated Deep Learning12 Sep 2025
- 2025Multi-Hop Privacy Propagation for Differentially Private Federated Learning in Social Networks11 Aug 2025
- 2025Enhancing Privacy in Decentralized Min-Max Optimization: A Differentially Private Approach10 Aug 2025
- 2025Equitable Federated Learning with NCA26 Jun 2025
- 2025Evaluating Query Efficiency and Accuracy of Transfer Learning-based Model Extraction Attack in Federated Learning25 May 2025
19 more
- 2025Mitigating Membership Inference Vulnerability in Personalized Federated Learning12 Mar 2025
- 2025FinP: Fairness-in-Privacy in Federated Learning by Addressing Disparities in Privacy Risk25 Feb 2025
- 2024SoK: Towards Security and Safety of Edge AI7 Oct 2024
- 2024Inference Attacks: A Taxonomy, Survey, and Promising Directions4 Jun 2024
- 2024No Vandalism: Privacy-Preserving and Byzantine-Robust Federated Learning3 Jun 2024
- 2024Enhancing Security and Privacy in Federated Learning using Low-Dimensional Update Representation and Proximity-Based Defense29 May 2024
- 2024Unraveling Attacks in Machine Learning-based IoT Ecosystems: A Survey and the Open Libraries Behind Them22 Jan 2024
- 2023MIA-BAD: An Approach for Enhancing Membership Inference Attack and its Mitigation with Federated Learning28 Nov 2023
- 2023FedSecurity: Benchmarking Attacks and Defenses in Federated Learning and Federated LLMs8 Jun 2023
- 2023On Knowledge Editing in Federated Learning: Perspectives, Challenges, and Future Directions2 Jun 2023
- 2023FedDWA: Personalized Federated Learning with Dynamic Weight Adjustment10 May 2023
- 2023Personalized and privacy-preserving federated heterogeneous medical image analysis with PPPML-HMI20 Feb 2023
- 2022Flow: Per-Instance Personalized Federated Learning Through Dynamic Routing28 Nov 2022
- 2022Local Model Reconstruction Attacks in Federated Learning and their Uses28 Oct 2022
- 2022Emerging Threats in Deep Learning-Based Autonomous Driving: A Comprehensive Survey19 Oct 2022
- 2022M^4I: Multi-modal Models Membership Inference15 Sep 2022
- 2022Efficient and Privacy Preserving Group Signature for Federated Learning12 Jul 2022
- 2022Perfectly Accurate Membership Inference by a Dishonest Central Server in Federated Learning30 Mar 2022
- 2021Attribute Inference Attack of Speech Emotion Recognition in Federated Learning Settings26 Dec 2021
- 2022M^4I: Multi-modal Models Membership Inferencecited by 30
- 2023MIA-BAD: An Approach for Enhancing Membership Inference Attack and its Mitigation with Federated Learningcited by 4
- 2022Perfectly Accurate Membership Inference by a Dishonest Central Server in Federated Learningcited by 2
- 2026SoK: Challenges in Tabular Membership Inference Attackscited by 1
- 2025Mitigating Membership Inference Vulnerability in Personalized Federated Learningcited by 0
- 2026SoK: Challenges in Tabular Membership Inference Attacks22 Jan 2026
- 2025Mitigating Membership Inference Vulnerability in Personalized Federated Learning12 Mar 2025
- 2023MIA-BAD: An Approach for Enhancing Membership Inference Attack and its Mitigation with Federated Learning28 Nov 2023
- 2022M^4I: Multi-modal Models Membership Inference15 Sep 2022
- 2022Perfectly Accurate Membership Inference by a Dishonest Central Server in Federated Learning30 Mar 2022
- 2023FedSecurity: Benchmarking Attacks and Defenses in Federated Learning and Federated LLMscited by 19
- 2021Attribute Inference Attack of Speech Emotion Recognition in Federated Learning Settingscited by 12
- 2023FedDWA: Personalized Federated Learning with Dynamic Weight Adjustmentcited by 9
- 2022Flow: Per-Instance Personalized Federated Learning Through Dynamic Routingcited by 6
- 2023Personalized and privacy-preserving federated heterogeneous medical image analysis with PPPML-HMIcited by 6
- 2022Emerging Threats in Deep Learning-Based Autonomous Driving: A Comprehensive Surveycited by 3
- 2023On Knowledge Editing in Federated Learning: Perspectives, Challenges, and Future Directionscited by 3
- 2025Equitable Federated Learning with NCAcited by 3
- 2022Local Model Reconstruction Attacks in Federated Learning and their Usescited by 2
- 2024No Vandalism: Privacy-Preserving and Byzantine-Robust Federated Learningcited by 2
- 2024Inference Attacks: A Taxonomy, Survey, and Promising Directionscited by 2
- 2025FinP: Fairness-in-Privacy in Federated Learning by Addressing Disparities in Privacy Riskcited by 2
12 most cited of 26 All 26 (JSON)
- 2026Upholding Robustness in Federated Learning: Trends, Emerging Strategies, and Research Opportunities23 Sep 2026
- 2026Protecting patient privacy in clinical foundation models: Technical and legal perspectives7 Aug 2026
- 2026PRoVeFL: Private Robust and Verifiable Aggregation in Federated Learning7 Jul 2026
- 2026IntraShuffler: A Privacy Preserving Framework for Heterogeneous DP Federated Learning1 Jun 2026
- 2026CQSA: Byzantine-robust Clustered Quantum Secure Aggregation in Federated Learning25 Feb 2026
- 2026ERIS: Enhancing Privacy and Scalability in Federated Learning via Federated Shard Aggregation9 Feb 2026
- 2025Accurate and Private Diagnosis of Rare Genetic Syndromes from Facial Images with Federated Deep Learning12 Sep 2025
- 2025Multi-Hop Privacy Propagation for Differentially Private Federated Learning in Social Networks11 Aug 2025
- 2025Enhancing Privacy in Decentralized Min-Max Optimization: A Differentially Private Approach10 Aug 2025
- 2025Equitable Federated Learning with NCA26 Jun 2025
- 2025Evaluating Query Efficiency and Accuracy of Transfer Learning-based Model Extraction Attack in Federated Learning25 May 2025
- 2025FinP: Fairness-in-Privacy in Federated Learning by Addressing Disparities in Privacy Risk25 Feb 2025
12 newest of 26 All 26 (JSON)