Local Model Reconstruction Attacks in Federated Learning and their Uses
Not on the map. Why?
Abstract (arXiv)
In this paper, we initiate the study of local model reconstruction attacks for federated learning, where a honest-but-curious adversary eavesdrops the messages exchanged between a targeted client and the server, and then reconstructs the local/personalized model of the victim. The local model reconstruction attack allows the adversary to trigger other classical attacks in a more effective way, since the local model only depends on the client's data and can leak more private information than the global model learned by the server. Additionally, we propose a novel model-based attribute inference attack in federated learning leveraging the local model reconstruction attack. We provide an analytical lower-bound for this attribute inference attack. Empirical results using real world datasets confirm that our local reconstruction attack works well for both regression and classification tasks. Moreover, we benchmark our novel attribute inference attack against the state-of-the-art attacks in federated learning. Our attack results in higher reconstruction accuracy especially when the clients' datasets are heterogeneous. Our work provides a new angle for designing powerful and explainable attacks to effectively quantify the privacy risk in FL.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 48 of its 79 references that are in the map. First posted on arXiv 28 Oct 2022.
Builds on
48 of 79 references.
References · 48
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2019Advances and Open Problems in Federated Learningcited by 3,021
- 2018Federated Optimization in Heterogeneous Networkscited by 2,971
- 2016Deep Learning with Differential Privacycited by 2,682
- 2016Membership Inference Attacks against Machine Learning Modelscited by 2,221
- 2019On the Convergence of FedAvg on Non-IID Datacited by 1,220
- 2016The Concrete Distribution: A Continuous Relaxation of Discrete Random Variablescited by 1,135
- 2019Deep Leakage from Gradientscited by 1,004
- 2018LEAF: A Benchmark for Federated Settingscited by 780
36 more
- 2020Inverting Gradients -- How easy is it to break privacy in federated learning?cited by 707
- 2018Byzantine-Robust Distributed Learning: Towards Optimal Statistical Ratescited by 698
- 2016Stealing Machine Learning Models via Prediction APIscited by 602
- 2021FedBN: Federated Learning on Non-IID Features via Local Batch Normalizationcited by 565
- 2018Exploiting Unintended Feature Leakage in Collaborative Learningcited by 509
- 2017Can Decentralized Algorithms Outperform Centralized Algorithms? A Case Study for Decentralized Parallel Stochastic Gradient Descentcited by 496
- 2021Opacus: User-Friendly Differential Privacy Library in PyTorchcited by 375
- 2020iDLG: Improved Deep Leakage from Gradientscited by 367
- 2018Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edgecited by 347
- 2021See through Gradients: Image Batch Recovery via GradInversioncited by 320
- 2017How to Escape Saddle Points Efficientlycited by 284
- 2019Tighter Theory for Local SGD on Identical and Heterogeneous Datacited by 266
- 2018Beyond Inferring Class Representatives: User-Level Privacy Leakage From Federated Learningcited by 242
- 2018Privacy Amplification by Subsampling: Tight Analyses via Couplings and Divergencescited by 237
- 2018Subsampled R'enyi Differential Privacy and Analytical Moments Accountantcited by 234
- 2019Model Fusion via Optimal Transportcited by 217
- 2020Client Selection in Federated Learning: Convergence Analysis and Power-of-Choice Selection Strategiescited by 196
- 2021Evaluating Gradient Inversion Attacks and Defenses in Federated Learningcited by 196
- 2020Optimal Client Sampling for Federated Learningcited by 123
- 2021FedMix: Approximation of Mixup under Mean Augmented Federated Learningcited by 108
- 2021DENSE: Data-Free One-Shot Federated Learningcited by 100
- 2022Truth Serum: Poisoning Machine Learning Models to Reveal Their Secretscited by 94
- 2018On the Convergence of Adaptive Gradient Methods for Nonconvex Optimizationcited by 91
- 2019Differentially Private Model Publishing for Deep Learningcited by 69
- 2021Understanding Clipping for Federated Learning: Convergence and Client-Level Differential Privacycited by 66
- 2020A Framework for Evaluating Gradient Leakage Attacks in Federated Learningcited by 63
- 2020A High Probability Analysis of Adaptive SGD with Momentumcited by 61
- 2020FastSecAgg: Scalable Secure Aggregation for Privacy-Preserving Federated Learningcited by 60
- 2019Mixup Inference: Better Exploiting Mixup to Defend Adversarial Attackscited by 54
- 2019Differential Privacy-enabled Federated Learning for Sensitive Health Datacited by 44
- 2019Interpret Federated Learning with Shapley Valuescited by 33
- 2021Source Inference Attacks in Federated Learningcited by 31
- 2019Distributed Learning in Non-Convex Environments -- Part I: Agreement at a Linear Ratecited by 22
- 2021A Novel Attribute Reconstruction Attack in Federated Learningcited by 18
- 2021secureTF: A Secure TensorFlow Frameworkcited by 12
- 2020Oblivious Sampling Algorithms for Private Data Analysiscited by 2
Built on by
Citing papers per year: 2024: 2.
2 papers.