mlsanityData to 7 Oct 2026

Local Model Reconstruction Attacks in Federated Learning and their Uses

arXiv 2210.16205 ↗First posted 28 Oct 2022cs.LG cs.AI cs.CRcited by 2

Not on the map. Why?

Abstract (arXiv)

In this paper, we initiate the study of local model reconstruction attacks for federated learning, where a honest-but-curious adversary eavesdrops the messages exchanged between a targeted client and the server, and then reconstructs the local/personalized model of the victim. The local model reconstruction attack allows the adversary to trigger other classical attacks in a more effective way, since the local model only depends on the client's data and can leak more private information than the global model learned by the server. Additionally, we propose a novel model-based attribute inference attack in federated learning leveraging the local model reconstruction attack. We provide an analytical lower-bound for this attribute inference attack. Empirical results using real world datasets confirm that our local reconstruction attack works well for both regression and classification tasks. Moreover, we benchmark our novel attribute inference attack against the state-of-the-art attacks in federated learning. Our attack results in higher reconstruction accuracy especially when the clients' datasets are heterogeneous. Our work provides a new angle for designing powerful and explainable attacks to effectively quantify the privacy risk in FL.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 48 of its 79 references that are in the map. First posted on arXiv 28 Oct 2022.

Builds on

48 of 79 references.

References · 48

  1. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
  2. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  3. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
  4. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  5. 2019Advances and Open Problems in Federated Learningcited by 3,021
  6. 2018Federated Optimization in Heterogeneous Networkscited by 2,971
  7. 2016Deep Learning with Differential Privacycited by 2,682
  8. 2016Membership Inference Attacks against Machine Learning Modelscited by 2,221
  9. 2019On the Convergence of FedAvg on Non-IID Datacited by 1,220
  10. 2016The Concrete Distribution: A Continuous Relaxation of Discrete Random Variablescited by 1,135
  11. 2019Deep Leakage from Gradientscited by 1,004
  12. 2018LEAF: A Benchmark for Federated Settingscited by 780
36 more
  1. 2020Inverting Gradients -- How easy is it to break privacy in federated learning?cited by 707
  2. 2018Byzantine-Robust Distributed Learning: Towards Optimal Statistical Ratescited by 698
  3. 2016Stealing Machine Learning Models via Prediction APIscited by 602
  4. 2021FedBN: Federated Learning on Non-IID Features via Local Batch Normalizationcited by 565
  5. 2018Exploiting Unintended Feature Leakage in Collaborative Learningcited by 509
  6. 2017Can Decentralized Algorithms Outperform Centralized Algorithms? A Case Study for Decentralized Parallel Stochastic Gradient Descentcited by 496
  7. 2021Opacus: User-Friendly Differential Privacy Library in PyTorchcited by 375
  8. 2020iDLG: Improved Deep Leakage from Gradientscited by 367
  9. 2018Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edgecited by 347
  10. 2021See through Gradients: Image Batch Recovery via GradInversioncited by 320
  11. 2017How to Escape Saddle Points Efficientlycited by 284
  12. 2019Tighter Theory for Local SGD on Identical and Heterogeneous Datacited by 266
  13. 2018Beyond Inferring Class Representatives: User-Level Privacy Leakage From Federated Learningcited by 242
  14. 2018Privacy Amplification by Subsampling: Tight Analyses via Couplings and Divergencescited by 237
  15. 2018Subsampled R'enyi Differential Privacy and Analytical Moments Accountantcited by 234
  16. 2019Model Fusion via Optimal Transportcited by 217
  17. 2020Client Selection in Federated Learning: Convergence Analysis and Power-of-Choice Selection Strategiescited by 196
  18. 2021Evaluating Gradient Inversion Attacks and Defenses in Federated Learningcited by 196
  19. 2020Optimal Client Sampling for Federated Learningcited by 123
  20. 2021FedMix: Approximation of Mixup under Mean Augmented Federated Learningcited by 108
  21. 2021DENSE: Data-Free One-Shot Federated Learningcited by 100
  22. 2022Truth Serum: Poisoning Machine Learning Models to Reveal Their Secretscited by 94
  23. 2018On the Convergence of Adaptive Gradient Methods for Nonconvex Optimizationcited by 91
  24. 2019Differentially Private Model Publishing for Deep Learningcited by 69
  25. 2021Understanding Clipping for Federated Learning: Convergence and Client-Level Differential Privacycited by 66
  26. 2020A Framework for Evaluating Gradient Leakage Attacks in Federated Learningcited by 63
  27. 2020A High Probability Analysis of Adaptive SGD with Momentumcited by 61
  28. 2020FastSecAgg: Scalable Secure Aggregation for Privacy-Preserving Federated Learningcited by 60
  29. 2019Mixup Inference: Better Exploiting Mixup to Defend Adversarial Attackscited by 54
  30. 2019Differential Privacy-enabled Federated Learning for Sensitive Health Datacited by 44
  31. 2019Interpret Federated Learning with Shapley Valuescited by 33
  32. 2021Source Inference Attacks in Federated Learningcited by 31
  33. 2019Distributed Learning in Non-Convex Environments -- Part I: Agreement at a Linear Ratecited by 22
  34. 2021A Novel Attribute Reconstruction Attack in Federated Learningcited by 18
  35. 2021secureTF: A Secure TensorFlow Frameworkcited by 12
  36. 2020Oblivious Sampling Algorithms for Private Data Analysiscited by 2

Built on by

Cited by year

Citing papers per year: 2024: 2.

2 papers.