mlsanityData to 14 Oct 2026

Mitigating Privacy-Utility Trade-off in Decentralized Federated Learning via f-Differential Privacy

arXiv 2510.19934 ↗First posted 22 Oct 2025cs.LG cs.CR math.STcited by 3

Not on the map. Why?

Abstract (arXiv)

Differentially private (DP) decentralized Federated Learning (FL) allows local users to collaborate without sharing their data with a central server. However, accurately quantifying the privacy budget of private FL algorithms is challenging due to the co-existence of complex algorithmic components such as decentralized communication and local updates. This paper addresses privacy accounting for two decentralized FL algorithms within the f-differential privacy (f-DP) framework. We develop two new f-DP-based accounting methods tailored to decentralized settings: Pairwise Network f-DP (PN-f-DP), which quantifies privacy leakage between user pairs under random-walk communication, and Secret-based f-Local DP (Sec-f-LDP), which supports structured noise injection via shared secrets. By combining tools from f-DP theory and Markov chain concentration, our accounting framework captures privacy amplification arising from sparse communication, local iterations, and correlated noise. Experiments on synthetic and real datasets demonstrate that our methods yield consistently tighter (ε,δ) bounds and improved utility compared to R'enyi DP-based approaches, illustrating the benefits of f-DP in decentralized privacy accounting.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 48 of its 72 references that are in the map. First posted on arXiv 22 Oct 2025.

Builds on

48 of 72 references.

References · 48

  1. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  2. 2019Advances and Open Problems in Federated Learningcited by 3,046
  3. 2016Deep Learning with Differential Privacycited by 2,728
  4. 2016Membership Inference Attacks against Machine Learning Modelscited by 2,281
  5. 2019On the Convergence of FedAvg on Non-IID Datacited by 1,229
  6. 2020Inverting Gradients -- How easy is it to break privacy in federated learning?cited by 712
  7. 2017Renyi Differential Privacycited by 650
  8. 2017Can Decentralized Algorithms Outperform Centralized Algorithms? A Case Study for Decentralized Parallel Stochastic Gradient Descentcited by 502
  9. 2016Concentrated Differential Privacy: Simplifications, Extensions, and Lower Boundscited by 346
  10. 2013The Composition Theorem for Differential Privacycited by 297
  11. 2021Enhanced Membership Inference Attacks against Machine Learning Modelscited by 248
  12. 2018Privacy Amplification by Subsampling: Tight Analyses via Couplings and Divergencescited by 242
36 more
  1. 2018Subsampled R'enyi Differential Privacy and Analytical Moments Accountantcited by 236
  2. 2019Decentralized Stochastic Optimization and Gossip Algorithms with Compressed Communicationcited by 221
  3. 2021Numerical Composition of Differential Privacycited by 180
  4. 2013On the Convergence of Decentralized Gradient Descentcited by 159
  5. 2018D2: Decentralized Training over Decentralized Datacited by 140
  6. 2018Distributed Differential Privacy via Shufflingcited by 115
  7. 2018Privacy Amplification by Iterationcited by 100
  8. 2020Hiding Among the Clones: A Simple and Nearly Optimal Analysis of Privacy Amplification by Shufflingcited by 96
  9. 2021Optimal Accounting of Differential Privacy via Characteristic Functioncited by 86
  10. 2019Hypothesis Testing Interpretations and Renyi Differential Privacycited by 85
  11. 2021Learning with User-Level Privacycited by 72
  12. 2019MATCHA: Speeding Up Decentralized SGD via Matching Decomposition Samplingcited by 67
  13. 2022Privacy of Noisy Stochastic Gradient Descent: More Iterations without More Privacy Losscited by 61
  14. 2022Differentially Private Learning Needs Hidden State (Or Much Faster Convergence)cited by 48
  15. 2017Communication-Efficient Algorithms for Decentralized and Stochastic Optimizationcited by 43
  16. 2023Stochastic Gradient Descent under Markovian Sampling Schemescited by 38
  17. 2018Walkman: A Communication-Efficient Random-Walk Algorithm for Decentralized Optimizationcited by 31
  18. 2021Federated f-Differential Privacycited by 29
  19. 2022Stronger Privacy Amplification by Shuffling for R'enyi and Approximate Differential Privacycited by 29
  20. 2020Privacy Amplification by Decentralizationcited by 28
  21. 2022Muffliato: Peer-to-Peer Privacy Amplification for Decentralized Optimization and Averagingcited by 27
  22. 2020Three Variants of Differential Privacy: Lossless Conversion and Applicationscited by 26
  23. 2022On the (In)security of Peer-to-Peer Decentralized Machine Learningcited by 23
  24. 2020An Accurate, Scalable and Verifiable Protocol for Federated Differentially Private Averagingcited by 20
  25. 2018Empirical Risk Minimization in Non-interactive Local Differential Privacy: Efficiency and High Dimensional Casecited by 19
  26. 2024The Privacy Power of Correlated Noise in Decentralized Learningcited by 18
  27. 2021Minimax Estimation for Personalized Federated Learning: An Alternative between FedAvg and Local Training?cited by 15
  28. 2023Unified Enhancement of Privacy Bounds for Mixture Mechanisms via f-Differential Privacycited by 13
  29. 2024Shifted Interpolation for Differential Privacycited by 13
  30. 2024Differentially Private Decentralized Learning with Random Walkscited by 8
  31. 2024Neural Collapse Meets Differential Privacy: Curious Behaviors of NoisyGD with Near-perfect Representation Learningcited by 8
  32. 2021A Central Limit Theorem for Differentially Private Query Answeringcited by 7
  33. 2023Optimal Locally Private Nonparametric Classification with Public Datacited by 7
  34. 2022Network Shuffling: Privacy Amplification via Random Walkscited by 6
  35. 2024Correlated Privacy Mechanisms for Differentially Private Distributed Mean Estimationcited by 4
  36. 2024The 2020 US Decennial Census is more private than you (might) thinkcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.