mlsanityData to 14 Oct 2026

Dropout-Robust Mechanisms for Differentially Private and Fully Decentralized Mean Estimation

arXiv 2506.03746 ↗First posted 4 Jun 2025cs.CR cs.DC cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Achieving differentially private computations in decentralized settings poses significant challenges, particularly regarding accuracy, communication cost, and robustness against information leakage. While cryptographic solutions offer promise, they often suffer from high communication overhead or require centralization in the presence of network failures. Conversely, existing fully decentralized approaches typically rely on relaxed adversarial models or pairwise noise cancellation, the latter suffering from substantial accuracy degradation if parties unexpectedly disconnect. In this work, we propose IncA, a new protocol for fully decentralized mean estimation, a widely used primitive in data-intensive processing. Our protocol, which enforces differential privacy, requires no central orchestration and employs low-variance correlated noise, achieved by incrementally injecting sensitive information into the computation. First, we theoretically demonstrate that, when no parties permanently disconnect, our protocol achieves accuracy comparable to that of a centralized setting-already an improvement over most existing decentralized differentially private techniques. Second, we empirically show that our use of low-variance correlated noise significantly mitigates the accuracy loss experienced by existing techniques in the presence of dropouts.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 72 references that are in the map. First posted on arXiv 4 Jun 2025.

Builds on

29 of 72 references.

References · 29

  1. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  2. 2020Inverting Gradients -- How easy is it to break privacy in federated learning?cited by 712
  3. 2017Renyi Differential Privacycited by 650
  4. 2018Exploiting Unintended Feature Leakage in Collaborative Learningcited by 520
  5. 2014RAPPOR: Randomized Aggregatable Privacy-Preserving Ordinal Responsecited by 272
  6. 2021The Distributed Discrete Gaussian Mechanism for Federated Learning with Secure Aggregationcited by 128
  7. 2018Distributed Differential Privacy via Shufflingcited by 115
  8. 2020Turbo-Aggregate: Breaking the Quadratic Aggregation Barrier in Secure Federated Learningcited by 78
  9. 2018Slow and Stale Gradients Can Win the Race: Error-Runtime Trade-offs in Distributed SGDcited by 68
  10. 2020Breaking the Communication-Privacy-Accuracy Trilemmacited by 68
  11. 2021The Skellam Mechanism for Differentially Private Federated Learningcited by 68
  12. 2019MATCHA: Speeding Up Decentralized SGD via Matching Decomposition Samplingcited by 67
17 more
  1. 2016Discrete Distribution Estimation under Local Privacycited by 59
  2. 2020Private Summation in the Multi-Message Shuffle Modelcited by 34
  3. 2019ABIDES: Towards High-Fidelity Market Simulation for AI Researchcited by 32
  4. 2022Muffliato: Peer-to-Peer Privacy Amplification for Decentralized Optimization and Averagingcited by 27
  5. 2013Local Privacy, Data Processing Inequalities, and Statistical Minimax Ratescited by 26
  6. 2022On the (In)security of Peer-to-Peer Decentralized Machine Learningcited by 23
  7. 2020An Accurate, Scalable and Verifiable Protocol for Federated Differentially Private Averagingcited by 20
  8. 2015Model Accuracy and Runtime Tradeoff in Distributed Deep Learning:A Systematic Studycited by 19
  9. 2024The Privacy Power of Correlated Noise in Decentralized Learningcited by 18
  10. 2021Private Counting from Anonymous Messages: Near-Optimal Accuracy with Vanishing Communication Overheadcited by 16
  11. 2018Accelerated Gossip in Networks of Given Dimension using Jacobi Polynomial Iterationscited by 15
  12. 2024Privacy Attacks in Decentralized Learningcited by 8
  13. 2024Differentially private and decentralized randomized power methodcited by 6
  14. 2024Correlated Privacy Mechanisms for Differentially Private Distributed Mean Estimationcited by 4
  15. 2019Distributed Differentially Private Computation of Functions with Correlated Noisecited by 3
  16. 2025Differentially Private Empirical Cumulative Distribution Functionscited by 2
  17. 2024On Using Secure Aggregation in Differentially Private Federated Learning with Multiple Local Stepscited by 1

Built on by

Not cited yet.