Distributed Differential Privacy via Shuffling
Not on the map. Why?
Abstract (arXiv)
We consider the problem of designing scalable, robust protocols for computing statistics about sensitive data. Specifically, we look at how best to design differentially private protocols in a distributed setting, where each user holds a private datum. The literature has mostly considered two models: the "central" model, in which a trusted server collects users' data in the clear, which allows greater accuracy; and the "local" model, in which users individually randomize their data, and need not trust the server, but accuracy is limited. Attempts to achieve the accuracy of the central model without a trusted server have so far focused on variants of cryptographic MPC, which limits scalability. In this paper, we initiate the analytic study of a shuffled model for distributed differentially private algorithms, which lies between the local and central models. This simple-to-implement model, a special case of the ESA framework of [Bittau et al., '17], augments the local model with an anonymous channel that randomly permutes a set of user-supplied messages. For sum queries, we show that this model provides the power of the central model while avoiding the need to trust a central server and the complexity of cryptographic secure function evaluation. More generally, we give evidence that the power of the shuffled model lies strictly between those of the central and local models: for a natural restriction of the model, we show that shuffled protocols for a widely studied selection problem require exponentially higher sample complexity than do central-model protocols.
Key facts. Cited by 115 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Aug 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 30; 2022: 30; 2023: 18; 2024: 13; 2025: 11; 2026: 13.
115 papers.
Sort:
- 2021The Distributed Discrete Gaussian Mechanism for Federated Learning with Secure Aggregationcited by 127
- 2021Deep Learning with Label Differential Privacycited by 113
- 2023Foundation Models and Fair Usecited by 112
- 2021Label Leakage and Protection in Two-party Split Learningcited by 87
- 2021Differentially Private Federated Learning on Heterogeneous Datacited by 74
- 2021On Large-Cohort Training for Federated Learningcited by 73
- 2022Composition of Differential Privacy & Privacy Amplification by Subsamplingcited by 42
- 2022Optimal Algorithms for Mean Estimation under Local Differential Privacycited by 36
- 2022On Privacy and Personalization in Cross-Silo Federated Learningcited by 36
- 2022SoteriaFL: A Unified Framework for Private Federated Learning with Communication Compressioncited by 34
- 2021Differentially Private Federated Bayesian Optimization with Distributed Explorationcited by 32
- 2021Private Federated Learning Without a Trusted Server: Optimal Algorithms for Convex Lossescited by 30
38 more
- 2022Stronger Privacy Amplification by Shuffling for R'enyi and Approximate Differential Privacycited by 29
- 2021Lossless Compression of Efficient Private Local Randomizerscited by 27
- 2022Shuffle Private Linear Contextual Banditscited by 27
- 2022Muffliato: Peer-to-Peer Privacy Amplification for Decentralized Optimization and Averagingcited by 27
- 2022Label Leakage and Protection from Forward Embedding in Vertical Federated Learningcited by 26
- 2022Private Non-Convex Federated Learning Without a Trusted Servercited by 26
- 2021Differentially Private Multi-Armed Bandits in the Shuffle Modelcited by 24
- 2021Efficient Differentially Private Secure Aggregation for Federated Learning via Hardness of Learning with Errorscited by 23
- 2022Differentially Private Reinforcement Learning with Linear Function Approximationcited by 22
- 2023Privacy Amplification via Compression: Achieving the Optimal Privacy-Accuracy-Communication Trade-off in Distributed Mean Estimationcited by 22
- 2021Defending against Reconstruction Attack in Vertical Federated Learningcited by 20
- 2021Label differential privacy via clusteringcited by 20
- 2023Differentially Private Natural Language Models: Recent Advances and Future Directionscited by 20
- 2021Locally Private k-Means in One Roundcited by 19
- 2022Differentially Private Stochastic Linear Bandits: (Almost) for Freecited by 19
- 2021Shuffle Private Stochastic Convex Optimizationcited by 17
- 2021Privacy Amplification via Shuffling for Linear Contextual Banditscited by 17
- 2022Discrete Distribution Estimation under User-level Local Differential Privacycited by 17
- 2024The Privacy Power of Correlated Noise in Decentralized Learningcited by 17
- 2021On the Renyi Differential Privacy of the Shuffle Modelcited by 16
- 2022Distributed Differential Privacy in Multi-Armed Banditscited by 14
- 2023On Differentially Private Federated Linear Contextual Banditscited by 14
- 2023Fast Optimal Locally Private Mean Estimation via Random Projectionscited by 14
- 2023Unified Enhancement of Privacy Bounds for Mixture Mechanisms via f-Differential Privacycited by 13
- 2025Privacy amplification by random allocationcited by 13
- 2021Differentially Private Exploration in Reinforcement Learning with Linear Representationcited by 11
- 2021Towards Sparse Federated Analytics: Location Heatmaps under Distributed Differential Privacy with Secure Aggregationcited by 10
- 2023Simple Binary Hypothesis Testing under Local Differential Privacy and Communication Constraintscited by 10
- 2021User-Level Private Learning via Correlated Samplingcited by 9
- 2022Private Frequency Estimation via Projective Geometrycited by 9
- 2023ULDP-FL: Federated Learning with Across Silo User-Level Differential Privacycited by 9
- 2022Differentially Private Linear Bandits with Partial Distributed Feedbackcited by 8
- 2024Differentially Private Decentralized Learning with Random Walkscited by 8
- 2025Towards Trustworthy Federated Learning with Untrusted Participantscited by 8
- 2022DPAUC: Differentially Private AUC Computation in Federated Learningcited by 7
- 2022Skellam Mixture Mechanism: a Novel Approach to Federated Learning with Differential Privacycited by 7
- 2021Renyi Differential Privacy of the Subsampled Shuffle Model in Distributed Learningcited by 6
- 2022Differential Privacy Amplification in Quantum and Quantum-inspired Algorithmscited by 6
50 most cited of 115 All 115 (JSON)
- 2026Predictability as a Fine-Grained Measure for Privacy18 Jun 2026
- 2026Cross-Silo De-Anonymization Under Local Differential Privacy: Threat Model, Phase Transition, and Coordination Necessity15 Jun 2026
- 2026IntraShuffler: A Privacy Preserving Framework for Heterogeneous DP Federated Learning1 Jun 2026
- 2026Randomized Least Squares Value Iteration itself is Joint Differentially Private1 Jun 2026
- 2026Jacobian-Guided Anisotropic Noise Reshaping for Enhancing Representation Utility under Local Differential Privacy16 May 2026
- 2026Shuffling-Aware Optimization for Private Vector Mean Estimation30 Apr 2026
- 2026Combinatorial Privacy: Private Multi-Party Bitstream Grand Sum by Hiding in Birkhoff Polytopes24 Mar 2026
- 2026PrivacyBench: Privacy Isn't Free in Hybrid Privacy-Preserving Vision Systems21 Feb 2026
- 2026PenTiDef: Decentralized Federated Intrusion Detection System with Differential Privacy and Latent-Space Defense via Blockchain Coordination in IIoT20 Feb 2026
- 2026Efficient privacy loss accounting for subsampling and random allocation19 Feb 2026
- 2026On the Inherent Privacy Amplification of Missing Data2 Feb 2026
- 2026RPWithPrior: Label Differential Privacy in Regression30 Jan 2026
38 more
- 2026Balancing Security and Privacy: The Pivotal Role of AI in Modern Healthcare Systems22 Jan 2026
- 2025Mitigating Privacy-Utility Trade-off in Decentralized Federated Learning via f-Differential Privacy22 Oct 2025
- 2025Differentially Private Wasserstein Barycenters3 Oct 2025
- 2025Federated Learning of Quantile Inference under Local Differential Privacy26 Sep 2025
- 2025Practical and Private Hybrid ML Inference with Fully Homomorphic Encryption1 Sep 2025
- 2025How to Securely Shuffle? A survey about Secure Shufflers for privacy-preserving computations2 Jul 2025
- 2025Dropout-Robust Mechanisms for Differentially Private and Fully Decentralized Mean Estimation4 Jun 2025
- 2025Towards Trustworthy Federated Learning with Untrusted Participants3 May 2025
- 2025PAUSE: Low-Latency and Privacy-Aware Active User Selection for Federated Learning17 Mar 2025
- 2025Learning from End User Data with Shuffled Differential Privacy over Kernel Densities19 Feb 2025
- 2025Privacy amplification by random allocation12 Feb 2025
- 2025Optimal Survey Design for Private Mean Estimation30 Jan 2025
- 2024Review of Mathematical Optimization in Federated Learning2 Dec 2024
- 2024Distributed Differentially Private Data Analytics via Secure Sketching30 Nov 2024
- 2024Near-Optimal Reinforcement Learning with Shuffle Differential Privacy18 Nov 2024
- 2024To Shuffle or not to Shuffle: Auditing DP-SGD with Shuffling15 Nov 2024
- 2024Differential Privacy on Trust Graphs15 Oct 2024
- 2024Training on Fake Labels: Mitigating Label Leakage in Split Learning via Secure Dimension Transformation11 Oct 2024
- 2024Differentially Private Block-wise Gradient Shuffle for Deep Learning31 Jul 2024
- 2024Weights Shuffling for Improving DPSGD in Transformer-based Models22 Jul 2024
- 2024Correlated Privacy Mechanisms for Differentially Private Distributed Mean Estimation3 Jul 2024
- 2024Beyond Statistical Estimation: Differentially Private Individual Computation via Shuffling26 Jun 2024
- 2024The Privacy Power of Correlated Noise in Decentralized Learning2 May 2024
- 2024Private Vector Mean Estimation in the Shuffle Model: Optimal Rates Require Many Messages16 Apr 2024
- 2024Differentially Private Decentralized Learning with Random Walks12 Feb 2024
- 2023Balancing Privacy, Robustness, and Efficiency in Machine Learning22 Dec 2023
- 2023Privacy Amplification by Iteration for ADMM with (Strongly) Convex Objective Functions14 Dec 2023
- 2023Toward the Tradeoffs between Privacy, Fairness and Utility in Federated Learning30 Nov 2023
- 2023Unified Enhancement of Privacy Bounds for Mixture Mechanisms via f-Differential Privacy30 Oct 2023
- 2023Differentially Private Multi-Site Treatment Effect Estimation10 Oct 2023
- 2023ULDP-FL: Federated Learning with Across Silo User-Level Differential Privacy23 Aug 2023
- 2023Samplable Anonymous Aggregation for Private Federated Data Analysis27 Jul 2023
- 2023Differentially Private Heavy Hitter Detection using Federated Analytics21 Jul 2023
- 2023Fast Optimal Locally Private Mean Estimation via Random Projections7 Jun 2023
- 2023When approximate design for fast homomorphic computation provides differential privacy guarantees6 Apr 2023
- 2023Privacy Amplification via Compression: Achieving the Optimal Privacy-Accuracy-Communication Trade-off in Distributed Mean Estimation4 Apr 2023
- 2023Foundation Models and Fair Use28 Mar 2023
- 2023On Differentially Private Federated Linear Contextual Bandits27 Feb 2023
50 newest of 115 All 115 (JSON)
- 2021The Distributed Discrete Gaussian Mechanism for Federated Learning with Secure Aggregationcited by 127
- 2021Deep Learning with Label Differential Privacycited by 113
- 2023Foundation Models and Fair Usecited by 112
- 2021Label Leakage and Protection in Two-party Split Learningcited by 87
- 2021Differentially Private Federated Learning on Heterogeneous Datacited by 74
- 2021On Large-Cohort Training for Federated Learningcited by 73
- 2022Composition of Differential Privacy & Privacy Amplification by Subsamplingcited by 42
- 2022Optimal Algorithms for Mean Estimation under Local Differential Privacycited by 36
- 2022On Privacy and Personalization in Cross-Silo Federated Learningcited by 36
- 2022SoteriaFL: A Unified Framework for Private Federated Learning with Communication Compressioncited by 34
- 2021Differentially Private Federated Bayesian Optimization with Distributed Explorationcited by 32
- 2021Private Federated Learning Without a Trusted Server: Optimal Algorithms for Convex Lossescited by 30
12 most cited of 115 All 115 (JSON)
- 2026Predictability as a Fine-Grained Measure for Privacy18 Jun 2026
- 2026Cross-Silo De-Anonymization Under Local Differential Privacy: Threat Model, Phase Transition, and Coordination Necessity15 Jun 2026
- 2026IntraShuffler: A Privacy Preserving Framework for Heterogeneous DP Federated Learning1 Jun 2026
- 2026Randomized Least Squares Value Iteration itself is Joint Differentially Private1 Jun 2026
- 2026Jacobian-Guided Anisotropic Noise Reshaping for Enhancing Representation Utility under Local Differential Privacy16 May 2026
- 2026Shuffling-Aware Optimization for Private Vector Mean Estimation30 Apr 2026
- 2026Combinatorial Privacy: Private Multi-Party Bitstream Grand Sum by Hiding in Birkhoff Polytopes24 Mar 2026
- 2026PrivacyBench: Privacy Isn't Free in Hybrid Privacy-Preserving Vision Systems21 Feb 2026
- 2026PenTiDef: Decentralized Federated Intrusion Detection System with Differential Privacy and Latent-Space Defense via Blockchain Coordination in IIoT20 Feb 2026
- 2026Efficient privacy loss accounting for subsampling and random allocation19 Feb 2026
- 2026On the Inherent Privacy Amplification of Missing Data2 Feb 2026
- 2026RPWithPrior: Label Differential Privacy in Regression30 Jan 2026
12 newest of 115 All 115 (JSON)