Topology-Aware Differential Privacy in Hierarchical Federated Learning
Not on the map. Why?
Abstract (arXiv)
Hierarchical federated learning places regional aggregators between clients and the cloud, so a participant's update is observed only alongside its neighbours'. The concealment this arrangement provides depends on the size of the aggregation region, and regions in operational deployments vary widely. Prevailing practice applies a single noise multiplier to every participant, calibrated for the most exposed region, so every other participant carries more noise than its own exposure requires. We show that this allocation problem admits an explicit solution. We first give a silo-level differential privacy guarantee for the mechanism, then bound the mutual information between a participant's local class distribution and any estimate an observer positioned above the regional tier could form of it, using an adjacency notion matched to the quantity being protected. Minimising the worst-case bound under a fixed utility budget yields a min-max optimal allocation, which we call Fulcrum. The budget it recovers has a closed form we term the exposure dispersion, a measure of how unevenly aggregation weight is concentrated within regions relative to the most exposed one. Because this quantity follows from the region structure and the aggregation weights alone, a practitioner can evaluate it before training begins, and it vanishes precisely when all regions are equally exposed. On image and text classification at varepsilon = 0.99, accuracy at a matched worst-case per-client guarantee improves by up to 14.84 and 12.16 percentage points where the dispersion is large, and is exactly zero on a balanced control for which the theory predicts parity.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 44 references that are in the map. First posted on arXiv 24 Jun 2025.
Builds on
27 of 44 references.
References · 27
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
- 2019Advances and Open Problems in Federated Learningcited by 3,046
- 2016Deep Learning with Differential Privacycited by 2,728
- 2021Convex optimizationcited by 2,515
- 2015Character-level Convolutional Networks for Text Classificationcited by 2,330
- 2016Membership Inference Attacks against Machine Learning Modelscited by 2,281
- 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,463
- 2020Inverting Gradients -- How easy is it to break privacy in federated learning?cited by 712
- 2017Renyi Differential Privacycited by 650
- 2018Federated Learning for Mobile Keyboard Predictioncited by 572
15 more
- 2019Federated Learning with Differential Privacy: Algorithms and Performance Analysiscited by 536
- 2018Exploiting Unintended Feature Leakage in Collaborative Learningcited by 520
- 2021Opacus: User-Friendly Differential Privacy Library in PyTorchcited by 383
- 2018Subsampled R'enyi Differential Privacy and Analytical Moments Accountantcited by 236
- 2020Federated learning with hierarchical clustering of local updates to improve training on non-IID datacited by 223
- 2019Client-Edge-Cloud Hierarchical Federated Learningcited by 202
- 2020The Discrete Gaussian for Differential Privacycited by 135
- 2022FLamby: Datasets and Benchmarks for Cross-Silo Federated Learning in Realistic Healthcare Settingscited by 125
- 2019Hierarchical Federated Learning Across Heterogeneous Cellular Networkscited by 98
- 2016Differential Privacy as a Mutual Information Constraintcited by 45
- 2020Privacy Amplification by Decentralizationcited by 28
- 2022Muffliato: Peer-to-Peer Privacy Amplification for Decentralized Optimization and Averagingcited by 27
- 2023Have it your way: Individualized Privacy Assignment for DP-SGDcited by 21
- 2015Understanding Mobile Traffic Patterns of Large Scale Cellular Towers in Urban Environmentcited by 18
- 2022Hierarchical Federated Learning with Privacycited by 4
Built on by
Not cited yet.