Federated Learning is Better with Non-Homomorphic Encryption
Not on the map. Why?
Abstract (arXiv)
Traditional AI methodologies necessitate centralized data collection, which becomes impractical when facing problems with network communication, data privacy, or storage capacity. Federated Learning (FL) offers a paradigm that empowers distributed AI model training without collecting raw data. There are different choices for providing privacy during FL training. One of the popular methodologies is employing Homomorphic Encryption (HE) - a breakthrough in privacy-preserving computation from Cryptography. However, these methods have a price in the form of extra computation and memory footprint. To resolve these issues, we propose an innovative framework that synergizes permutation-based compressors with Classical Cryptography, even though employing Classical Cryptography was assumed to be impossible in the past in the context of FL. Our framework offers a way to replace HE with cheaper Classical Cryptography primitives which provides security for the training process. It fosters asynchronous communication and provides flexible deployment options in various communication topologies.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 18 of its 71 references that are in the map. First posted on arXiv 4 Dec 2023.
Builds on
18 of 71 references.
References · 18
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2014One weird trick for parallelizing convolutional neural networkscited by 264
- 2018The Convergence of Sparsified Gradient Methodscited by 228
- 2017Gradient Sparsification for Communication-Efficient Distributed Optimizationcited by 199
- 2018Beyond Data and Model Parallelism for Deep Neural Networkscited by 177
- 2020Understanding Gradient Clipping in Private SGD: A Geometric Perspectivecited by 140
- 2021EF21: A New, Simpler, Theoretically Better, and Practically Faster Error Feedbackcited by 131
- 2018Protection Against Reconstruction and Its Applications in Private Federated Learningcited by 127
- 2021MARINA: Faster Non-Convex Distributed Learning with Compressioncited by 77
- 2018Distributed learning with compressed gradientscited by 53
- 2021TenSEAL: A Library for Encrypted Tensor Operations Using Homomorphic Encryptioncited by 51
6 more
- 2022On Privacy and Personalization in Cross-Silo Federated Learningcited by 36
- 2021Permutation Compressors for Provably Faster Distributed Nonconvex Optimizationcited by 32
- 2021FLASHE: Additively Symmetric Homomorphic Encryption for Cross-Silo Federated Learningcited by 15
- 2021Faster Rates for Compressed Federated Learning with Client-Variance Reductioncited by 14
- 2018Linear Program Reconstruction in Practicecited by 12
- 2022FL_PyTorch: optimization research simulator for federated learningcited by 10
Built on by
Citing papers per year: 2024: 1; 2025: 1.
2 papers.