PackVFL: Efficient HE Packing for Vertical Federated Learning
Not on the map. Why?
Abstract (arXiv)
As an essential tool of secure distributed machine learning, vertical federated learning (VFL) based on homomorphic encryption (HE) suffers from severe efficiency problems due to data inflation and time-consuming operations. To this core, we propose PackVFL, an efficient VFL framework based on packed HE (PackedHE), to accelerate the existing HE-based VFL algorithms. PackVFL packs multiple cleartexts into one ciphertext and supports single-instruction-multiple-data (SIMD)-style parallelism. We focus on designing a high-performant matrix multiplication (MatMult) method since it takes up most of the ciphertext computation time in HE-based VFL. Besides, devising the MatMult method is also challenging for PackedHE because a slight difference in the packing way could predominantly affect its computation and communication costs. Without domain-specific design, directly applying SOTA MatMult methods is hard to achieve optimal. Therefore, we make a three-fold design: 1) we systematically explore the current design space of MatMult and quantify the complexity of existing approaches to provide guidance; 2) we propose a hybrid MatMult method according to the unique characteristics of VFL; 3) we adaptively apply our hybrid method in representative VFL algorithms, leveraging distinctive algorithmic properties to further improve efficiency. As the batch size, feature dimension and model size of VFL scale up to large sizes, PackVFL consistently delivers enhanced performance. Empirically, PackVFL propels existing VFL algorithms to new heights, achieving up to a 51.52X end-to-end speedup. This represents a substantial 34.51X greater speedup compared to the direct application of SOTA MatMult methods.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 29 of its 77 references that are in the map. First posted on arXiv 1 May 2024.
Builds on
29 of 77 references.
References · 29
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2019Advances and Open Problems in Federated Learningcited by 3,021
- 2016On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minimacited by 1,337
- 2019Deep Leakage from Gradientscited by 1,004
- 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 837
- 2018LEAF: A Benchmark for Federated Settingscited by 780
- 2018Certified Robustness to Adversarial Examples with Differential Privacycited by 462
- 2018Split learning for health: Distributed deep learning without sharing raw patient datacited by 391
- 2017Train longer, generalize better: closing the generalization gap in large batch training of neural networkscited by 278
- 2018Gazelle: A Low Latency Framework for Secure Neural Network Inferencecited by 193
- 2019SecureBoost: A Lossless Federated Learning Frameworkcited by 174
17 more
- 2017A Survey on Homomorphic Encryption Schemes: Theory and Implementationcited by 154
- 2021TenSEAL: A Library for Encrypted Tensor Operations Using Homomorphic Encryptioncited by 51
- 2019A Quasi-Newton Method Based Vertical Federated Learning Framework for Logistic Regressioncited by 37
- 2022BlindFL: Vertical Federated Machine Learning without Peeking into Your Datacited by 36
- 2020When Homomorphic Encryption Marries Secret Sharing: Secure Large-Scale Sparse Logistic Regression and Applications in Risk Controlcited by 32
- 2023A Survey on Vertical Federated Learning: From a Layered Perspectivecited by 30
- 2020Extrapolation for Large-batch Training in Deep Learningcited by 25
- 2021F1: A Fast and Programmable Accelerator for Fully Homomorphic Encryption (Extended Version)cited by 23
- 2019EVA: An Encrypted Vector Arithmetic Language and Compiler for Efficient Homomorphic Computationcited by 20
- 2020Additively Homomorphical Encryption based Deep Neural Network for Asymmetrically Collaborative Machine Learningcited by 19
- 2021FLASHE: Additively Symmetric Homomorphic Encryption for Cross-Silo Federated Learningcited by 15
- 2021GALA: Greedy ComputAtion for Linear Algebra in Privacy-Preserved Neural Networkscited by 10
- 2019Achieving Differential Privacy in Vertically Partitioned Multiparty Learningcited by 8
- 2022Secure Forward Aggregation for Vertical Federated Neural Networkscited by 6
- 2021Artificial intelligence across company borderscited by 5
- 2022EFMVFL: An Efficient and Flexible Multi-party Vertical Federated Learning without a Third Partycited by 5
- 2023XFL: A High Performace, Lightweighted Federated Learning Frameworkcited by 2
Built on by
Citing papers per year: 2025: 1.
1 paper.