Flexible Vertical Federated Learning with Heterogeneous Parties
Not on the map. Why?
Abstract (arXiv)
We propose Flexible Vertical Federated Learning (Flex-VFL), a distributed machine algorithm that trains a smooth, non-convex function in a distributed system with vertically partitioned data. We consider a system with several parties that wish to collaboratively learn a global function. Each party holds a local dataset; the datasets have different features but share the same sample ID space. The parties are heterogeneous in nature: the parties' operating speeds, local model architectures, and optimizers may be different from one another and, further, they may change over time. To train a global model in such a system, Flex-VFL utilizes a form of parallel block coordinate descent, where parties train a partition of the global model via stochastic coordinate descent. We provide theoretical convergence analysis for Flex-VFL and show that the convergence rate is constrained by the party speeds and local optimizer parameters. We apply this analysis and extend our algorithm to adapt party learning rates in response to changing speeds and local optimizer parameters. Finally, we compare the convergence time of Flex-VFL against synchronous and asynchronous VFL algorithms, as well as illustrate the effectiveness of our adaptive extension.
Key facts. Cited by 20 papers in the map (data through 13 Oct 2026). First posted on arXiv 26 Aug 2022.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 1; 2023: 9; 2024: 3; 2025: 6; 2026: 1.
20 papers.
Sort:
- 2022Vertical Federated Learning: Concepts, Advances and Challengescited by 108
- 2023FedVS: Straggler-Resilient and Privacy-Preserving Vertical Federated Learning for Split Modelscited by 17
- 2024Advances in Robust Federated Learning: A Survey with Heterogeneity Considerationscited by 12
- 2023Vertical Federated Learning: Taxonomies, Threats, and Prospectscited by 8
- 2023VFLAIR: A Research Library and Benchmark for Vertical Federated Learningcited by 8
- 2023Robust and IP-Protecting Vertical Federated Learning against Unexpected Quitting of Partiescited by 7
- 2023Online Vertical Federated Learning for Cooperative Spectrum Sensingcited by 6
- 2024Communication-Efficient Hybrid Federated Learning for E-health with Horizontal and Vertical Data Partitioningcited by 6
- 2024Communication-efficient Vertical Federated Learning via Compressed Error Feedbackcited by 3
- 2023Secure and Fast Asynchronous Vertical Federated Learning via Cascaded Hybrid Optimizationcited by 2
- 2023Robust Collaborative Inference with Vertically Split Data Over Dynamic Device Environmentscited by 2
- 2023Flexible Differentially Private Vertical Federated Learning with Adaptive Feature Embeddingscited by 1
8 more
- 2023Task-Oriented Edge Networks: Decentralized Learning Over Wireless Fronthaulcited by 1
- 2025Integrating Identity-Based Identification against Adaptive Adversaries in Federated Learningcited by 1
- 2025Communication-Efficient and Differentially Private Vertical Federated Learning with Zeroth-Order Optimizationcited by 0
- 2025Deep Latent Variable Model based Vertical Federated Learning with Flexible Alignment and Labeling Scenarioscited by 0
- 2025Multimodal Federated Learning: A Survey through the Lens of Different FL Paradigmscited by 0
- 2025Proto-EVFL: Enhanced Vertical Federated Learning via Dual Prototype with Extremely Unaligned Datacited by 0
- 2025PubSub-VFL: Towards Efficient Two-Party Split Learning in Heterogeneous Environments via Publisher/Subscriber Architecturecited by 0
- 2026Optimizing Server Placement for Vertical Federated Learning in Dynamic Edge/Fog Networkscited by 0
- 2026Optimizing Server Placement for Vertical Federated Learning in Dynamic Edge/Fog Networks10 May 2026
- 2025PubSub-VFL: Towards Efficient Two-Party Split Learning in Heterogeneous Environments via Publisher/Subscriber Architecture14 Oct 2025
- 2025Proto-EVFL: Enhanced Vertical Federated Learning via Dual Prototype with Extremely Unaligned Data30 Jul 2025
- 2025Multimodal Federated Learning: A Survey through the Lens of Different FL Paradigms27 May 2025
- 2025Deep Latent Variable Model based Vertical Federated Learning with Flexible Alignment and Labeling Scenarios16 May 2025
- 2025Integrating Identity-Based Identification against Adaptive Adversaries in Federated Learning3 Apr 2025
- 2025Communication-Efficient and Differentially Private Vertical Federated Learning with Zeroth-Order Optimization27 Feb 2025
- 2024Communication-efficient Vertical Federated Learning via Compressed Error Feedback20 Jun 2024
- 2024Advances in Robust Federated Learning: A Survey with Heterogeneity Considerations16 May 2024
- 2024Communication-Efficient Hybrid Federated Learning for E-health with Horizontal and Vertical Data Partitioning15 Apr 2024
- 2023Robust Collaborative Inference with Vertically Split Data Over Dynamic Device Environments27 Dec 2023
- 2023Online Vertical Federated Learning for Cooperative Spectrum Sensing18 Dec 2023
8 more
- 2023Task-Oriented Edge Networks: Decentralized Learning Over Wireless Fronthaul3 Dec 2023
- 2023VFLAIR: A Research Library and Benchmark for Vertical Federated Learning15 Oct 2023
- 2023Flexible Differentially Private Vertical Federated Learning with Adaptive Feature Embeddings26 Jul 2023
- 2023Secure and Fast Asynchronous Vertical Federated Learning via Cascaded Hybrid Optimization28 Jun 2023
- 2023FedVS: Straggler-Resilient and Privacy-Preserving Vertical Federated Learning for Split Models26 Apr 2023
- 2023Robust and IP-Protecting Vertical Federated Learning against Unexpected Quitting of Parties28 Mar 2023
- 2023Vertical Federated Learning: Taxonomies, Threats, and Prospects3 Feb 2023
- 2022Vertical Federated Learning: Concepts, Advances and Challenges23 Nov 2022
- 2022Vertical Federated Learning: Concepts, Advances and Challengescited by 108
- 2023FedVS: Straggler-Resilient and Privacy-Preserving Vertical Federated Learning for Split Modelscited by 17
- 2024Advances in Robust Federated Learning: A Survey with Heterogeneity Considerationscited by 12
- 2023Vertical Federated Learning: Taxonomies, Threats, and Prospectscited by 8
- 2023VFLAIR: A Research Library and Benchmark for Vertical Federated Learningcited by 8
- 2023Robust and IP-Protecting Vertical Federated Learning against Unexpected Quitting of Partiescited by 7
- 2023Online Vertical Federated Learning for Cooperative Spectrum Sensingcited by 6
- 2024Communication-Efficient Hybrid Federated Learning for E-health with Horizontal and Vertical Data Partitioningcited by 6
- 2024Communication-efficient Vertical Federated Learning via Compressed Error Feedbackcited by 3
- 2023Secure and Fast Asynchronous Vertical Federated Learning via Cascaded Hybrid Optimizationcited by 2
- 2023Robust Collaborative Inference with Vertically Split Data Over Dynamic Device Environmentscited by 2
- 2023Flexible Differentially Private Vertical Federated Learning with Adaptive Feature Embeddingscited by 1
12 most cited of 20 All 20 (JSON)
- 2026Optimizing Server Placement for Vertical Federated Learning in Dynamic Edge/Fog Networks10 May 2026
- 2025PubSub-VFL: Towards Efficient Two-Party Split Learning in Heterogeneous Environments via Publisher/Subscriber Architecture14 Oct 2025
- 2025Proto-EVFL: Enhanced Vertical Federated Learning via Dual Prototype with Extremely Unaligned Data30 Jul 2025
- 2025Multimodal Federated Learning: A Survey through the Lens of Different FL Paradigms27 May 2025
- 2025Deep Latent Variable Model based Vertical Federated Learning with Flexible Alignment and Labeling Scenarios16 May 2025
- 2025Integrating Identity-Based Identification against Adaptive Adversaries in Federated Learning3 Apr 2025
- 2025Communication-Efficient and Differentially Private Vertical Federated Learning with Zeroth-Order Optimization27 Feb 2025
- 2024Communication-efficient Vertical Federated Learning via Compressed Error Feedback20 Jun 2024
- 2024Advances in Robust Federated Learning: A Survey with Heterogeneity Considerations16 May 2024
- 2024Communication-Efficient Hybrid Federated Learning for E-health with Horizontal and Vertical Data Partitioning15 Apr 2024
- 2023Robust Collaborative Inference with Vertically Split Data Over Dynamic Device Environments27 Dec 2023
- 2023Online Vertical Federated Learning for Cooperative Spectrum Sensing18 Dec 2023
12 newest of 20 All 20 (JSON)