A Communication Efficient Collaborative Learning Framework for Distributed Features
Not on the map. Why?
Abstract (arXiv)
We introduce a collaborative learning framework allowing multiple parties having different sets of attributes about the same user to jointly build models without exposing their raw data or model parameters. In particular, we propose a Federated Stochastic Block Coordinate Descent (FedBCD) algorithm, in which each party conducts multiple local updates before each communication to effectively reduce the number of communication rounds among parties, a principal bottleneck for collaborative learning problems. We analyze theoretically the impact of the number of local updates and show that when the batch size, sample size, and the local iterations are selected appropriately, within T iterations, the algorithm performs O(√T) communication rounds and achieves some O(1/√T) accuracy (measured by the average of the gradient norm squared). The approach is supported by our empirical evaluations on a variety of tasks and datasets, demonstrating advantages over stochastic gradient descent (SGD) approaches.
Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). First posted on arXiv 24 Dec 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 7; 2023: 7; 2024: 0; 2025: 1.
21 papers.
Sort:
By area:
- 2022A Survey on Heterogeneous Federated Learningcited by 42
- 2021FedCG: Leverage Conditional GAN for Protecting Privacy and Maintaining Competitive Performance in Federated Learningcited by 39
- 2022Compressed-VFL: Communication-Efficient Learning with Vertically Partitioned Datacited by 36
- 2022Accelerated Federated Learning with Decoupled Adaptive Optimizationcited by 23
- 2023Machine Learning for Large-Scale Optimization in 6G Wireless Networkscited by 18
- 2021AsySQN: Faster Vertical Federated Learning Algorithms with Better Computation Resource Utilizationcited by 16
- 2022Towards Communication-efficient Vertical Federated Learning Training via Cache-enabled Local Updatescited by 15
- 2023FedSDG-FS: Efficient and Secure Feature Selection for Vertical Federated Learningcited by 15
- 2021PIVODL: Privacy-preserving vertical federated learning over distributed labelscited by 9
- 2022Desirable Companion for Vertical Federated Learning: New Zeroth-Order Gradient Based Algorithmcited by 9
- 2021GAL: Gradient Assisted Learning for Decentralized Multi-Organization Collaborationscited by 8
- 2021Multi-Tier Federated Learning for Vertically Partitioned Datacited by 7
9 more
- 2023FedDebug: Systematic Debugging for Federated Learning Applicationscited by 6
- 2023Eliminating Label Leakage in Tree-Based Vertical Federated Learningcited by 6
- 2023Online Vertical Federated Learning for Cooperative Spectrum Sensingcited by 6
- 2021Multi-VFL: A Vertical Federated Learning System for Multiple Data and Label Ownerscited by 5
- 2022Hijack Vertical Federated Learning Models As One Partycited by 5
- 2022Analyzing the Robustness of Decentralized Horizontal and Vertical Federated Learning Architectures in a Non-IID Scenariocited by 2
- 2023Secure and Fast Asynchronous Vertical Federated Learning via Cascaded Hybrid Optimizationcited by 2
- 2023TraceFL: Interpretability-Driven Debugging in Federated Learning via Neuron Provenancecited by 1
- 2025Scaling Probabilistic Circuits via Data Partitioningcited by 1
- 2025Scaling Probabilistic Circuits via Data Partitioning11 Mar 2025
- 2023TraceFL: Interpretability-Driven Debugging in Federated Learning via Neuron Provenance21 Dec 2023
- 2023Online Vertical Federated Learning for Cooperative Spectrum Sensing18 Dec 2023
- 2023Eliminating Label Leakage in Tree-Based Vertical Federated Learning19 Jul 2023
- 2023Secure and Fast Asynchronous Vertical Federated Learning via Cascaded Hybrid Optimization28 Jun 2023
- 2023FedSDG-FS: Efficient and Secure Feature Selection for Vertical Federated Learning21 Feb 2023
- 2023FedDebug: Systematic Debugging for Federated Learning Applications9 Jan 2023
- 2023Machine Learning for Large-Scale Optimization in 6G Wireless Networks3 Jan 2023
- 2022Hijack Vertical Federated Learning Models As One Party1 Dec 2022
- 2022Analyzing the Robustness of Decentralized Horizontal and Vertical Federated Learning Architectures in a Non-IID Scenario20 Oct 2022
- 2022A Survey on Heterogeneous Federated Learning10 Oct 2022
- 2022Towards Communication-efficient Vertical Federated Learning Training via Cache-enabled Local Updates29 Jul 2022
9 more
- 2022Accelerated Federated Learning with Decoupled Adaptive Optimization14 Jul 2022
- 2022Compressed-VFL: Communication-Efficient Learning with Vertically Partitioned Data16 Jun 2022
- 2022Desirable Companion for Vertical Federated Learning: New Zeroth-Order Gradient Based Algorithm19 Mar 2022
- 2021FedCG: Leverage Conditional GAN for Protecting Privacy and Maintaining Competitive Performance in Federated Learning16 Nov 2021
- 2021AsySQN: Faster Vertical Federated Learning Algorithms with Better Computation Resource Utilization26 Sep 2021
- 2021PIVODL: Privacy-preserving vertical federated learning over distributed labels25 Aug 2021
- 2021Multi-VFL: A Vertical Federated Learning System for Multiple Data and Label Owners10 Jun 2021
- 2021GAL: Gradient Assisted Learning for Decentralized Multi-Organization Collaborations2 Jun 2021
- 2021Multi-Tier Federated Learning for Vertically Partitioned Data6 Feb 2021
- 2022A Survey on Heterogeneous Federated Learningcited by 42
- 2021FedCG: Leverage Conditional GAN for Protecting Privacy and Maintaining Competitive Performance in Federated Learningcited by 39
- 2022Compressed-VFL: Communication-Efficient Learning with Vertically Partitioned Datacited by 36
- 2022Accelerated Federated Learning with Decoupled Adaptive Optimizationcited by 23
- 2023Machine Learning for Large-Scale Optimization in 6G Wireless Networkscited by 18
- 2021AsySQN: Faster Vertical Federated Learning Algorithms with Better Computation Resource Utilizationcited by 16
- 2022Towards Communication-efficient Vertical Federated Learning Training via Cache-enabled Local Updatescited by 15
- 2023FedSDG-FS: Efficient and Secure Feature Selection for Vertical Federated Learningcited by 15
- 2021PIVODL: Privacy-preserving vertical federated learning over distributed labelscited by 9
- 2022Desirable Companion for Vertical Federated Learning: New Zeroth-Order Gradient Based Algorithmcited by 9
- 2021GAL: Gradient Assisted Learning for Decentralized Multi-Organization Collaborationscited by 8
- 2021Multi-Tier Federated Learning for Vertically Partitioned Datacited by 7
12 most cited of 20 All 20 (JSON)
- 2025Scaling Probabilistic Circuits via Data Partitioning11 Mar 2025
- 2023TraceFL: Interpretability-Driven Debugging in Federated Learning via Neuron Provenance21 Dec 2023
- 2023Online Vertical Federated Learning for Cooperative Spectrum Sensing18 Dec 2023
- 2023Eliminating Label Leakage in Tree-Based Vertical Federated Learning19 Jul 2023
- 2023Secure and Fast Asynchronous Vertical Federated Learning via Cascaded Hybrid Optimization28 Jun 2023
- 2023FedSDG-FS: Efficient and Secure Feature Selection for Vertical Federated Learning21 Feb 2023
- 2023FedDebug: Systematic Debugging for Federated Learning Applications9 Jan 2023
- 2023Machine Learning for Large-Scale Optimization in 6G Wireless Networks3 Jan 2023
- 2022Hijack Vertical Federated Learning Models As One Party1 Dec 2022
- 2022A Survey on Heterogeneous Federated Learning10 Oct 2022
- 2022Towards Communication-efficient Vertical Federated Learning Training via Cache-enabled Local Updates29 Jul 2022
- 2022Accelerated Federated Learning with Decoupled Adaptive Optimization14 Jul 2022
12 newest of 20 All 20 (JSON)