FederBoost: Private Federated Learning for GBDT
Not on the map. Why?
Abstract (arXiv)
Federated Learning (FL) has been an emerging trend in machine learning and artificial intelligence. It allows multiple participants to collaboratively train a better global model and offers a privacy-aware paradigm for model training since it does not require participants to release their original training data. However, existing FL solutions for vertically partitioned data or decision trees require heavy cryptographic operations. In this paper, we propose a framework named FederBoost for private federated learning of gradient boosting decision trees (GBDT). It supports running GBDT over both vertically and horizontally partitioned data. Vertical FederBoost does not require any cryptographic operation and horizontal FederBoost only requires lightweight secure aggregation. The key observation is that the whole training process of GBDT relies on the ordering of the data instead of the values. We fully implement FederBoost and evaluate its utility and efficiency through extensive experiments performed on three public datasets. Our experimental results show that both vertical and horizontal FederBoost achieve the same level of accuracy with centralized training where all data are collected in a central server, and they are 4-5 orders of magnitude faster than the state-of-the-art solutions for federated decision tree training; hence offering practical solutions for industrial applications.
Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Nov 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 7; 2023: 5; 2024: 8; 2025: 4; 2026: 1.
27 papers.
Sort:
- 2022Vertical Federated Learning: Concepts, Advances and Challengescited by 104
- 2022Coresets for Vertical Federated Learning: Regularized Linear Regression and K-Means Clusteringcited by 14
- 2024Vertical Federated Learning for Effectiveness, Security, Applicability: A Surveycited by 14
- 2022OpBoost: A Vertical Federated Tree Boosting Framework Based on Order-Preserving Desensitizationcited by 12
- 2023Gradient-less Federated Gradient Boosting Trees with Learnable Learning Ratescited by 12
- 2021PIVODL: Privacy-preserving vertical federated learning over distributed labelscited by 9
- 2022Federated Boosted Decision Trees with Differential Privacycited by 9
- 2021Enabling SQL-based Training Data Debugging for Federated Learningcited by 8
- 2022Continual Horizontal Federated Learning for Heterogeneous Datacited by 8
- 2023Vertical Federated Learning: Taxonomies, Threats, and Prospectscited by 8
- 2023VFLAIR: A Research Library and Benchmark for Vertical Federated Learningcited by 8
- 2024A Survey of Privacy Threats and Defense in Vertical Federated Learning: From Model Life Cycle Perspectivecited by 7
15 more
- 2023Eliminating Label Leakage in Tree-Based Vertical Federated Learningcited by 6
- 2023Effective and Efficient Federated Tree Learning on Hybrid Datacited by 5
- 2022Federated XGBoost on Sample-Wise Non-IID Datacited by 4
- 2024Starlit: Privacy-Preserving Federated Learning to Enhance Financial Fraud Detectioncited by 3
- 2024A Federated Learning Benchmark on Tabular Data: Comparing Tree-Based Models and Neural Networkscited by 3
- 2025Tree-based Models for Vertical Federated Learning: A Surveycited by 3
- 2024AFGI: Towards Accurate and Fast-convergent Gradient Inversion Attack in Federated Learningcited by 2
- 2022A Fair and Efficient Hybrid Federated Learning Framework based on XGBoost for Distributed Power Predictioncited by 1
- 2024Histogram-Based Federated XGBoost using Minimal Variance Sampling for Federated Tabular Datacited by 1
- 2025How to Securely Shuffle? A survey about Secure Shufflers for privacy-preserving computationscited by 1
- 2024Survey of Privacy Threats and Countermeasures in Federated Learningcited by 0
- 2024Attributed Graph Clustering in Collaborative Settingscited by 0
- 2025TimberStrike: Dataset Reconstruction Attack Revealing Privacy Leakage in Federated Tree-Based Systemscited by 0
- 2025FedGA-Tree: Federated Decision Tree using Genetic Algorithmcited by 0
- 2026Scalable and Private Federated Learning Using Distributed Differential Privacy and Secure Aggregationcited by 0
- 2026Scalable and Private Federated Learning Using Distributed Differential Privacy and Secure Aggregation8 Apr 2026
- 2025How to Securely Shuffle? A survey about Secure Shufflers for privacy-preserving computations2 Jul 2025
- 2025FedGA-Tree: Federated Decision Tree using Genetic Algorithm9 Jun 2025
- 2025TimberStrike: Dataset Reconstruction Attack Revealing Privacy Leakage in Federated Tree-Based Systems9 Jun 2025
- 2025Tree-based Models for Vertical Federated Learning: A Survey3 Apr 2025
- 2024Attributed Graph Clustering in Collaborative Settings19 Nov 2024
- 2024Vertical Federated Learning for Effectiveness, Security, Applicability: A Survey25 May 2024
- 2024A Federated Learning Benchmark on Tabular Data: Comparing Tree-Based Models and Neural Networks3 May 2024
- 2024Histogram-Based Federated XGBoost using Minimal Variance Sampling for Federated Tabular Data3 May 2024
- 2024AFGI: Towards Accurate and Fast-convergent Gradient Inversion Attack in Federated Learning13 Mar 2024
- 2024A Survey of Privacy Threats and Defense in Vertical Federated Learning: From Model Life Cycle Perspective6 Feb 2024
- 2024Survey of Privacy Threats and Countermeasures in Federated Learning1 Feb 2024
15 more
- 2024Starlit: Privacy-Preserving Federated Learning to Enhance Financial Fraud Detection19 Jan 2024
- 2023Effective and Efficient Federated Tree Learning on Hybrid Data18 Oct 2023
- 2023VFLAIR: A Research Library and Benchmark for Vertical Federated Learning15 Oct 2023
- 2023Eliminating Label Leakage in Tree-Based Vertical Federated Learning19 Jul 2023
- 2023Gradient-less Federated Gradient Boosting Trees with Learnable Learning Rates15 Apr 2023
- 2023Vertical Federated Learning: Taxonomies, Threats, and Prospects3 Feb 2023
- 2022Vertical Federated Learning: Concepts, Advances and Challenges23 Nov 2022
- 2022Coresets for Vertical Federated Learning: Regularized Linear Regression and K-Means Clustering26 Oct 2022
- 2022Federated Boosted Decision Trees with Differential Privacy6 Oct 2022
- 2022OpBoost: A Vertical Federated Tree Boosting Framework Based on Order-Preserving Desensitization4 Oct 2022
- 2022Federated XGBoost on Sample-Wise Non-IID Data3 Sep 2022
- 2022Continual Horizontal Federated Learning for Heterogeneous Data4 Mar 2022
- 2022A Fair and Efficient Hybrid Federated Learning Framework based on XGBoost for Distributed Power Prediction8 Jan 2022
- 2021Enabling SQL-based Training Data Debugging for Federated Learning26 Aug 2021
- 2021PIVODL: Privacy-preserving vertical federated learning over distributed labels25 Aug 2021
- 2022Vertical Federated Learning: Concepts, Advances and Challengescited by 104
- 2022Coresets for Vertical Federated Learning: Regularized Linear Regression and K-Means Clusteringcited by 14
- 2024Vertical Federated Learning for Effectiveness, Security, Applicability: A Surveycited by 14
- 2022OpBoost: A Vertical Federated Tree Boosting Framework Based on Order-Preserving Desensitizationcited by 12
- 2023Gradient-less Federated Gradient Boosting Trees with Learnable Learning Ratescited by 12
- 2021PIVODL: Privacy-preserving vertical federated learning over distributed labelscited by 9
- 2022Federated Boosted Decision Trees with Differential Privacycited by 9
- 2021Enabling SQL-based Training Data Debugging for Federated Learningcited by 8
- 2022Continual Horizontal Federated Learning for Heterogeneous Datacited by 8
- 2023Vertical Federated Learning: Taxonomies, Threats, and Prospectscited by 8
- 2023VFLAIR: A Research Library and Benchmark for Vertical Federated Learningcited by 8
- 2024A Survey of Privacy Threats and Defense in Vertical Federated Learning: From Model Life Cycle Perspectivecited by 7
12 most cited of 27 All 27 (JSON)
- 2026Scalable and Private Federated Learning Using Distributed Differential Privacy and Secure Aggregation8 Apr 2026
- 2025How to Securely Shuffle? A survey about Secure Shufflers for privacy-preserving computations2 Jul 2025
- 2025FedGA-Tree: Federated Decision Tree using Genetic Algorithm9 Jun 2025
- 2025TimberStrike: Dataset Reconstruction Attack Revealing Privacy Leakage in Federated Tree-Based Systems9 Jun 2025
- 2025Tree-based Models for Vertical Federated Learning: A Survey3 Apr 2025
- 2024Attributed Graph Clustering in Collaborative Settings19 Nov 2024
- 2024Vertical Federated Learning for Effectiveness, Security, Applicability: A Survey25 May 2024
- 2024A Federated Learning Benchmark on Tabular Data: Comparing Tree-Based Models and Neural Networks3 May 2024
- 2024Histogram-Based Federated XGBoost using Minimal Variance Sampling for Federated Tabular Data3 May 2024
- 2024AFGI: Towards Accurate and Fast-convergent Gradient Inversion Attack in Federated Learning13 Mar 2024
- 2024A Survey of Privacy Threats and Defense in Vertical Federated Learning: From Model Life Cycle Perspective6 Feb 2024
- 2024Survey of Privacy Threats and Countermeasures in Federated Learning1 Feb 2024
12 newest of 27 All 27 (JSON)