SecureBoost: A Lossless Federated Learning Framework
Not on the map. Why?
Abstract (arXiv)
The protection of user privacy is an important concern in machine learning, as evidenced by the rolling out of the General Data Protection Regulation (GDPR) in the European Union (EU) in May 2018. The GDPR is designed to give users more control over their personal data, which motivates us to explore machine learning frameworks for data sharing that do not violate user privacy. To meet this goal, in this paper, we propose a novel lossless privacy-preserving tree-boosting system known as SecureBoost in the setting of federated learning. SecureBoost first conducts entity alignment under a privacy-preserving protocol and then constructs boosting trees across multiple parties with a carefully designed encryption strategy. This federated learning system allows the learning process to be jointly conducted over multiple parties with common user samples but different feature sets, which corresponds to a vertically partitioned data set. An advantage of SecureBoost is that it provides the same level of accuracy as the non-privacy-preserving approach while at the same time, reveals no information of each private data provider. We show that the SecureBoost framework is as accurate as other non-federated gradient tree-boosting algorithms that require centralized data and thus it is highly scalable and practical for industrial applications such as credit risk analysis. To this end, we discuss information leakage during the protocol execution and propose ways to provably reduce it.
Key facts. Cited by 174 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Jan 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 34; 2022: 42; 2023: 33; 2024: 34; 2025: 22; 2026: 9.
174 papers.
Sort:
By area:
- 2021Federated Learning on Non-IID Data: A Surveycited by 345
- 2023FederatedScope-LLM: A Comprehensive Package for Fine-tuning Large Language Models in Federated Learningcited by 146
- 2022Decentralized Federated Learning: Fundamentals, State of the Art, Frameworks, Trends, and Challengescited by 137
- 2022Vertical Federated Learning: Concepts, Advances and Challengescited by 104
- 2021CAFE: Catastrophic Data Leakage in Vertical Federated Learningcited by 76
- 2023FATE-LLM: A Industrial Grade Federated Learning Framework for Large Language Modelscited by 62
- 2021Privacy-Preserving Machine Learning: Methods, Challenges and Directionscited by 58
- 2021Survey: Leakage and Privacy at Inference Timecited by 44
- 2021Federated Learning Meets Natural Language Processing: A Surveycited by 42
- 2022A Survey on Heterogeneous Federated Learningcited by 42
- 2022No Free Lunch Theorem for Security and Utility in Federated Learningcited by 39
- 2021Secure Bilevel Asynchronous Vertical Federated Learning with Backward Updatingcited by 37
38 more
- 2022FLIP: A Provable Defense Framework for Backdoor Mitigation in Federated Learningcited by 37
- 2022BlindFL: Vertical Federated Machine Learning without Peeking into Your Datacited by 36
- 2022Compressed-VFL: Communication-Efficient Learning with Vertically Partitioned Datacited by 36
- 2022Federated Learning for Healthcare Domain - Pipeline, Applications and Challengescited by 34
- 2022Trading Off Privacy, Utility and Efficiency in Federated Learningcited by 33
- 2021FedV: Privacy-Preserving Federated Learning over Vertically Partitioned Datacited by 31
- 2023A Survey on Vertical Federated Learning: From a Layered Perspectivecited by 30
- 2021Personalized Federated Learning with Adaptive Batchnorm for Healthcarecited by 26
- 2023Federated Domain Generalization: A Surveycited by 25
- 2024Decentralized Federated Learning: A Survey on Security and Privacycited by 25
- 2023A Survey of Trustworthy Federated Learning with Perspectives on Security, Robustness, and Privacycited by 24
- 2022FairVFL: A Fair Vertical Federated Learning Framework with Contrastive Adversarial Learningcited by 23
- 2022AI Security for Geoscience and Remote Sensing: Challenges and Future Trendscited by 23
- 2022Practical Vertical Federated Learning with Unsupervised Representation Learningcited by 19
- 2023Vertical Federated Knowledge Transfer via Representation Distillation for Healthcare Collaboration Networkscited by 19
- 2024FedMKT: Federated Mutual Knowledge Transfer for Large and Small Language Modelscited by 19
- 2022Fair and efficient contribution valuation for vertical federated learningcited by 18
- 2022A Hybrid Self-Supervised Learning Framework for Vertical Federated Learningcited by 17
- 2022Vertical Federated Learning: A Structured Literature Reviewcited by 17
- 2023FedVS: Straggler-Resilient and Privacy-Preserving Vertical Federated Learning for Split Modelscited by 17
- 2021Scalable federated machine learning with FEDncited by 16
- 2021AsySQN: Faster Vertical Federated Learning Algorithms with Better Computation Resource Utilizationcited by 16
- 2021Batch Label Inference and Replacement Attacks in Black-Boxed Vertical Federated Learningcited by 16
- 2021FLASHE: Additively Symmetric Homomorphic Encryption for Cross-Silo Federated Learningcited by 15
- 2022Towards Communication-efficient Vertical Federated Learning Training via Cache-enabled Local Updatescited by 15
- 2023FedSDG-FS: Efficient and Secure Feature Selection for Vertical Federated Learningcited by 15
- 2021Citadel: Protecting Data Privacy and Model Confidentiality for Collaborative Learning with SGXcited by 14
- 2022Coresets for Vertical Federated Learning: Regularized Linear Regression and K-Means Clusteringcited by 14
- 2024Vertical Federated Learning for Effectiveness, Security, Applicability: A Surveycited by 14
- 2022Feature Reconstruction Attacks and Countermeasures of DNN training in Vertical Federated Learningcited by 13
- 2023Communication-Efficient Vertical Federated Learning with Limited Overlapping Samplescited by 13
- 2024The Federation Strikes Back: A Survey of Federated Learning Privacy Attacks, Defenses, Applications, and Policy Landscapecited by 13
- 2022OpBoost: A Vertical Federated Tree Boosting Framework Based on Order-Preserving Desensitizationcited by 12
- 2023Gradient-less Federated Gradient Boosting Trees with Learnable Learning Ratescited by 12
- 2023Optimizing Privacy, Utility and Efficiency in Constrained Multi-Objective Federated Learningcited by 12
- 2021A Federated Learning Framework for Smart Grids: Securing Power Traces in Collaborative Learningcited by 11
- 2023Towards Interpretable Federated Learningcited by 11
- 2021Fed-EINI: An Efficient and Interpretable Inference Framework for Decision Tree Ensembles in Federated Learningcited by 10
50 most cited of 174 All 174 (JSON)
- 2026Optimal Networks for Agentic Information Aggregation28 Sep 2026
- 2026Optimal Rates for Agentic Networked Information Aggregation4 Sep 2026
- 2026Practical Anonymous Two-Party Gradient Boosting Decision Tree26 May 2026
- 2026Federated Imputation under Heterogeneous Feature Spaces15 May 2026
- 2026Private Vertical Federated Inference for Time-Series8 May 2026
- 2026Privacy-Preserving Federated Learning: Integrating Zero-Knowledge Proofs in Scalable Distributed Architectures4 May 2026
- 2026Networked Information Aggregation for Binary Classification1 May 2026
- 2026Learning Unknown Interdependencies for Decentralized Root Cause Analysis in Nonlinear Dynamical Systems25 Feb 2026
- 2026HybridFL: A Federated Learning Approach for Financial Crime Detection22 Feb 2026
- 2025HybridVFL: Disentangled Feature Learning for Edge-Enabled Vertical Federated Multimodal Classification11 Dec 2025
- 2025REMISVFU: Vertical Federated Unlearning via Representation Misdirection for Intermediate Output Feature11 Dec 2025
- 2025DISCO: A Browser-Based Privacy-Preserving Framework for Distributed Collaborative Learning24 Nov 2025
38 more
- 2025A Structure-Agnostic Co-Tuning Framework for LLMs and SLMs in Cloud-Edge Systems12 Nov 2025
- 2025PubSub-VFL: Towards Efficient Two-Party Split Learning in Heterogeneous Environments via Publisher/Subscriber Architecture14 Oct 2025
- 2025The Role of Federated Learning in Improving Financial Security: A Survey7 Oct 2025
- 2025Adversarial Robustness in Distributed Quantum Machine Learning16 Aug 2025
- 2025FedCVD++: Communication-Efficient Federated Learning for Cardiovascular Risk Prediction with Parametric and Non-Parametric Model Optimization30 Jul 2025
- 2025FedBAP: Backdoor Defense via Benign Adversarial Perturbation in Federated Learning26 Jul 2025
- 2025Federated Learning for ICD Classification with Lightweight Models and Pretrained Embeddings3 Jul 2025
- 2025How to Securely Shuffle? A survey about Secure Shufflers for privacy-preserving computations2 Jul 2025
- 2025FedGA-Tree: Federated Decision Tree using Genetic Algorithm9 Jun 2025
- 2025TimberStrike: Dataset Reconstruction Attack Revealing Privacy Leakage in Federated Tree-Based Systems9 Jun 2025
- 2025WikiDBGraph: A Data Management Benchmark Suite for Collaborative Learning over Database Silos22 May 2025
- 2025Bayesian Robust Aggregation for Federated Learning5 May 2025
- 2025Tree-based Models for Vertical Federated Learning: A Survey3 Apr 2025
- 2025Robust Asymmetric Heterogeneous Federated Learning with Corrupted Clients12 Mar 2025
- 2025Scaling Probabilistic Circuits via Data Partitioning11 Mar 2025
- 2025Communication-Efficient and Differentially Private Vertical Federated Learning with Zeroth-Order Optimization27 Feb 2025
- 2025Principles and Components of Federated Learning Architectures7 Feb 2025
- 2025Vertical Federated Learning for Failure-Cause Identification in Disaggregated Microwave Networks5 Feb 2025
- 2025CENSOR: Defense Against Gradient Inversion via Orthogonal Subspace Bayesian Sampling27 Jan 2025
- 2024Concurrent vertical and horizontal federated learning with fuzzy cognitive maps17 Dec 2024
- 2024Just a Simple Transformation is Enough for Data Protection in Vertical Federated Learning16 Dec 2024
- 2024Towards Active Participant Centric Vertical Federated Learning: Some Representations May Be All You Need23 Oct 2024
- 2024Training on Fake Labels: Mitigating Label Leakage in Split Learning via Secure Dimension Transformation11 Oct 2024
- 2024HSTFL: A Heterogeneous Federated Learning Framework for Misaligned Spatiotemporal Forecasting27 Sep 2024
- 2024FedModule: A Modular Federated Learning Framework7 Sep 2024
- 2024FedAD-Bench: A Unified Benchmark for Federated Unsupervised Anomaly Detection in Tabular Data8 Aug 2024
- 2024A Hybrid Federated Kernel Regularized Least Squares Algorithm24 Jul 2024
- 2024Privacy-Preserving Data Deduplication for Enhancing Federated Learning of Language Models (Extended Version)11 Jul 2024
- 2024Linkage on Security, Privacy and Fairness in Federated Learning: New Balances and New Perspectives16 Jun 2024
- 2024FedMKT: Federated Mutual Knowledge Transfer for Large and Small Language Models4 Jun 2024
- 2024FedAdOb: Privacy-Preserving Federated Deep Learning with Adaptive Obfuscation3 Jun 2024
- 2024Vertical Federated Learning for Effectiveness, Security, Applicability: A Survey25 May 2024
- 2024Privacy-Preserving Edge Federated Learning for Intelligent Mobile-Health Systems9 May 2024
- 2024The Federation Strikes Back: A Survey of Federated Learning Privacy Attacks, Defenses, Applications, and Policy Landscape6 May 2024
- 2024A Survey on Contribution Evaluation in Vertical Federated Learning3 May 2024
- 2024A Federated Learning Benchmark on Tabular Data: Comparing Tree-Based Models and Neural Networks3 May 2024
- 2024Histogram-Based Federated XGBoost using Minimal Variance Sampling for Federated Tabular Data3 May 2024
- 2024Federated Learning for Tabular Data using TabNet: A Vehicular Use-Case3 May 2024
50 newest of 174 All 174 (JSON)
- 2023SecureCut: Federated Gradient Boosting Decision Trees with Efficient Machine Unlearningcited by 4
- 2023Mutual Information Regularization for Vertical Federated Learningcited by 3
- 2022Analyzing the Robustness of Decentralized Horizontal and Vertical Federated Learning Architectures in a Non-IID Scenariocited by 2
- 2024A GAN-based data poisoning framework against anomaly detection in vertical federated learningcited by 1
- 2025REMISVFU: Vertical Federated Unlearning via Representation Misdirection for Intermediate Output Featurecited by 1
- 2025REMISVFU: Vertical Federated Unlearning via Representation Misdirection for Intermediate Output Feature11 Dec 2025
- 2024A GAN-based data poisoning framework against anomaly detection in vertical federated learning17 Jan 2024
- 2023SecureCut: Federated Gradient Boosting Decision Trees with Efficient Machine Unlearning22 Nov 2023
- 2023Mutual Information Regularization for Vertical Federated Learning1 Jan 2023
- 2022Analyzing the Robustness of Decentralized Horizontal and Vertical Federated Learning Architectures in a Non-IID Scenario20 Oct 2022
- 2026Optimal Rates for Agentic Networked Information Aggregationcited by 1
- 2026Optimal Networks for Agentic Information Aggregationcited by 0
- 2026Optimal Networks for Agentic Information Aggregation28 Sep 2026
- 2026Optimal Rates for Agentic Networked Information Aggregation4 Sep 2026
- 2021Federated Learning on Non-IID Data: A Surveycited by 345
- 2023FederatedScope-LLM: A Comprehensive Package for Fine-tuning Large Language Models in Federated Learningcited by 146
- 2022Decentralized Federated Learning: Fundamentals, State of the Art, Frameworks, Trends, and Challengescited by 137
- 2022Vertical Federated Learning: Concepts, Advances and Challengescited by 104
- 2021CAFE: Catastrophic Data Leakage in Vertical Federated Learningcited by 76
- 2023FATE-LLM: A Industrial Grade Federated Learning Framework for Large Language Modelscited by 62
- 2021Privacy-Preserving Machine Learning: Methods, Challenges and Directionscited by 58
- 2021Survey: Leakage and Privacy at Inference Timecited by 44
- 2021Federated Learning Meets Natural Language Processing: A Surveycited by 42
- 2022A Survey on Heterogeneous Federated Learningcited by 42
- 2022No Free Lunch Theorem for Security and Utility in Federated Learningcited by 39
- 2021Secure Bilevel Asynchronous Vertical Federated Learning with Backward Updatingcited by 37
12 most cited of 167 All 167 (JSON)
- 2026Practical Anonymous Two-Party Gradient Boosting Decision Tree26 May 2026
- 2026Federated Imputation under Heterogeneous Feature Spaces15 May 2026
- 2026Private Vertical Federated Inference for Time-Series8 May 2026
- 2026Privacy-Preserving Federated Learning: Integrating Zero-Knowledge Proofs in Scalable Distributed Architectures4 May 2026
- 2026Networked Information Aggregation for Binary Classification1 May 2026
- 2026Learning Unknown Interdependencies for Decentralized Root Cause Analysis in Nonlinear Dynamical Systems25 Feb 2026
- 2026HybridFL: A Federated Learning Approach for Financial Crime Detection22 Feb 2026
- 2025HybridVFL: Disentangled Feature Learning for Edge-Enabled Vertical Federated Multimodal Classification11 Dec 2025
- 2025DISCO: A Browser-Based Privacy-Preserving Framework for Distributed Collaborative Learning24 Nov 2025
- 2025A Structure-Agnostic Co-Tuning Framework for LLMs and SLMs in Cloud-Edge Systems12 Nov 2025
- 2025PubSub-VFL: Towards Efficient Two-Party Split Learning in Heterogeneous Environments via Publisher/Subscriber Architecture14 Oct 2025
- 2025The Role of Federated Learning in Improving Financial Security: A Survey7 Oct 2025
12 newest of 167 All 167 (JSON)