Generalized Byzantine-tolerant SGD
Not on the map. Why?
Abstract (arXiv)
We propose three new robust aggregation rules for distributed synchronous Stochastic Gradient Descent~(SGD) under a general Byzantine failure model. The attackers can arbitrarily manipulate the data transferred between the servers and the workers in the parameter server~(PS) architecture. We prove the Byzantine resilience properties of these aggregation rules. Empirical analysis shows that the proposed techniques outperform current approaches for realistic use cases and Byzantine attack scenarios.
Key facts. Cited by 94 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 Feb 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 19; 2022: 14; 2023: 22; 2024: 22; 2025: 15; 2026: 2.
94 papers.
Sort:
By area:
- 2021Back to the Drawing Board: A Critical Evaluation of Poisoning Attacks on Production Federated Learningcited by 116
- 2023Fixing by Mixing: A Recipe for Optimal Byzantine ML under Heterogeneitycited by 64
- 2022Byzantine Machine Learning Made Easy by Resilient Averaging of Momentumscited by 63
- 2021Federated Learning: A Signal Processing Perspectivecited by 49
- 2021Challenges and Approaches for Mitigating Byzantine Attacks in Federated Learningcited by 46
- 2022LoMar: A Local Defense Against Poisoning Attack on Federated Learningcited by 29
- 2022Byzantine-Robust Decentralized Learning via ClippedGossipcited by 29
- 2023A Survey on Decentralized Federated Learningcited by 27
- 2023A Survey of Trustworthy Federated Learning with Perspectives on Security, Robustness, and Privacycited by 24
- 2021Exploiting Heterogeneity in Robust Federated Best-Arm Identificationcited by 20
- 2021Differential Privacy and Byzantine Resilience in SGD: Do They Add Up?cited by 17
- 2024Threats and Defenses in Federated Learning Life Cycle: A Comprehensive Survey and Challengescited by 14
38 more
- 2024Byzantine-Robust Federated Learning: Impact of Client Subsampling and Local Updatescited by 13
- 2024Achieving Byzantine-Resilient Federated Learning via Layer-Adaptive Sparsified Model Aggregationcited by 13
- 2023FedDefender: Client-Side Attack-Tolerant Federated Learningcited by 12
- 2021Variance Reduced Median-of-Means Estimator for Byzantine-Robust Distributed Inferencecited by 11
- 2024MedBN: Robust Test-Time Adaptation against Malicious Test Samplescited by 10
- 2023Client-specific Property Inference against Secure Aggregation in Federated Learningcited by 9
- 2023Denial-of-Service or Fine-Grained Control: Towards Flexible Model Poisoning Attacks on Federated Learningcited by 9
- 2023A Survey on Vulnerability of Federated Learning: A Learning Algorithm Perspectivecited by 9
- 2022Byzantines can also Learn from History: Fall of Centered Clipping in Federated Learningcited by 8
- 2023Byzantine-Robust Distributed Online Learning: Taming Adversarial Participants in An Adversarial Environmentcited by 8
- 2023Byzantine-Robust Federated Learning with Variance Reduction and Differential Privacycited by 8
- 2025Towards Trustworthy Federated Learning with Untrusted Participantscited by 8
- 2021Byzantine Fault-Tolerance in Federated Local SGD under 2f-Redundancycited by 7
- 2022Byzantine-Robust Federated Linear Banditscited by 7
- 2022Long-Short History of Gradients is All You Need: Detecting Malicious and Unreliable Clients in Federated Learningcited by 7
- 2023Towards Attack-tolerant Federated Learning via Critical Parameter Analysiscited by 7
- 2024Towards Efficient and Certified Recovery from Poisoning Attacks in Federated Learningcited by 7
- 2021Certified Federated Adversarial Trainingcited by 6
- 2022zPROBE: Zero Peek Robustness Checks for Federated Learningcited by 6
- 2023A Comprehensive Survey On Client Selections in Federated Learningcited by 6
- 2024Global Convergence Guarantees for Federated Policy Gradient Methods with Adversariescited by 6
- 2021SAFELearning: Enable Backdoor Detectability In Federated Learning With Secure Aggregationcited by 5
- 2021Robust Federated Learning via Over-The-Air Computationcited by 5
- 2022Security Analysis of SplitFed Learningcited by 5
- 2024ACE: A Model Poisoning Attack on Contribution Evaluation Methods in Federated Learningcited by 5
- 2021LEGATO: A LayerwisE Gradient AggregaTiOn Algorithm for Mitigating Byzantine Attacks in Federated Learningcited by 4
- 2021Bristle: Decentralized Federated Learning in Byzantine, Non-i.i.d. Environmentscited by 4
- 2022Over-The-Air Federated Learning under Byzantine Attackscited by 4
- 2022Collaborative Linear Bandits with Adversarial Agents: Near-Optimal Regret Boundscited by 4
- 2022Distributed Non-Convex Optimization with One-Bit Compressors on Heterogeneous Data: Efficient and Resilient Algorithmscited by 4
- 2023Temporal Gradient Inversion Attacks with Robust Optimizationcited by 4
- 2023Client-side Gradient Inversion Against Federated Learning from Poisoningcited by 4
- 2024Federated Learning Resilient to Byzantine Attacks and Data Heterogeneitycited by 4
- 2025Federated learning framework for collaborative remaining useful life prognostics: an aircraft engine case studycited by 4
- 2021Tolerating Adversarial Attacks and Byzantine Faults in Distributed Machine Learningcited by 3
- 2021Combining Differential Privacy and Byzantine Resilience in Distributed SGDcited by 3
- 2022A simplified convergence theory for Byzantine resilient stochastic gradient descentcited by 3
- 2023Mitigating Backdoors in Federated Learning with FLDcited by 3
50 most cited of 94 All 94 (JSON)
- 2026Practical Validity Conditions for Byzantine-Tolerant Federated Learning15 May 2026
- 2026Byzantine-Robust Distributed SGD: A Unified Analysis and Tight Error Bounds11 Apr 2026
- 2025Fast, Private, and Protected: Safeguarding Data Privacy and Defending Against Model Poisoning Attacks in Federated Learning4 Nov 2025
- 2025Power to the Clients: Federated Learning in a Dictatorship Setting25 Oct 2025
- 2025H+: An Efficient Similarity-Aware Aggregation for Byzantine Resilient Federated Learning29 Sep 2025
- 2025CoSIFL: Collaborative Secure and Incentivized Federated Learning with Differential Privacy27 Sep 2025
- 2025On the Security and Privacy of Federated Learning: A Survey with Attacks, Defenses, Frameworks, Applications, and Future Directions19 Aug 2025
- 2025Adversarial Robustness in Distributed Quantum Machine Learning16 Aug 2025
- 2025FedLAD: A Linear Algebra Based Data Poisoning Defence for Federated Learning4 Aug 2025
- 2025Find a Scapegoat: Poisoning Membership Inference Attack and Defense to Federated Learning1 Jul 2025
- 2025SABRE-FL: Selective and Accurate Backdoor Rejection for Federated Prompt Learning25 Jun 2025
- 2025Federated learning framework for collaborative remaining useful life prognostics: an aircraft engine case study31 May 2025
38 more
- 2025ByzFL: Research Framework for Robust Federated Learning30 May 2025
- 2025Incentivizing Permissionless Distributed Learning of LLMs27 May 2025
- 2025Towards Trustworthy Federated Learning with Untrusted Participants3 May 2025
- 2025Approaching the Harm of Gradient Attacks While Only Flipping Labels28 Feb 2025
- 2025Decoding FL Defenses: Systemization, Pitfalls, and Remedies3 Feb 2025
- 2024Tazza: Shuffling Neural Network Parameters for Secure and Private Federated Learning10 Dec 2024
- 2024dSTAR: Straggler Tolerant and Byzantine Resilient Distributed SGD10 Dec 2024
- 2024Efficient Federated Unlearning with Adaptive Differential Privacy Preservation17 Nov 2024
- 2024Byzantine-Robust Federated Learning: An Overview With Focus on Developing Sybil-based Attacks to Backdoor Augmented Secure Aggregation Protocols30 Oct 2024
- 2024HYDRA-FL: Hybrid Knowledge Distillation for Robust and Accurate Federated Learning30 Sep 2024
- 2024On the Hardness of Decentralized Multi-Agent Policy Evaluation under Byzantine Attacks19 Sep 2024
- 2024Achieving Byzantine-Resilient Federated Learning via Layer-Adaptive Sparsified Model Aggregation2 Sep 2024
- 2024Efficient Federated Learning against Byzantine Attacks and Data Heterogeneity via Aggregating Normalized Gradients18 Aug 2024
- 2024Understanding Byzantine Robustness in Federated Learning with A Black-box Server12 Aug 2024
- 2024Byzantine-tolerant distributed learning of finite mixture models19 Jul 2024
- 2024Threats and Defenses in Federated Learning Life Cycle: A Comprehensive Survey and Challenges9 Jul 2024
- 2024Asynchronous Byzantine Federated Learning3 Jun 2024
- 2024Data Quality in Edge Machine Learning: A State-of-the-Art Survey1 Jun 2024
- 2024ACE: A Model Poisoning Attack on Contribution Evaluation Methods in Federated Learning31 May 2024
- 2024Fed-Credit: Robust Federated Learning with Credibility Management20 May 2024
- 2024FedMID: A Data-Free Method for Using Intermediate Outputs as a Defense Mechanism Against Poisoning Attacks in Federated Learning18 Apr 2024
- 2024MedBN: Robust Test-Time Adaptation against Malicious Test Samples28 Mar 2024
- 2024Federated Learning Resilient to Byzantine Attacks and Data Heterogeneity20 Mar 2024
- 2024Global Convergence Guarantees for Federated Policy Gradient Methods with Adversaries15 Mar 2024
- 2024Byzantine-Robust Federated Learning: Impact of Client Subsampling and Local Updates20 Feb 2024
- 2024TernaryVote: Differentially Private, Communication Efficient, and Byzantine Resilient Distributed Optimization on Heterogeneous Data16 Feb 2024
- 2024Towards Efficient and Certified Recovery from Poisoning Attacks in Federated Learning16 Jan 2024
- 2023A Survey on Vulnerability of Federated Learning: A Learning Algorithm Perspective27 Nov 2023
- 2023A Comprehensive Survey On Client Selections in Federated Learning12 Nov 2023
- 2023Robust and Actively Secure Serverless Collaborative Learning25 Oct 2023
- 2023SPIRT: A Fault-Tolerant and Reliable Peer-to-Peer Serverless ML Training Architecture25 Sep 2023
- 2023Client-side Gradient Inversion Against Federated Learning from Poisoning14 Sep 2023
- 2023SABLE: Secure And Byzantine robust LEarning11 Sep 2023
- 2023Byzantine-Robust Federated Learning with Variance Reduction and Differential Privacy7 Sep 2023
- 2023Federated Learning Robust to Byzantine Attacks: Achieving Zero Optimality Gap21 Aug 2023
- 2023Towards Attack-tolerant Federated Learning via Critical Parameter Analysis18 Aug 2023
- 2023DISBELIEVE: Distance Between Client Models is Very Essential for Effective Local Model Poisoning Attacks14 Aug 2023
- 2023A Survey on Decentralized Federated Learning8 Aug 2023
50 newest of 94 All 94 (JSON)
- 2024Efficient Federated Unlearning with Adaptive Differential Privacy Preservationcited by 2
- 2025SABRE-FL: Selective and Accurate Backdoor Rejection for Federated Prompt Learningcited by 2
- 2025Find a Scapegoat: Poisoning Membership Inference Attack and Defense to Federated Learningcited by 0
- 2025FedLAD: A Linear Algebra Based Data Poisoning Defence for Federated Learningcited by 0
- 2025FedLAD: A Linear Algebra Based Data Poisoning Defence for Federated Learning4 Aug 2025
- 2025Find a Scapegoat: Poisoning Membership Inference Attack and Defense to Federated Learning1 Jul 2025
- 2025SABRE-FL: Selective and Accurate Backdoor Rejection for Federated Prompt Learning25 Jun 2025
- 2024Efficient Federated Unlearning with Adaptive Differential Privacy Preservation17 Nov 2024
- 2021Back to the Drawing Board: A Critical Evaluation of Poisoning Attacks on Production Federated Learningcited by 116
- 2023Fixing by Mixing: A Recipe for Optimal Byzantine ML under Heterogeneitycited by 64
- 2022Byzantine Machine Learning Made Easy by Resilient Averaging of Momentumscited by 63
- 2021Federated Learning: A Signal Processing Perspectivecited by 49
- 2021Challenges and Approaches for Mitigating Byzantine Attacks in Federated Learningcited by 46
- 2022LoMar: A Local Defense Against Poisoning Attack on Federated Learningcited by 29
- 2022Byzantine-Robust Decentralized Learning via ClippedGossipcited by 29
- 2023A Survey on Decentralized Federated Learningcited by 27
- 2023A Survey of Trustworthy Federated Learning with Perspectives on Security, Robustness, and Privacycited by 24
- 2021Exploiting Heterogeneity in Robust Federated Best-Arm Identificationcited by 20
- 2021Differential Privacy and Byzantine Resilience in SGD: Do They Add Up?cited by 17
- 2024Threats and Defenses in Federated Learning Life Cycle: A Comprehensive Survey and Challengescited by 14
12 most cited of 90 All 90 (JSON)
- 2026Practical Validity Conditions for Byzantine-Tolerant Federated Learning15 May 2026
- 2026Byzantine-Robust Distributed SGD: A Unified Analysis and Tight Error Bounds11 Apr 2026
- 2025Fast, Private, and Protected: Safeguarding Data Privacy and Defending Against Model Poisoning Attacks in Federated Learning4 Nov 2025
- 2025Power to the Clients: Federated Learning in a Dictatorship Setting25 Oct 2025
- 2025H+: An Efficient Similarity-Aware Aggregation for Byzantine Resilient Federated Learning29 Sep 2025
- 2025CoSIFL: Collaborative Secure and Incentivized Federated Learning with Differential Privacy27 Sep 2025
- 2025On the Security and Privacy of Federated Learning: A Survey with Attacks, Defenses, Frameworks, Applications, and Future Directions19 Aug 2025
- 2025Adversarial Robustness in Distributed Quantum Machine Learning16 Aug 2025
- 2025Federated learning framework for collaborative remaining useful life prognostics: an aircraft engine case study31 May 2025
- 2025ByzFL: Research Framework for Robust Federated Learning30 May 2025
- 2025Incentivizing Permissionless Distributed Learning of LLMs27 May 2025
- 2025Towards Trustworthy Federated Learning with Untrusted Participants3 May 2025
12 newest of 90 All 90 (JSON)