Convergence Analysis of Sequential Federated Learning on Heterogeneous Data
Not on the map. Why?
Abstract (arXiv)
There are two categories of methods in Federated Learning (FL) for joint training across multiple clients: (i) parallel FL (PFL), where clients train models in a parallel manner; and (ii) sequential FL (SFL), where clients train models in a sequential manner. In contrast to that of PFL, the convergence theory of SFL on heterogeneous data is still lacking. In this paper, we establish the convergence guarantees of SFL for strongly/general/non-convex objectives on heterogeneous data. The convergence guarantees of SFL are better than that of PFL on heterogeneous data with both full and partial client participation. Experimental results validate the counterintuitive analysis result that SFL outperforms PFL on extremely heterogeneous data in cross-device settings.
Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Nov 2023.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2024: 6; 2025: 12; 2026: 5.
23 papers.
Sort:
By area:
- 2024OpenFGL: A Comprehensive Benchmark for Federated Graph Learningcited by 16
- 2024One-Shot Sequential Federated Learning for Non-IID Data by Enhancing Local Model Diversitycited by 8
- 2025FSL-SAGE: Accelerating Federated Split Learning via Smashed Activation Gradient Estimationcited by 7
- 2024The Impact of Cut Layer Selection in Split Federated Learningcited by 6
- 2024Parallel Split Learning with Global Samplingcited by 3
- 2025Research in Collaborative Learning Does Not Serve Cross-Silo Federated Learning in Practicecited by 3
- 2024When Foresight Pruning Meets Zeroth-Order Optimization: Efficient Federated Learning for Low-Memory Devicescited by 2
- 2025Data Heterogeneity and Forgotten Labels in Split Federated Learningcited by 2
- 2025Robust Federated Learning with Global Sensitivity Estimation for Financial Risk Managementcited by 1
- 2025SHeRL-FL: When Representation Learning Meets Split Learning in Hierarchical Federated Learningcited by 1
- 2026EdgeFLow: Serverless Federated Learning via Sequential Model Migration in Edge Networkscited by 1
- 2024UniFed: A Universal Federation of a Mixture of Highly Heterogeneous Medical Image Classification Taskscited by 0
11 more
- 2025Stratify: Rethinking Federated Learning for Non-IID Data through Balanced Samplingcited by 0
- 2025SFedKD: Sequential Federated Learning with Discrepancy-Aware Multi-Teacher Knowledge Distillationcited by 0
- 2025orb-QFL: Orbital Quantum Federated Learningcited by 0
- 2025PubSub-VFL: Towards Efficient Two-Party Split Learning in Heterogeneous Environments via Publisher/Subscriber Architecturecited by 0
- 2025Accelerating Wireless Distributed Learning via Hybrid Split and Federated Learning Optimizationcited by 0
- 2025DFedReweighting: A Unified Framework for Objective-Oriented Reweighting in Decentralized Federated Learningcited by 0
- 2025Efficient Asynchronous Federated Evaluation with Strategy Similarity Awareness for Intent-Based Networking in Industrial Internet of Thingscited by 0
- 2026FedDES: Graph-Based Dynamic Ensemble Selection for Personalized Federated Learningcited by 0
- 2026Federated Client Selection under Partial Visibility: A POMDP Approach with Spatio-Temporal Attentioncited by 0
- 2026UB-SMoE: Universally Balanced Sparse Mixture-of-Experts for Resource-adaptive Federated Fine-tuning of Foundation Modelscited by 0
- 2026Heterogeneity-Aware Dataset Scheduling for Efficient Audio Large Language Model Trainingcited by 0
- 2026Heterogeneity-Aware Dataset Scheduling for Efficient Audio Large Language Model Training18 May 2026
- 2026UB-SMoE: Universally Balanced Sparse Mixture-of-Experts for Resource-adaptive Federated Fine-tuning of Foundation Models15 May 2026
- 2026Federated Client Selection under Partial Visibility: A POMDP Approach with Spatio-Temporal Attention12 May 2026
- 2026FedDES: Graph-Based Dynamic Ensemble Selection for Personalized Federated Learning30 Mar 2026
- 2026EdgeFLow: Serverless Federated Learning via Sequential Model Migration in Edge Networks3 Mar 2026
- 2025DFedReweighting: A Unified Framework for Objective-Oriented Reweighting in Decentralized Federated Learning12 Dec 2025
- 2025Efficient Asynchronous Federated Evaluation with Strategy Similarity Awareness for Intent-Based Networking in Industrial Internet of Things28 Nov 2025
- 2025Accelerating Wireless Distributed Learning via Hybrid Split and Federated Learning Optimization25 Nov 2025
- 2025Data Heterogeneity and Forgotten Labels in Split Federated Learning12 Nov 2025
- 2025Research in Collaborative Learning Does Not Serve Cross-Silo Federated Learning in Practice14 Oct 2025
- 2025PubSub-VFL: Towards Efficient Two-Party Split Learning in Heterogeneous Environments via Publisher/Subscriber Architecture14 Oct 2025
- 2025orb-QFL: Orbital Quantum Federated Learning20 Sep 2025
11 more
- 2025SHeRL-FL: When Representation Learning Meets Split Learning in Hierarchical Federated Learning11 Aug 2025
- 2025SFedKD: Sequential Federated Learning with Discrepancy-Aware Multi-Teacher Knowledge Distillation11 Jul 2025
- 2025FSL-SAGE: Accelerating Federated Split Learning via Smashed Activation Gradient Estimation29 May 2025
- 2025Stratify: Rethinking Federated Learning for Non-IID Data through Balanced Sampling18 Apr 2025
- 2025Robust Federated Learning with Global Sensitivity Estimation for Financial Risk Management24 Feb 2025
- 2024The Impact of Cut Layer Selection in Split Federated Learning20 Dec 2024
- 2024OpenFGL: A Comprehensive Benchmark for Federated Graph Learning29 Aug 2024
- 2024UniFed: A Universal Federation of a Mixture of Highly Heterogeneous Medical Image Classification Tasks29 Jul 2024
- 2024Parallel Split Learning with Global Sampling22 Jul 2024
- 2024When Foresight Pruning Meets Zeroth-Order Optimization: Efficient Federated Learning for Low-Memory Devices8 May 2024
- 2024One-Shot Sequential Federated Learning for Non-IID Data by Enhancing Local Model Diversity18 Apr 2024
- 2024OpenFGL: A Comprehensive Benchmark for Federated Graph Learningcited by 16
- 2024One-Shot Sequential Federated Learning for Non-IID Data by Enhancing Local Model Diversitycited by 8
- 2025FSL-SAGE: Accelerating Federated Split Learning via Smashed Activation Gradient Estimationcited by 7
- 2024The Impact of Cut Layer Selection in Split Federated Learningcited by 6
- 2024Parallel Split Learning with Global Samplingcited by 3
- 2025Research in Collaborative Learning Does Not Serve Cross-Silo Federated Learning in Practicecited by 3
- 2024When Foresight Pruning Meets Zeroth-Order Optimization: Efficient Federated Learning for Low-Memory Devicescited by 2
- 2025Data Heterogeneity and Forgotten Labels in Split Federated Learningcited by 2
- 2025Robust Federated Learning with Global Sensitivity Estimation for Financial Risk Managementcited by 1
- 2025SHeRL-FL: When Representation Learning Meets Split Learning in Hierarchical Federated Learningcited by 1
- 2026EdgeFLow: Serverless Federated Learning via Sequential Model Migration in Edge Networkscited by 1
- 2024UniFed: A Universal Federation of a Mixture of Highly Heterogeneous Medical Image Classification Taskscited by 0
12 most cited of 22 All 22 (JSON)
- 2026Heterogeneity-Aware Dataset Scheduling for Efficient Audio Large Language Model Training18 May 2026
- 2026Federated Client Selection under Partial Visibility: A POMDP Approach with Spatio-Temporal Attention12 May 2026
- 2026FedDES: Graph-Based Dynamic Ensemble Selection for Personalized Federated Learning30 Mar 2026
- 2026EdgeFLow: Serverless Federated Learning via Sequential Model Migration in Edge Networks3 Mar 2026
- 2025DFedReweighting: A Unified Framework for Objective-Oriented Reweighting in Decentralized Federated Learning12 Dec 2025
- 2025Efficient Asynchronous Federated Evaluation with Strategy Similarity Awareness for Intent-Based Networking in Industrial Internet of Things28 Nov 2025
- 2025Accelerating Wireless Distributed Learning via Hybrid Split and Federated Learning Optimization25 Nov 2025
- 2025Data Heterogeneity and Forgotten Labels in Split Federated Learning12 Nov 2025
- 2025Research in Collaborative Learning Does Not Serve Cross-Silo Federated Learning in Practice14 Oct 2025
- 2025PubSub-VFL: Towards Efficient Two-Party Split Learning in Heterogeneous Environments via Publisher/Subscriber Architecture14 Oct 2025
- 2025orb-QFL: Orbital Quantum Federated Learning20 Sep 2025
- 2025SHeRL-FL: When Representation Learning Meets Split Learning in Hierarchical Federated Learning11 Aug 2025
12 newest of 22 All 22 (JSON)