LotteryFL: Personalized and Communication-Efficient Federated Learning with Lottery Ticket Hypothesis on Non-IID Datasets
Not on the map. Why?
Abstract (arXiv)
Federated learning is a popular distributed machine learning paradigm with enhanced privacy. Its primary goal is learning a global model that offers good performance for the participants as many as possible. The technology is rapidly advancing with many unsolved challenges, among which statistical heterogeneity (i.e., non-IID) and communication efficiency are two critical ones that hinder the development of federated learning. In this work, we propose LotteryFL -- a personalized and communication-efficient federated learning framework via exploiting the Lottery Ticket hypothesis. In LotteryFL, each client learns a lottery ticket network (i.e., a subnetwork of the base model) by applying the Lottery Ticket hypothesis, and only these lottery networks will be communicated between the server and clients. Rather than learning a shared global model in classic federated learning, each client learns a personalized model via LotteryFL; the communication cost can be significantly reduced due to the compact size of lottery networks. To support the training and evaluation of our framework, we construct non-IID datasets based on MNIST, CIFAR-10 and EMNIST by taking feature distribution skew, label distribution skew and quantity skew into consideration. Experiments on these non-IID datasets demonstrate that LotteryFL significantly outperforms existing solutions in terms of personalization and communication cost.
Key facts. Cited by 60 papers in the map (data through 14 Oct 2026). First posted on arXiv 7 Aug 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 9; 2023: 15; 2024: 13; 2025: 4; 2026: 6.
60 papers.
Sort:
By area:
- 2023Towards Building the Federated GPT: Federated Instruction Tuningcited by 185
- 2023Federated Learning for Generalization, Robustness, Fairness: A Survey and Benchmarkcited by 99
- 2022DisPFL: Towards Communication-Efficient Personalized Federated Learning via Decentralized Sparse Trainingcited by 74
- 2021Federated Dynamic Sparse Training: Computing Less, Communicating Less, Yet Learning Bettercited by 55
- 2021FedCor: Correlation-Based Active Client Selection Strategy for Heterogeneous Federated Learningcited by 43
- 2021AutoFL: Enabling Heterogeneity-Aware Energy Efficient Federated Learningcited by 39
- 2021FL-WBC: Enhancing Robustness against Model Poisoning Attacks in Federated Learning from a Client Perspectivecited by 36
- 2024Advances and Open Challenges in Federated Foundation Modelscited by 36
- 2022Rare Gems: Finding Lottery Tickets at Initializationcited by 34
- 2022Sparse Random Networks for Communication-Efficient Federated Learningcited by 32
- 2022Achieving Personalized Federated Learning with Sparse Local Modelscited by 31
- 2024A Survey on Efficient Federated Learning Methods for Foundation Model Trainingcited by 29
38 more
- 2024A Survey of Lottery Ticket Hypothesiscited by 24
- 2023Phoenix: A Federated Generative Diffusion Modelcited by 22
- 2024FIARSE: Model-Heterogeneous Federated Learning via Importance-Aware Submodel Extractioncited by 21
- 2023Fed-GraB: Federated Long-tailed Learning with Self-Adjusting Gradient Balancercited by 17
- 2022Recycling Model Updates in Federated Learning: Are Gradient Subspaces Low-Rank?cited by 16
- 2022Self-Aware Personalized Federated Learningcited by 16
- 2023Fusion of Global and Local Knowledge for Personalized Federated Learningcited by 14
- 2024Non-IID data in Federated Learning: A Survey with Taxonomy, Metrics, Methods, Frameworks and Future Directionscited by 13
- 2022Lottery Aware Sparsity Hunting: Enabling Federated Learning on Resource-Limited Edgecited by 12
- 2023Complement Sparsification: Low-Overhead Model Pruning for Federated Learningcited by 12
- 2021Opportunistic Federated Learning: An Exploration of Egocentric Collaboration for Pervasive Computing Applicationscited by 11
- 2021New Metrics to Evaluate the Performance and Fairness of Personalized Federated Learningcited by 11
- 2024FedMoE-DA: Federated Mixture of Experts via Domain Aware Fine-grained Aggregationcited by 11
- 2021Communication-Efficient and Personalized Federated Lottery Ticket Learningcited by 10
- 2024Effective Heterogeneous Federated Learning via Efficient Hypernetwork-based Weight Generationcited by 9
- 2021FRL: Federated Rank Learningcited by 8
- 2021Constrained Differentially Private Federated Learning for Low-bandwidth Devicescited by 6
- 2023Adaptive Compression in Federated Learning via Side Informationcited by 6
- 2023Efficient Federated Learning with Enhanced Privacy via Lottery Ticket Pruning in Edge Computingcited by 5
- 2023A Practical Recipe for Federated Learning Under Statistical Heterogeneity Experimental Designcited by 5
- 2021FedSkel: Efficient Federated Learning on Heterogeneous Systems with Skeleton Gradients Updatecited by 4
- 2023PriPrune: Quantifying and Preserving Privacy in Pruned Federated Learningcited by 4
- 2021Unifying Distillation with Personalization in Federated Learningcited by 3
- 2022E2FL: Equal and Equitable Federated Learningcited by 3
- 2023FedSelect: Customized Selection of Parameters for Fine-Tuning during Personalized Federated Learningcited by 2
- 2023Federated Fine-Tuning of Foundation Models via Probabilistic Maskingcited by 2
- 2024Gradient-Congruity Guided Federated Sparse Trainingcited by 2
- 2024FedPeWS: Personalized Warmup via Subnetworks for Enhanced Heterogeneous Federated Learningcited by 2
- 2024Revisiting Federated Fine-Tuning: A Single Communication Round is Enough for Foundation Modelscited by 2
- 2026Towards Building Non-Fine-Tunable Foundation Modelscited by 2
- 2021Backdoor Attacks on Federated Learning with Lottery Ticket Hypothesiscited by 1
- 2023SalientGrads: Sparse Models for Communication Efficient and Data Aware Distributed Federated Trainingcited by 1
- 2023Efficient Cluster Selection for Personalized Federated Learning: A Multi-Armed Bandit Approachcited by 1
- 2024SSFL: Discovering Sparse Unified Subnetworks at Initialization for Efficient Federated Learningcited by 1
- 2025Communication-Efficient Personalized Distributed Learning with Data and Node Heterogeneitycited by 1
- 2021FedCom: A Byzantine-Robust Local Model Aggregation Rule Using Data Commitment for Federated Learningcited by 0
- 2022One-Time Model Adaptation to Heterogeneous Clients: An Intra-Client and Inter-Image Attention Designcited by 0
- 2023FedSym: Unleashing the Power of Entropy for Benchmarking the Algorithms for Federated Learningcited by 0
50 most cited of 60 All 60 (JSON)
- 2026FedFIbOS: Fisher Importance based Optimal Submodelling for Heterogeneous Federated Learning17 Sep 2026
- 2026Sheaf-Based Federated Representation Learning8 Aug 2026
- 2026Representation-Aligned Multi-Scale Personalization for Federated Learning13 Apr 2026
- 2026CA-AFP: Cluster-Aware Adaptive Federated Pruning2 Mar 2026
- 2026Towards Building Non-Fine-Tunable Foundation Models31 Jan 2026
- 2026Feature-Aware One-Shot Federated Learning via Hierarchical Token Sequences7 Jan 2026
- 2025Towards Privacy-Preserving and Heterogeneity-aware Split Federated Learning via Probabilistic Masking18 Sep 2025
- 2025Communication-Efficient Personalized Distributed Learning with Data and Node Heterogeneity24 Apr 2025
- 2025FedTilt: Towards Multi-Level Fairness-Preserving and Robust Federated Learning15 Mar 2025
- 2025Personalized Federated Learning for Egocentric Video Gaze Estimation with Comprehensive Parameter Frezzing25 Feb 2025
- 2024Hybrid-Regularized Magnitude Pruning for Robust Federated Learning under Covariate Shift19 Dec 2024
- 2024Revisiting Federated Fine-Tuning: A Single Communication Round is Enough for Foundation Models5 Dec 2024
38 more
- 2024Non-IID data in Federated Learning: A Survey with Taxonomy, Metrics, Methods, Frameworks and Future Directions19 Nov 2024
- 2024FedMoE-DA: Federated Mixture of Experts via Domain Aware Fine-grained Aggregation4 Nov 2024
- 2024FedPeWS: Personalized Warmup via Subnetworks for Enhanced Heterogeneous Federated Learning3 Oct 2024
- 2024FIARSE: Model-Heterogeneous Federated Learning via Importance-Aware Submodel Extraction28 Jul 2024
- 2024Effective Heterogeneous Federated Learning via Efficient Hypernetwork-based Weight Generation3 Jul 2024
- 2024Selective Knowledge Sharing for Personalized Federated Learning Under Capacity Heterogeneity31 May 2024
- 2024SSFL: Discovering Sparse Unified Subnetworks at Initialization for Efficient Federated Learning15 May 2024
- 2024Gradient-Congruity Guided Federated Sparse Training2 May 2024
- 2024Advances and Open Challenges in Federated Foundation Models23 Apr 2024
- 2024A Survey of Lottery Ticket Hypothesis7 Mar 2024
- 2024A Survey on Efficient Federated Learning Methods for Foundation Model Training9 Jan 2024
- 2023Federated Fine-Tuning of Foundation Models via Probabilistic Masking29 Nov 2023
- 2023Federated Learning for Generalization, Robustness, Fairness: A Survey and Benchmark12 Nov 2023
- 2023PriPrune: Quantifying and Preserving Privacy in Pruned Federated Learning30 Oct 2023
- 2023Efficient Cluster Selection for Personalized Federated Learning: A Multi-Armed Bandit Approach29 Oct 2023
- 2023FedSym: Unleashing the Power of Entropy for Benchmarking the Algorithms for Federated Learning11 Oct 2023
- 2023Fed-GraB: Federated Long-tailed Learning with Self-Adjusting Gradient Balancer11 Oct 2023
- 2023A Practical Recipe for Federated Learning Under Statistical Heterogeneity Experimental Design28 Jul 2023
- 2023FedSelect: Customized Selection of Parameters for Fine-Tuning during Personalized Federated Learning23 Jun 2023
- 2023Adaptive Compression in Federated Learning via Side Information22 Jun 2023
- 2023Phoenix: A Federated Generative Diffusion Model7 Jun 2023
- 2023Towards Building the Federated GPT: Federated Instruction Tuning9 May 2023
- 2023Efficient Federated Learning with Enhanced Privacy via Lottery Ticket Pruning in Edge Computing2 May 2023
- 2023SalientGrads: Sparse Models for Communication Efficient and Data Aware Distributed Federated Training15 Apr 2023
- 2023Complement Sparsification: Low-Overhead Model Pruning for Federated Learning10 Mar 2023
- 2023Fusion of Global and Local Knowledge for Personalized Federated Learning21 Feb 2023
- 2022One-Time Model Adaptation to Heterogeneous Clients: An Intra-Client and Inter-Image Attention Design11 Nov 2022
- 2022Sparse Random Networks for Communication-Efficient Federated Learning30 Sep 2022
- 2022Lottery Aware Sparsity Hunting: Enabling Federated Learning on Resource-Limited Edge27 Aug 2022
- 2022DisPFL: Towards Communication-Efficient Personalized Federated Learning via Decentralized Sparse Training1 Jun 2022
- 2022E2FL: Equal and Equitable Federated Learning20 May 2022
- 2022Self-Aware Personalized Federated Learning17 Apr 2022
- 2022Rare Gems: Finding Lottery Tickets at Initialization24 Feb 2022
- 2022Recycling Model Updates in Federated Learning: Are Gradient Subspaces Low-Rank?1 Feb 2022
- 2022Achieving Personalized Federated Learning with Sparse Local Models27 Jan 2022
- 2021Federated Dynamic Sparse Training: Computing Less, Communicating Less, Yet Learning Better18 Dec 2021
- 2021FL-WBC: Enhancing Robustness against Model Poisoning Attacks in Federated Learning from a Client Perspective26 Oct 2021
- 2021FRL: Federated Rank Learning8 Oct 2021
50 newest of 60 All 60 (JSON)
- 2023Phoenix: A Federated Generative Diffusion Modelcited by 22
- 2023Phoenix: A Federated Generative Diffusion Model7 Jun 2023
- 2023Towards Building the Federated GPT: Federated Instruction Tuningcited by 185
- 2023Federated Learning for Generalization, Robustness, Fairness: A Survey and Benchmarkcited by 99
- 2022DisPFL: Towards Communication-Efficient Personalized Federated Learning via Decentralized Sparse Trainingcited by 74
- 2021Federated Dynamic Sparse Training: Computing Less, Communicating Less, Yet Learning Bettercited by 55
- 2021FedCor: Correlation-Based Active Client Selection Strategy for Heterogeneous Federated Learningcited by 43
- 2021AutoFL: Enabling Heterogeneity-Aware Energy Efficient Federated Learningcited by 39
- 2021FL-WBC: Enhancing Robustness against Model Poisoning Attacks in Federated Learning from a Client Perspectivecited by 36
- 2024Advances and Open Challenges in Federated Foundation Modelscited by 36
- 2022Rare Gems: Finding Lottery Tickets at Initializationcited by 34
- 2022Sparse Random Networks for Communication-Efficient Federated Learningcited by 32
- 2022Achieving Personalized Federated Learning with Sparse Local Modelscited by 31
- 2024A Survey on Efficient Federated Learning Methods for Foundation Model Trainingcited by 29
12 most cited of 56 All 56 (JSON)
- 2026FedFIbOS: Fisher Importance based Optimal Submodelling for Heterogeneous Federated Learning17 Sep 2026
- 2026Sheaf-Based Federated Representation Learning8 Aug 2026
- 2026Representation-Aligned Multi-Scale Personalization for Federated Learning13 Apr 2026
- 2026CA-AFP: Cluster-Aware Adaptive Federated Pruning2 Mar 2026
- 2026Towards Building Non-Fine-Tunable Foundation Models31 Jan 2026
- 2025Towards Privacy-Preserving and Heterogeneity-aware Split Federated Learning via Probabilistic Masking18 Sep 2025
- 2025Communication-Efficient Personalized Distributed Learning with Data and Node Heterogeneity24 Apr 2025
- 2025FedTilt: Towards Multi-Level Fairness-Preserving and Robust Federated Learning15 Mar 2025
- 2025Personalized Federated Learning for Egocentric Video Gaze Estimation with Comprehensive Parameter Frezzing25 Feb 2025
- 2024Hybrid-Regularized Magnitude Pruning for Robust Federated Learning under Covariate Shift19 Dec 2024
- 2024Revisiting Federated Fine-Tuning: A Single Communication Round is Enough for Foundation Models5 Dec 2024
- 2024Non-IID data in Federated Learning: A Survey with Taxonomy, Metrics, Methods, Frameworks and Future Directions19 Nov 2024
12 newest of 56 All 56 (JSON)