Federated Learning Meets Multi-objective Optimization
Not on the map. Why?
Abstract (arXiv)
Federated learning has emerged as a promising, massively distributed way to train a joint deep model over large amounts of edge devices while keeping private user data strictly on device. In this work, motivated from ensuring fairness among users and robustness against malicious adversaries, we formulate federated learning as multi-objective optimization and propose a new algorithm FedMGDA+ that is guaranteed to converge to Pareto stationary solutions. FedMGDA+ is simple to implement, has fewer hyperparameters to tune, and refrains from sacrificing the performance of any participating user. We establish the convergence properties of FedMGDA+ and point out its connections to existing approaches. Extensive experiments on a variety of datasets confirm that FedMGDA+ compares favorably against state-of-the-art.
Key facts. Cited by 50 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 5; 2023: 10; 2024: 11; 2025: 13; 2026: 6.
50 papers.
Sort:
- 2021A Field Guide to Federated Optimizationcited by 312
- 2021From Distributed Machine Learning to Federated Learning: A Surveycited by 65
- 2021Federated Learning with Fair Averagingcited by 59
- 2021Towards Fairness-Aware Federated Learningcited by 57
- 2023Fair Federated Medical Image Segmentation via Client Contribution Estimationcited by 50
- 2023Recent Advances on Federated Learning: A Systematic Surveycited by 40
- 2021Enforcing fairness in private federated learning via the modified method of differential multiplierscited by 38
- 2022Proportional Fairness in Federated Learningcited by 20
- 2022One-shot Federated Learning without Server-side Trainingcited by 20
- 2023FLShield: A Validation Based Federated Learning Framework to Defend Against Poisoning Attackscited by 15
- 2025Gradient-Based Multi-Objective Deep Learning: Algorithms, Theories, Applications, and Beyondcited by 15
- 2023Optimizing Privacy, Utility and Efficiency in Constrained Multi-Objective Federated Learningcited by 12
38 more
- 2024AdaFed: Fair Federated Learning via Adaptive Common Descent Directioncited by 12
- 2024Rethinking the Representation in Federated Unsupervised Learning with Non-IID Datacited by 12
- 2023Federated Multi-Objective Learningcited by 11
- 2024FedProK: Trustworthy Federated Class-Incremental Learning via Prototypical Feature Knowledge Transfercited by 9
- 2023Accelerating Fair Federated Learning: Adaptive Federated Adamcited by 8
- 2025Federated Learning with Domain Shift Erasercited by 7
- 2024Many-Objective Multi-Solution Transportcited by 5
- 2025When Federated Learning Meets Quantum Computing: Survey and Research Opportunitiescited by 5
- 2023Entropy-driven Fair and Effective Federated Learningcited by 4
- 2024Adaptive Online Mirror Descent for Tchebycheff Scalarization in Multi-Objective Learningcited by 4
- 2025Distributed Quasi-Newton Method for Fair and Fast Federated Learningcited by 4
- 2023Bi-level Multi-objective Evolutionary Learning: A Case Study on Multi-task Graph Neural Topology Searchcited by 3
- 2024Federated Communication-Efficient Multi-Objective Optimizationcited by 3
- 2024FedDP: Privacy-preserving method based on federated learning for histopathology image segmentationcited by 3
- 2025Over-the-Air Fair Federated Learning via Multi-Objective Optimizationcited by 3
- 2025Multi-objective methods in Federated Learning: A survey and taxonomycited by 3
- 2024Federated Fairness without Access to Sensitive Groupscited by 2
- 2024Pursuing Overall Welfare in Federated Learning through Sequential Decision Makingcited by 2
- 2024A New Perspective to Boost Performance Fairness for Medical Federated Learningcited by 2
- 2024Boosting Fairness and Robustness in Over-the-Air Federated Learningcited by 1
- 2025Enhancing Convergence, Privacy and Fairness for Wireless Personalized Federated Learning: Quantization-Assisted Min-Max Fair Schedulingcited by 1
- 2022Efficient Adaptive Federated Optimization of Federated Learning for IoTcited by 0
- 2022Handling Data Heterogeneity in Federated Learning via Knowledge Distillation and Fusioncited by 0
- 2022Robust Distributed Learning Against Both Distributional Shifts and Byzantine Attackscited by 0
- 2023Hierarchical and Decentralised Federated Learningcited by 0
- 2023The Landscape of Modern Machine Learning: A Review of Machine, Distributed and Federated Learningcited by 0
- 2025FedTilt: Towards Multi-Level Fairness-Preserving and Robust Federated Learningcited by 0
- 2025Convergence-Privacy-Fairness Trade-Off in Personalized Federated Learningcited by 0
- 2025Federated Multi-Objective Learning with Controlled Pareto Frontierscited by 0
- 2025FAIRVAR: Fair Federated Learning via Variance Regularizationcited by 0
- 2025Cost-Free Personalization via Information-Geometric Projection in Bayesian Federated Learningcited by 0
- 2025DFedReweighting: A Unified Framework for Objective-Oriented Reweighting in Decentralized Federated Learningcited by 0
- 2026Few-for-Many Personalized Federated Learningcited by 0
- 2026Graph Representation Learning Augmented Model Manipulation on Federated Fine-Tuning of LLMscited by 0
- 2026Optimizing Server Placement for Vertical Federated Learning in Dynamic Edge/Fog Networkscited by 0
- 2026PMF-CL: Pareto-Minimal-Forgetting Continual Learner for Conflicting Taskscited by 0
- 2026CRAFT: Conflict-Resolved Aggregation for Federated Trainingcited by 0
- 2026Efficient Hessian-Free Methods for Multi-Objective Bilevel Optimization with Nonconvex Lower Levelcited by 0
- 2026Efficient Hessian-Free Methods for Multi-Objective Bilevel Optimization with Nonconvex Lower Level13 Aug 2026
- 2026CRAFT: Conflict-Resolved Aggregation for Federated Training20 May 2026
- 2026PMF-CL: Pareto-Minimal-Forgetting Continual Learner for Conflicting Tasks18 May 2026
- 2026Optimizing Server Placement for Vertical Federated Learning in Dynamic Edge/Fog Networks10 May 2026
- 2026Graph Representation Learning Augmented Model Manipulation on Federated Fine-Tuning of LLMs8 May 2026
- 2026Few-for-Many Personalized Federated Learning12 Mar 2026
- 2025DFedReweighting: A Unified Framework for Objective-Oriented Reweighting in Decentralized Federated Learning12 Dec 2025
- 2025Cost-Free Personalization via Information-Geometric Projection in Bayesian Federated Learning12 Sep 2025
- 2025FAIRVAR: Fair Federated Learning via Variance Regularization16 Aug 2025
- 2025Federated Multi-Objective Learning with Controlled Pareto Frontiers7 Aug 2025
- 2025Convergence-Privacy-Fairness Trade-Off in Personalized Federated Learning17 Jun 2025
- 2025Enhancing Convergence, Privacy and Fairness for Wireless Personalized Federated Learning: Quantization-Assisted Min-Max Fair Scheduling3 Jun 2025
38 more
- 2025When Federated Learning Meets Quantum Computing: Survey and Research Opportunities9 Apr 2025
- 2025Federated Learning with Domain Shift Eraser17 Mar 2025
- 2025FedTilt: Towards Multi-Level Fairness-Preserving and Robust Federated Learning15 Mar 2025
- 2025Multi-objective methods in Federated Learning: A survey and taxonomy5 Feb 2025
- 2025Gradient-Based Multi-Objective Deep Learning: Algorithms, Theories, Applications, and Beyond19 Jan 2025
- 2025Distributed Quasi-Newton Method for Fair and Fast Federated Learning18 Jan 2025
- 2025Over-the-Air Fair Federated Learning via Multi-Objective Optimization6 Jan 2025
- 2024FedDP: Privacy-preserving method based on federated learning for histopathology image segmentation7 Nov 2024
- 2024Adaptive Online Mirror Descent for Tchebycheff Scalarization in Multi-Objective Learning29 Oct 2024
- 2024Federated Communication-Efficient Multi-Objective Optimization21 Oct 2024
- 2024A New Perspective to Boost Performance Fairness for Medical Federated Learning12 Oct 2024
- 2024Pursuing Overall Welfare in Federated Learning through Sequential Decision Making31 May 2024
- 2024FedProK: Trustworthy Federated Class-Incremental Learning via Prototypical Feature Knowledge Transfer4 May 2024
- 2024Rethinking the Representation in Federated Unsupervised Learning with Non-IID Data25 Mar 2024
- 2024Boosting Fairness and Robustness in Over-the-Air Federated Learning7 Mar 2024
- 2024Many-Objective Multi-Solution Transport6 Mar 2024
- 2024Federated Fairness without Access to Sensitive Groups22 Feb 2024
- 2024AdaFed: Fair Federated Learning via Adaptive Common Descent Direction10 Jan 2024
- 2023The Landscape of Modern Machine Learning: A Review of Machine, Distributed and Federated Learning5 Dec 2023
- 2023Federated Multi-Objective Learning15 Oct 2023
- 2023FLShield: A Validation Based Federated Learning Framework to Defend Against Poisoning Attacks10 Aug 2023
- 2023Optimizing Privacy, Utility and Efficiency in Constrained Multi-Objective Federated Learning29 Apr 2023
- 2023Hierarchical and Decentralised Federated Learning28 Apr 2023
- 2023Fair Federated Medical Image Segmentation via Client Contribution Estimation29 Mar 2023
- 2023Bi-level Multi-objective Evolutionary Learning: A Case Study on Multi-task Graph Neural Topology Search6 Feb 2023
- 2023Entropy-driven Fair and Effective Federated Learning29 Jan 2023
- 2023Accelerating Fair Federated Learning: Adaptive Federated Adam23 Jan 2023
- 2023Recent Advances on Federated Learning: A Systematic Survey3 Jan 2023
- 2022Robust Distributed Learning Against Both Distributional Shifts and Byzantine Attacks29 Oct 2022
- 2022Handling Data Heterogeneity in Federated Learning via Knowledge Distillation and Fusion23 Jul 2022
- 2022Efficient Adaptive Federated Optimization of Federated Learning for IoT23 Jun 2022
- 2022One-shot Federated Learning without Server-side Training26 Apr 2022
- 2022Proportional Fairness in Federated Learning3 Feb 2022
- 2021Towards Fairness-Aware Federated Learning2 Nov 2021
- 2021Enforcing fairness in private federated learning via the modified method of differential multipliers17 Sep 2021
- 2021A Field Guide to Federated Optimization14 Jul 2021
- 2021Federated Learning with Fair Averaging30 Apr 2021
- 2021From Distributed Machine Learning to Federated Learning: A Survey29 Apr 2021
- 2021A Field Guide to Federated Optimizationcited by 312
- 2021From Distributed Machine Learning to Federated Learning: A Surveycited by 65
- 2021Federated Learning with Fair Averagingcited by 59
- 2021Towards Fairness-Aware Federated Learningcited by 57
- 2023Fair Federated Medical Image Segmentation via Client Contribution Estimationcited by 50
- 2023Recent Advances on Federated Learning: A Systematic Surveycited by 40
- 2021Enforcing fairness in private federated learning via the modified method of differential multiplierscited by 38
- 2022Proportional Fairness in Federated Learningcited by 20
- 2022One-shot Federated Learning without Server-side Trainingcited by 20
- 2023FLShield: A Validation Based Federated Learning Framework to Defend Against Poisoning Attackscited by 15
- 2025Gradient-Based Multi-Objective Deep Learning: Algorithms, Theories, Applications, and Beyondcited by 15
- 2023Optimizing Privacy, Utility and Efficiency in Constrained Multi-Objective Federated Learningcited by 12
12 most cited of 50 All 50 (JSON)
- 2026Efficient Hessian-Free Methods for Multi-Objective Bilevel Optimization with Nonconvex Lower Level13 Aug 2026
- 2026CRAFT: Conflict-Resolved Aggregation for Federated Training20 May 2026
- 2026PMF-CL: Pareto-Minimal-Forgetting Continual Learner for Conflicting Tasks18 May 2026
- 2026Optimizing Server Placement for Vertical Federated Learning in Dynamic Edge/Fog Networks10 May 2026
- 2026Graph Representation Learning Augmented Model Manipulation on Federated Fine-Tuning of LLMs8 May 2026
- 2026Few-for-Many Personalized Federated Learning12 Mar 2026
- 2025DFedReweighting: A Unified Framework for Objective-Oriented Reweighting in Decentralized Federated Learning12 Dec 2025
- 2025Cost-Free Personalization via Information-Geometric Projection in Bayesian Federated Learning12 Sep 2025
- 2025FAIRVAR: Fair Federated Learning via Variance Regularization16 Aug 2025
- 2025Federated Multi-Objective Learning with Controlled Pareto Frontiers7 Aug 2025
- 2025Convergence-Privacy-Fairness Trade-Off in Personalized Federated Learning17 Jun 2025
- 2025Enhancing Convergence, Privacy and Fairness for Wireless Personalized Federated Learning: Quantization-Assisted Min-Max Fair Scheduling3 Jun 2025
12 newest of 50 All 50 (JSON)