Federated Residual Learning
Not on the map. Why?
Abstract (arXiv)
We study a new form of federated learning where the clients train personalized local models and make predictions jointly with the server-side shared model. Using this new federated learning framework, the complexity of the central shared model can be minimized while still gaining all the performance benefits that joint training provides. Our framework is robust to data heterogeneity, addressing the slow convergence problem traditional federated learning methods face when the data is non-i.i.d. across clients. We test the theory empirically and find substantial performance gains over baselines.
Key facts. Cited by 23 papers in the map (data through 14 Oct 2026). First posted on arXiv 28 Mar 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 6; 2023: 5; 2024: 0; 2025: 2.
23 papers.
Sort:
By area:
- 2022Federated Learning with Partial Model Personalizationcited by 114
- 2021Federated Multi-armed Bandits with Personalizationcited by 62
- 2021What Do We Mean by Generalization in Federated Learning?cited by 62
- 2021Federated Linear Contextual Banditscited by 61
- 2021Federated Multi-Armed Banditscited by 59
- 2021Sharp Bounds for Federated Averaging (Local SGD) and Continuous Perspectivecited by 38
- 2022On Privacy and Personalization in Cross-Silo Federated Learningcited by 36
- 2021Personalized Federated Learning: A Unified Framework and Universal Optimization Techniquescited by 34
- 2023Privacy and Fairness in Federated Learning: on the Perspective of Trade-offcited by 26
- 2022Personalization Improves Privacy-Accuracy Tradeoffs in Federated Learningcited by 23
- 2021On Bridging Generic and Personalized Federated Learning for Image Classificationcited by 15
- 2021Private Multi-Task Learning: Formulation and Applications to Federated Learningcited by 11
11 more
- 2021Communication-Efficient Agnostic Federated Averagingcited by 10
- 2021Practical and Secure Federated Recommendation with Personalized Maskscited by 7
- 2023Federated Learning of Shareable Bases for Personalization-Friendly Image Classificationcited by 6
- 2022Multi-Model Federated Learning with Provable Guaranteescited by 5
- 2022Federated Online Sparse Decision Makingcited by 3
- 2025pMixFed: Efficient Personalized Federated Learning through Adaptive Layer-Wise Mixupcited by 3
- 2023Federated Learning for Heterogeneous Bandits with Unobserved Contextscited by 1
- 2023Harnessing the Power of Federated Learning in Federated Contextual Banditscited by 1
- 2022Vertical Federated Linear Contextual Banditscited by 0
- 2023Federated Offline Policy Learningcited by 0
- 2025Addressing the Collaboration Dilemma in Low-Data Federated Learning via Transient Sparsitycited by 0
- 2025Addressing the Collaboration Dilemma in Low-Data Federated Learning via Transient Sparsity1 Jun 2025
- 2025pMixFed: Efficient Personalized Federated Learning through Adaptive Layer-Wise Mixup19 Jan 2025
- 2023Harnessing the Power of Federated Learning in Federated Contextual Bandits26 Dec 2023
- 2023Privacy and Fairness in Federated Learning: on the Perspective of Trade-off25 Jun 2023
- 2023Federated Offline Policy Learning21 May 2023
- 2023Federated Learning of Shareable Bases for Personalization-Friendly Image Classification16 Apr 2023
- 2023Federated Learning for Heterogeneous Bandits with Unobserved Contexts29 Mar 2023
- 2022Vertical Federated Linear Contextual Bandits20 Oct 2022
- 2022Multi-Model Federated Learning with Provable Guarantees9 Jul 2022
- 2022On Privacy and Personalization in Cross-Silo Federated Learning16 Jun 2022
- 2022Federated Learning with Partial Model Personalization8 Apr 2022
- 2022Federated Online Sparse Decision Making27 Feb 2022
11 more
- 2022Personalization Improves Privacy-Accuracy Tradeoffs in Federated Learning10 Feb 2022
- 2021Sharp Bounds for Federated Averaging (Local SGD) and Continuous Perspective5 Nov 2021
- 2021What Do We Mean by Generalization in Federated Learning?27 Oct 2021
- 2021Federated Linear Contextual Bandits27 Oct 2021
- 2021Private Multi-Task Learning: Formulation and Applications to Federated Learning30 Aug 2021
- 2021Practical and Secure Federated Recommendation with Personalized Masks18 Aug 2021
- 2021On Bridging Generic and Personalized Federated Learning for Image Classification2 Jul 2021
- 2021Communication-Efficient Agnostic Federated Averaging6 Apr 2021
- 2021Federated Multi-armed Bandits with Personalization25 Feb 2021
- 2021Personalized Federated Learning: A Unified Framework and Universal Optimization Techniques19 Feb 2021
- 2021Federated Multi-Armed Bandits28 Jan 2021
- 2023Federated Offline Policy Learningcited by 0
- 2023Federated Offline Policy Learning21 May 2023
- 2022Federated Learning with Partial Model Personalizationcited by 114
- 2021Federated Multi-armed Bandits with Personalizationcited by 62
- 2021What Do We Mean by Generalization in Federated Learning?cited by 62
- 2021Federated Linear Contextual Banditscited by 61
- 2021Federated Multi-Armed Banditscited by 59
- 2021Sharp Bounds for Federated Averaging (Local SGD) and Continuous Perspectivecited by 38
- 2022On Privacy and Personalization in Cross-Silo Federated Learningcited by 36
- 2021Personalized Federated Learning: A Unified Framework and Universal Optimization Techniquescited by 34
- 2023Privacy and Fairness in Federated Learning: on the Perspective of Trade-offcited by 26
- 2022Personalization Improves Privacy-Accuracy Tradeoffs in Federated Learningcited by 23
- 2021On Bridging Generic and Personalized Federated Learning for Image Classificationcited by 15
- 2021Private Multi-Task Learning: Formulation and Applications to Federated Learningcited by 11
12 most cited of 22 All 22 (JSON)
- 2025Addressing the Collaboration Dilemma in Low-Data Federated Learning via Transient Sparsity1 Jun 2025
- 2025pMixFed: Efficient Personalized Federated Learning through Adaptive Layer-Wise Mixup19 Jan 2025
- 2023Harnessing the Power of Federated Learning in Federated Contextual Bandits26 Dec 2023
- 2023Privacy and Fairness in Federated Learning: on the Perspective of Trade-off25 Jun 2023
- 2023Federated Learning of Shareable Bases for Personalization-Friendly Image Classification16 Apr 2023
- 2023Federated Learning for Heterogeneous Bandits with Unobserved Contexts29 Mar 2023
- 2022Vertical Federated Linear Contextual Bandits20 Oct 2022
- 2022Multi-Model Federated Learning with Provable Guarantees9 Jul 2022
- 2022On Privacy and Personalization in Cross-Silo Federated Learning16 Jun 2022
- 2022Federated Learning with Partial Model Personalization8 Apr 2022
- 2022Federated Online Sparse Decision Making27 Feb 2022
- 2022Personalization Improves Privacy-Accuracy Tradeoffs in Federated Learning10 Feb 2022
12 newest of 22 All 22 (JSON)