FedDAR: Federated Domain-Aware Representation Learning
Not on the map. Why?
Abstract (arXiv)
Cross-silo Federated learning (FL) has become a promising tool in machine learning applications for healthcare. It allows hospitals/institutions to train models with sufficient data while the data is kept private. To make sure the FL model is robust when facing heterogeneous data among FL clients, most efforts focus on personalizing models for clients. However, the latent relationships between clients' data are ignored. In this work, we focus on a special non-iid FL problem, called Domain-mixed FL, where each client's data distribution is assumed to be a mixture of several predefined domains. Recognizing the diversity of domains and the similarity within domains, we propose a novel method, FedDAR, which learns a domain shared representation and domain-wise personalized prediction heads in a decoupled manner. For simplified linear regression settings, we have theoretically proved that FedDAR enjoys a linear convergence rate. For general settings, we have performed intensive empirical studies on both synthetic and real-world medical datasets which demonstrate its superiority over prior FL methods.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 49 of its 70 references that are in the map. First posted on arXiv 8 Sep 2022.
Builds on
49 of 70 references.
References · 49
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2019Advances and Open Problems in Federated Learningcited by 3,021
- 2016Equality of Opportunity in Supervised Learningcited by 2,000
- 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,906
- 2019Federated Learning: Challenges, Methods, and Future Directionscited by 1,531
- 2017Federated Multi-Task Learningcited by 669
- 2020Ditto: Fair and Robust Federated Learning Through Personalizationcited by 665
- 2020The Future of Digital Health with Federated Learningcited by 625
- 2020Personalized Federated Learning with Moreau Envelopescited by 612
- 2021FedBN: Federated Learning on Non-IID Features via Local Batch Normalizationcited by 565
- 2021Exploiting Shared Representations for Personalized Federated Learningcited by 537
37 more
- 2019Federated Learning with Personalization Layerscited by 533
- 2020An Efficient Framework for Clustered Federated Learningcited by 505
- 2019Clustered Federated Learning: Model-Agnostic Distributed Multi-Task Optimization under Privacy Constraintscited by 499
- 2019Agnostic Federated Learningcited by 451
- 2019Fair Resource Allocation in Federated Learningcited by 389
- 2020Adaptive Personalized Federated Learningcited by 353
- 2020Think Locally, Act Globally: Federated Learning with Local and Global Representationscited by 322
- 2020Three Approaches for Personalization with Applications to Federated Learningcited by 321
- 2020Personalized Federated Learning: A Meta-Learning Approachcited by 309
- 2020Personalized Cross-Silo Federated Learning on Non-IID Datacited by 282
- 2019Improving Federated Learning Personalization via Model Agnostic Meta Learningcited by 264
- 2021Personalized Federated Learning using Hypernetworkscited by 210
- 2020Federated Learning of a Mixture of Global and Local Modelscited by 208
- 2019Adaptive Gradient-Based Meta-Learning Methodscited by 183
- 2020Provable Meta-Learning of Linear Representationscited by 161
- 2019Federated Evaluation of On-device Personalizationcited by 147
- 2019Identifying and Correcting Label Bias in Machine Learningcited by 146
- 2019Inherent Tradeoffs in Learning Fair Representationscited by 144
- 2020Salvaging Federated Learning by Local Adaptationcited by 142
- 2020Lower Bounds and Optimal Algorithms for Personalized Federated Learningcited by 122
- 2020FairBatch: Batch Selection for Model Fairnesscited by 99
- 2019FairFace: Face Attribute Dataset for Balanced Race, Gender, and Agecited by 87
- 2020Fairness-aware Agnostic Federated Learningcited by 87
- 2020Continuously Indexed Domain Adaptationcited by 74
- 2016Decentralized Collaborative Learning of Personalized Models over Networkscited by 73
- 2019Variational Federated Multi-Task Learningcited by 69
- 2021Personalized Federated Learning through Local Memorizationcited by 57
- 2021Addressing Algorithmic Disparity and Performance Inconsistency in Federated Learningcited by 50
- 2022Closing the Generalization Gap of Cross-silo Federated Medical Image Segmentationcited by 41
- 2021Improving Fairness via Federated Learningcited by 39
- 2019The reliability of a deep learning model in clinical out-of-distribution MRI data: a multicohort studycited by 38
- 2021Enforcing fairness in private federated learning via the modified method of differential multiplierscited by 38
- 2019Fully Decentralized Joint Learning of Personalized Models and Collaboration Graphscited by 34
- 2021Training for the Future: A Simple Gradient Interpolation Loss to Generalize Along Timecited by 27
- 2021Training Fair Models in Federated Learning without Data Privacy Infringementcited by 26
- 2017The importance of stain normalization in colorectal tissue classification with convolutional networkscited by 20
- 2021Federating for Learning Group Fair Modelscited by 9
Built on by
Citing papers per year: 2023: 3; 2024: 2; 2025: 1; 2026: 2.
8 papers.
- 2024Federated Representation Learning in the Under-Parameterized Regimecited by 7
- 2023PPFL: A Personalized Federated Learning Framework for Heterogeneous Populationcited by 1
- 2024Federated Learning in Healthcare: Model Misconducts, Security, Challenges, Applications, and Future Research Directions -- A Systematic Reviewcited by 1
- 2025DBA-DFL: Towards Distributed Backdoor Attacks with Network Detection in Decentralized Federated Learningcited by 1
- 2026FedCCA: Client-Centric Adaptation against Data Heterogeneity in Federated Learning on IoT Devicescited by 1
- 2023Global Layers: Non-IID Tabular Federated Learningcited by 0
- 2023FedL2P: Federated Learning to Personalizecited by 0
- 2026FedRD: Reducing Divergences for Generalized Federated Learning via Heterogeneity-aware Parameter Guidancecited by 0
- 2026FedRD: Reducing Divergences for Generalized Federated Learning via Heterogeneity-aware Parameter Guidance28 Jan 2026
- 2026FedCCA: Client-Centric Adaptation against Data Heterogeneity in Federated Learning on IoT Devices25 Jan 2026
- 2025DBA-DFL: Towards Distributed Backdoor Attacks with Network Detection in Decentralized Federated Learning25 Jan 2025
- 2024Federated Representation Learning in the Under-Parameterized Regime7 Jun 2024
- 2024Federated Learning in Healthcare: Model Misconducts, Security, Challenges, Applications, and Future Research Directions -- A Systematic Review22 May 2024
- 2023PPFL: A Personalized Federated Learning Framework for Heterogeneous Population22 Oct 2023
- 2023FedL2P: Federated Learning to Personalize3 Oct 2023
- 2023Global Layers: Non-IID Tabular Federated Learning29 May 2023