Flow: Per-Instance Personalized Federated Learning Through Dynamic Routing
Not on the map. Why?
Abstract (arXiv)
Personalization in Federated Learning (FL) aims to modify a collaboratively trained global model according to each client. Current approaches to personalization in FL are at a coarse granularity, i.e. all the input instances of a client use the same personalized model. This ignores the fact that some instances are more accurately handled by the global model due to better generalizability. To address this challenge, this work proposes Flow, a fine-grained stateless personalized FL approach. Flow creates dynamic personalized models by learning a routing mechanism that determines whether an input instance prefers the local parameters or its global counterpart. Thus, Flow introduces per-instance routing in addition to leveraging per-client personalization to improve accuracies at each client. Further, Flow is stateless which makes it unnecessary for a client to retain its personalized state across FL rounds. This makes Flow practical for large-scale FL settings and friendly to newly joined clients. Evaluations on Stackoverflow, Reddit, and EMNIST datasets demonstrate the superiority in prediction accuracy of Flow over state-of-the-art non-personalized and only per-client personalized approaches to FL.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 34 of its 48 references that are in the map. First posted on arXiv 28 Nov 2022.
Builds on
34 of 48 references.
References · 34
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
- 2018Federated Optimization in Heterogeneous Networkscited by 2,987
- 2018DARTS: Differentiable Architecture Searchcited by 1,798
- 2019Federated Learning: Challenges, Methods, and Future Directionscited by 1,538
- 2020Adaptive Federated Optimizationcited by 1,046
- 2020Tackling the Objective Inconsistency Problem in Heterogeneous Federated Optimizationcited by 906
- 2020Ditto: Fair and Robust Federated Learning Through Personalizationcited by 672
- 2020Personalized Federated Learning with Moreau Envelopescited by 618
- 2017BranchyNet: Fast Inference via Early Exiting from Deep Neural Networkscited by 596
- 2021Exploiting Shared Representations for Personalized Federated Learningcited by 541
- 2019Federated Learning with Differential Privacy: Algorithms and Performance Analysiscited by 536
22 more
- 2021Towards Personalized Federated Learningcited by 464
- 2020Flower: A Friendly Federated Learning Research Frameworkcited by 455
- 2020Adaptive Personalized Federated Learningcited by 358
- 2017SkipNet: Learning Dynamic Routing in Convolutional Networkscited by 332
- 2020Think Locally, Act Globally: Federated Learning with Local and Global Representationscited by 325
- 2020Three Approaches for Personalization with Applications to Federated Learningcited by 325
- 2019Searching for A Robust Neural Architecture in Four GPU Hourscited by 260
- 2021Personalized Federated Learning using Hypernetworkscited by 212
- 2021FedBABU: Towards Enhanced Representation for Federated Image Classificationcited by 182
- 2017Adaptive Neural Networks for Efficient Inferencecited by 163
- 2020Minibatch vs Local SGD for Heterogeneous Distributed Learningcited by 147
- 2022Federated Learning with Partial Model Personalizationcited by 114
- 2021Tackling System and Statistical Heterogeneity for Federated Learning with Adaptive Client Samplingcited by 66
- 2020A Framework for Evaluating Gradient Leakage Attacks in Federated Learningcited by 64
- 2017Dynamic Deep Neural Networks: Optimizing Accuracy-Efficiency Trade-offs by Selective Executioncited by 59
- 2021Personalized Federated Learning through Local Memorizationcited by 57
- 2022FedAvg with Fine Tuning: Local Updates Lead to Representation Learningcited by 56
- 2021Gradient-Leakage Resilient Federated Learningcited by 40
- 2022Federated Learning under Distributed Concept Driftcited by 36
- 2021Source Inference Attacks in Federated Learningcited by 34
- 2022Motley: Benchmarking Heterogeneity and Personalization in Federated Learningcited by 31
- 2017Neural Speed Reading via Skim-RNNcited by 14
Built on by
Citing papers per year: 2024: 3; 2025: 2; 2026: 1.
6 papers.
- 2024Automated Federated Pipeline for Parameter-Efficient Fine-Tuning of Large Language Modelscited by 49
- 2025HSplitLoRA: A Heterogeneous Split Parameter-Efficient Fine-Tuning Framework for Large Language Modelscited by 31
- 2024DualGFL: Federated Learning with a Dual-Level Coalition-Auction Gamecited by 5
- 2024FedHPL: Efficient Heterogeneous Federated Learning with Prompt Tuning and Logit Distillationcited by 3
- 2025Personalized Subgraph Federated Learning with Sheaf Collaborationcited by 1
- 2026From Data Heterogeneity to Convergence: A Data-Centric Review of Federated Learningcited by 0
- 2026From Data Heterogeneity to Convergence: A Data-Centric Review of Federated Learning9 Jun 2026
- 2025Personalized Subgraph Federated Learning with Sheaf Collaboration19 Aug 2025
- 2025HSplitLoRA: A Heterogeneous Split Parameter-Efficient Fine-Tuning Framework for Large Language Models5 May 2025
- 2024DualGFL: Federated Learning with a Dual-Level Coalition-Auction Game20 Dec 2024
- 2024FedHPL: Efficient Heterogeneous Federated Learning with Prompt Tuning and Logit Distillation27 May 2024
- 2024Automated Federated Pipeline for Parameter-Efficient Fine-Tuning of Large Language Models9 Apr 2024