SubFLOT: Submodel Extraction for Efficient and Personalized Federated Learning via Optimal Transport
Not on the map. Why?
Abstract (arXiv)
Federated Learning (FL) enables collaborative model training while preserving data privacy, but its practical deployment is hampered by system and statistical heterogeneity. While federated network pruning offers a path to mitigate these issues, existing methods face a critical dilemma: server-side pruning lacks personalization, whereas client-side pruning is computationally prohibitive for resource-constrained devices. Furthermore, the pruning process itself induces significant parametric divergence among heterogeneous submodels, destabilizing training and hindering global convergence. To address these challenges, we propose SubFLOT, a novel framework for server-side personalized federated pruning. SubFLOT introduces an Optimal Transport-enhanced Pruning (OTP) module that treats historical client models as proxies for local data distributions, formulating the pruning task as a Wasserstein distance minimization problem to generate customized submodels without accessing raw data. Concurrently, to counteract parametric divergence, our Scaling-based Adaptive Regularization (SAR) module adaptively penalizes a submodel's deviation from the global model, with the penalty's strength scaled by the client's pruning rate. Comprehensive experiments demonstrate that SubFLOT consistently and substantially outperforms state-of-the-art methods, underscoring its potential for deploying efficient and personalized models on resource-constrained edge devices.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 28 of its 46 references that are in the map. First posted on arXiv 8 Apr 2026.
Builds on
28 of 46 references.
References · 28
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
- 2015Character-level Convolutional Networks for Text Classificationcited by 2,330
- 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,262
- 2019On the Convergence of FedAvg on Non-IID Datacited by 1,229
- 2016Bag of Tricks for Efficient Text Classificationcited by 876
- 2020Personalized Federated Learning with Moreau Envelopescited by 618
- 2017A Downsampled Variant of ImageNet as an Alternative to the CIFAR datasetscited by 377
- 2020HeteroFL: Computation and Communication Efficient Federated Learning for Heterogeneous Clientscited by 337
16 more
- 2020Personalized Federated Learning: A Meta-Learning Approachcited by 312
- 2020Personalized Cross-Silo Federated Learning on Non-IID Datacited by 283
- 2019Model Fusion via Optimal Transportcited by 219
- 2018DeepJDOT: Deep Joint Distribution Optimal Transport for Unsupervised Domain Adaptationcited by 214
- 2020Personalized Federated Learning with First Order Model Optimizationcited by 201
- 2018Expanding the Reach of Federated Learning by Reducing Client Resource Requirementscited by 163
- 2021Unbalanced minibatch Optimal Transport; applications to Domain Adaptationcited by 125
- 2022FedRolex: Model-Heterogeneous Federated Learning with Rolling Sub-Model Extractioncited by 102
- 2023Efficient Model Personalization in Federated Learning via Client-Specific Prompt Generationcited by 54
- 2024Global and Local Prompts Cooperation via Optimal Transport for Federated Learningcited by 46
- 2023Eliminating Domain Bias for Federated Learning in Representation Spacecited by 38
- 2023FedCP: Separating Feature Information for Personalized Federated Learning via Conditional Policycited by 36
- 2022PACS: A Dataset for Physical Audiovisual CommonSense Reasoningcited by 18
- 2024FedP3: Federated Personalized and Privacy-friendly Network Pruning under Model Heterogeneitycited by 13
- 2023AdaptiveFL: Adaptive Heterogeneous Federated Learning for Resource-Constrained AIoT Systemscited by 9
- 2024FlexFL: Heterogeneous Federated Learning via APoZ-Guided Flexible Pruning in Uncertain Scenarioscited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.