mlsanityData to 14 Oct 2026

When Is Shallow Enough? Adaptive Split Federated Learning with Client-Specific Sufficiency Estimation

arXiv 2608.15639 ↗First posted 16 Aug 2026cs.DC cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

textitSplit Federated Learning (SFL) enables distributed model training by splitting networks between the server and clients. However, under client heterogeneity, the conventional static split strategy may be suboptimal because clients can differ in data distributions, adaptation dynamics, and representation learning progress, making a single split point insufficient to accommodate client-specific training states. In this paper, we propose textscFedSGA, a Sufficiency-Guided Adaptive split Federated learning framework that addresses this question through client-specific shallow sufficiency estimation. First, we introduce a client-specific adaptation channel based on private prompt tokens, which tracks local adaptation dynamics separately from the shared backbone and provides a lightweight signal for detecting whether client adaptation remains active. To further avoid repeated online probing over multiple candidate depths, we design a shallow sufficiency estimator that combines cross-client semantic alignment, temporal interface stability, and prompt-state variation to estimate whether the shallowest split is already sufficient. Finally, we introduce a split-compatible interface harmonization module that projects activations from different split depths into a shared semantic space, improving the comparability of heterogeneous client interfaces before server-side prediction. Extensive experiments on multiple heterogeneous benchmarks demonstrate the effectiveness of textscFedSGA in improving model performance compared with state-of-the-art methods while reducing unnecessary client-side computation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 59 references that are in the map. First posted on arXiv 16 Aug 2026.

Builds on

25 of 59 references.

References · 25

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  4. 2018Federated Optimization in Heterogeneous Networkscited by 2,987
  5. 2018Moment Matching for Multi-Source Domain Adaptationcited by 1,331
  6. 2020SplitFed: When Federated Learning Meets Split Learningcited by 310
  7. 2024AdaptSFL: Adaptive Split Federated Learning in Resource-constrained Edge Networkscited by 64
  8. 2023FedGH: Heterogeneous Federated Learning with Generalized Global Headercited by 56
  9. 2022Learning Across Domains and Devices: Style-Driven Source-Free Domain Adaptation in Clustered Federated Learningcited by 35
  10. 2024Fair Federated Learning under Domain Skew with Local Consistency and Domain Diversitycited by 30
  11. 2024Taming Cross-Domain Representation Variance in Federated Prototype Learning with Heterogeneous Data Domainscited by 28
  12. 2023MergeSFL: Split Federated Learning with Feature Merging and Batch Size Regulationcited by 13
13 more
  1. 2023FedCiR: Client-Invariant Representation Learning for Federated Non-IID Featurescited by 12
  2. 2024Multi-Source Collaborative Gradient Discrepancy Minimization for Federated Domain Generalizationcited by 12
  3. 2024ParallelSFL: A Novel Split Federated Learning Framework Tackling Heterogeneity Issuescited by 10
  4. 2025Federated Learning with Domain Shift Erasercited by 7
  5. 2025Towards Straggler-Resilient Split Federated Learning: An Unbalanced Update Approachcited by 7
  6. 2023Multi-Source to Multi-Target Decentralized Federated Domain Adaptationcited by 6
  7. 2023UFDA: Universal Federated Domain Adaptation with Practical Assumptionscited by 5
  8. 2024R-SFLLM: Jamming Resilient Framework for Split Federated Learning with Large Language Modelscited by 5
  9. 2025FedAlign: Federated Domain Generalization with Cross-Client Feature Alignmentcited by 5
  10. 2023Robust and Communication-Efficient Federated Domain Adaptation via Random Featurescited by 4
  11. 2024Breaking the Memory Wall for Heterogeneous Federated Learning via Model Splittingcited by 4
  12. 2025Ampere: Communication-Efficient and High-Accuracy Split Federated Learningcited by 2
  13. 2026SplitFT: An Adaptive Federated Split Learning System For LLMs Fine-Tuningcited by 1

Built on by

Not cited yet.