Choice Outweighs Effort: Facilitating Complementary Knowledge Fusion in Federated Learning via Re-calibration and Merit-discrimination
Not on the map. Why?
Abstract (arXiv)
Cross-client data heterogeneity in federated learning induces biases that impede unbiased consensus condensation and the complementary fusion of generalization- and personalization-oriented knowledge. While existing approaches mitigate heterogeneity through model decoupling and representation center loss, they often rely on static and restricted metrics to evaluate local knowledge and adopt global alignment too rigidly, leading to consensus distortion and diminished model adaptability. To address these limitations, we propose FedMate, a method that implements bilateral optimization: On the server side, we construct a dynamic global prototype, with aggregation weights calibrated by holistic integration of sample size, current parameters, and future prediction; a category-wise classifier is then fine-tuned using this prototype to preserve global consistency. On the client side, we introduce complementary classification fusion to enable merit-based discrimination training and incorporate cost-aware feature transmission to balance model performance and communication efficiency. Experiments on five datasets of varying complexity demonstrate that FedMate outperforms state-of-the-art methods in harmonizing generalization and adaptation. Additionally, semantic segmentation experiments on autonomous driving datasets validate the method's real-world scalability.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 23 of its 38 references that are in the map. First posted on arXiv 25 Aug 2025.
Builds on
23 of 38 references.
References · 23
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2018Federated Optimization in Heterogeneous Networkscited by 2,971
- 2024VMamba: Visual State Space Modelcited by 955
- 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 860
- 2021Model-Contrastive Federated Learningcited by 762
- 2020Ditto: Fair and Robust Federated Learning Through Personalizationcited by 665
- 2021Exploiting Shared Representations for Personalized Federated Learningcited by 537
- 2019Federated Learning with Personalization Layerscited by 533
- 2019FedMD: Heterogenous Federated Learning via Model Distillationcited by 454
- 2020Adaptive Personalized Federated Learningcited by 353
- 2021FedProto: Federated Prototype Learning across Heterogeneous Clientscited by 349
11 more
- 2020Think Locally, Act Globally: Federated Learning with Local and Global Representationscited by 322
- 2020Personalized Cross-Silo Federated Learning on Non-IID Datacited by 282
- 2023Heterogeneous Federated Learning: State-of-the-art and Research Challengescited by 160
- 2022Federated Learning from Pre-Trained Models: A Contrastive Learning Approachcited by 141
- 2022Federated Learning with Partial Model Personalizationcited by 114
- 2023Multimodal Federated Learning via Contrastive Representation Ensemblecited by 85
- 2021FedGEMS: Federated Learning of Larger Server Models via Selective Knowledge Fusioncited by 49
- 2022FedFA: Federated Learning with Feature Anchors to Align Features and Classifiers for Heterogeneous Datacited by 49
- 2023Bold but Cautious: Unlocking the Potential of Personalized Federated Learning through Cautiously Aggressive Collaborationcited by 23
- 2025Communication-Efficient Language Model Training Scales Reliably and Robustly: Scaling Laws for DiLoCocited by 23
- 2024Decoupling General and Personalized Knowledge in Federated Learning via Additive and Low-Rank Decompositioncited by 15
Built on by
Citing papers per year: 2025: 1.
1 paper.