FedADB: Class Anchor-Driven Dual-Branch Federated Learning for Mitigating Forgetting
Not on the map. Why?
Abstract (arXiv)
Multimodal data collected by heterogeneous devices are used for collaborative training, where federated learning (FL) serves as a key paradigm for effective distributed modeling with data privacy preservation. However, local training suffers from the forgetting of previously learned global knowledge under cross-client data heterogeneity, which leads to significant declines in both performance and convergence speed. Most previous studies rely on global alignment strategies to retain global knowledge, which hinder local optimization and lead to inadequate supervision of missing classes. Some studies introduce proxy datasets to supplement supervision for missing classes. However, it remains a challenge to balance class-wise global consistency and local optimization objectives without proxy datasets. In this work, we propose FedADB, a Class Anchor-Driven Dual-Branch FL framework. Specifically, the server generates class anchors optimized in a differentiable input space, which are shared across clients. These class anchors serve as global references that provide supervision for missing classes during local training. A dual-branch collaborative training mechanism is designed for clients. In this mechanism, the anchor-based global branch focuses on learning with global consistency, achieving global knowledge alignment by class-anchor balanced sampling. The local calibration branch focuses on learning discriminative local features, mitigating the degradation of local representations caused by excessive global alignment. Extensive experiments across multiple medical and natural datasets demonstrate that FedADB achieves significant improvements in both accuracy and convergence speed.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 35 of its 62 references that are in the map. First posted on arXiv 15 Aug 2026.
Builds on
35 of 62 references.
References · 35
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
- 2018Federated Optimization in Heterogeneous Networkscited by 2,987
- 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,616
- 2016Federated Learning: Strategies for Improving Communication Efficiencycited by 1,475
- 2019Measuring the Effects of Non-Identical Data Distribution for Federated Visual Classificationcited by 851
- 2021Model-Contrastive Federated Learningcited by 766
- 2020Personalized Federated Learning with Moreau Envelopescited by 618
- 2021Federated Learning on Non-IID Data Silos: An Experimental Studycited by 568
- 2021Federated Learning Based on Dynamic Regularizationcited by 562
- 2021Exploiting Shared Representations for Personalized Federated Learningcited by 541
- 2021Data-Free Knowledge Distillation for Heterogeneous Federated Learningcited by 383
23 more
- 2021Federated Learning on Non-IID Data: A Surveycited by 346
- 2020Personalized Cross-Silo Federated Learning on Non-IID Datacited by 283
- 2021Achieving Linear Speedup with Partial Worker Participation in Non-IID Federated Learningcited by 193
- 2019Overcoming Forgetting in Federated Learning on Non-IID Datacited by 120
- 2020Robust Federated Learning: The Case of Affine Distribution Shiftscited by 102
- 2022Improving Generalization in Federated Learning by Seeking Flat Minimacited by 98
- 2023FedExP: Speeding Up Federated Averaging via Extrapolationcited by 69
- 2025Empowering Edge Intelligence: A Comprehensive Survey on On-Device AI Modelscited by 46
- 2022FedBR: Improving Federated Learning on Heterogeneous Data via Local Learning Bias Reductioncited by 35
- 2023GradMA: A Gradient-Memory-based Accelerated Federated Learning with Alleviated Catastrophic Forgettingcited by 27
- 2022Exploring the Distributed Knowledge Congruence in Proxy-data-free Federated Distillationcited by 22
- 2025FedAWA: Adaptive Optimization of Aggregation Weights in Federated Learning Using Client Vectorscited by 19
- 2023A Simple Data Augmentation for Feature Distribution Skewed Federated Learningcited by 17
- 2023FedSOL: Stabilized Orthogonal Learning with Proximal Restrictions in Federated Learningcited by 14
- 2024Multi-level Personalized Federated Learning on Heterogeneous and Long-Tailed Datacited by 14
- 2023Is Aggregation the Only Choice? Federated Learning via Layer-wise Model Recombinationcited by 13
- 2024Federated Learning with Bilateral Curation for Partially Class-Disjoint Datacited by 13
- 2024Cross-silo Federated Learning with Record-level Personalized Differential Privacycited by 9
- 2024Free-Rider and Conflict Aware Collaboration Formation for Cross-Silo Federated Learningcited by 9
- 2024Federated Learning with Label-Masking Distillationcited by 7
- 2024Flashback: Understanding and Mitigating Forgetting in Federated Learningcited by 4
- 2024FedDistill: Global Model Distillation for Local Model De-Biasing in Non-IID Federated Learningcited by 4
- 2023Towards Fast and Stable Federated Learning: Confronting Heterogeneity via Knowledge Anchorcited by 3
Built on by
Not cited yet.