mlsanityData to 7 Oct 2026

DriftGuard: Mitigating Asynchronous Data Drift in Federated Learning

arXiv 2603.18872 ↗First posted 19 Mar 2026cs.LGcited by 0

On the map: Mixture-of-experts → Federated mixture-of-experts

Abstract (arXiv)

In real-world Federated Learning (FL) deployments, data distributions on devices that participate in training evolve over time. This leads to asynchronous data drift, where different devices shift at different times and toward different distributions. Mitigating such drift is challenging: frequent retraining incurs high computational cost on resource-constrained devices, while infrequent retraining degrades performance on drifting devices. We propose DriftGuard, a federated continual learning framework that efficiently adapts to asynchronous data drift. DriftGuard adopts a Mixture-of-Experts (MoE) inspired architecture that separates shared parameters, which capture globally transferable knowledge, from local parameters that adapt to group-specific distributions. This design enables two complementary retraining strategies: (i) global retraining, which updates the shared parameters when system-wide drift is identified, and (ii) group retraining, which selectively updates local parameters for clusters of devices identified via MoE gating patterns, without sharing raw data. Experiments across multiple datasets and models show that DriftGuard matches or exceeds state-of-the-art accuracy while reducing total retraining cost by up to 83%. As a result, it achieves the highest accuracy per unit retraining cost, improving over the strongest baseline by up to 2.3x. DriftGuard is available for download from https://github.com/blessonvar/DriftGuard.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Federated mixture-of-experts, one of 12 directions in Mixture-of-experts. Builds on 29 of its 39 references that are in the map. First posted on arXiv 19 Mar 2026.

Builds on

29 of 39 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024FedMoE: Personalized Federated Learning via Heterogeneous Mixture of Experts21 Aug
  2. 2024pFedMoE: Data-Level Personalization with Mixture of Experts for Model-Heterogeneous Personalized Federated Learning2 Feb

Other references · 27

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
  4. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  5. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  6. 2018Federated Optimization in Heterogeneous Networkscited by 2,971
  7. 2017Gradient Episodic Memory for Continual Learningcited by 1,871
  8. 2018Moment Matching for Multi-Source Domain Adaptationcited by 1,327
  9. 2020Adaptive Federated Optimizationcited by 1,036
  10. 2017Deeper, Broader and Artier Domain Generalizationcited by 983
  11. 2017PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruningcited by 882
  12. 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 834
15 more
  1. 2020Learning under Concept Drift: A Reviewcited by 470
  2. 2021Towards Personalized Federated Learningcited by 462
  3. 2021Federated Learning for Internet of Things: A Comprehensive Surveycited by 247
  4. 2020Federated Continual Learning with Weighted Inter-client Transfercited by 158
  5. 2022Federated Class-Incremental Learningcited by 126
  6. 2020Empowering Things with Intelligence: A Survey of the Progress, Challenges, and Opportunities in Artificial Intelligence of Thingscited by 110
  7. 2023TARGET: Federated Class-Continual Learning via Exemplar-Free Distillationcited by 64
  8. 2023No One Left Behind: Real-World Federated Class-Incremental Learningcited by 53
  9. 2023Federated Continual Learning via Knowledge Fusion: A Surveycited by 53
  10. 2022Federated Learning under Distributed Concept Driftcited by 35
  11. 2022Feature Distribution Matching for Federated Domain Generalizationcited by 18
  12. 2023Complementary Domain Adaptation and Generalization for Unsupervised Continual Domain Shift Learningcited by 9
  13. 2023Monitoring and Adapting ML Models on Mobile Devicescited by 6
  14. 2024Rehearsal-free Federated Domain-incremental Learningcited by 4
  15. 2025FedDAA: Dynamic Client Clustering for Concept Drift Adaptation in Federated Learningcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Shift Happens: Mixture of Experts based Continual Adaptation in Federated Learning
  2. 2025OvA-LP: A Simple and Efficient Framework for Federated Learning on Non-IID Data
  3. 2024Diffusion-Driven Data Replay: A Novel Approach to Combat Forgetting in Federated Class Continual Learning
  4. 2025Data-Free Continual Learning of Server Models in Model-Heterogeneous Cloud-Device Collaboration
  5. 2025DriftMoE: A Mixture of Experts Approach to Handle Concept Drifts
  6. 2024Using Diffusion Models as Generative Replay in Continual Federated Learning -- What will Happen?
  7. 2024FedDr+: Stabilizing Dot-regression with Global Feature Distillation for Federated Learning
  8. 2023Learning to Specialize: Joint Gating-Expert Training for Adaptive MoEs in Decentralized Settings