mlsanityData to 7 Oct 2026

Federated continual learning: A comprehensive survey on lifelong and privacy-preserving learning over distributed and non-stationary data

arXiv 2606.11272 ↗First posted 9 Jun 2026cs.LG cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Federated Learning (FL) enables collaborative and privacy-preserving model training across distributed clients, but most existing FL systems implicitly assume data stationarity. In real-world settings-such as healthcare, industrial IoT (IIOT), cybersecurity, and smart cities-data streams are inherently non-stationary, leading classical FL methods to suffer from performance degradation, instability, and catastrophic forgetting. Continual Learning (CL) addresses learning under evolving data distributions but has been largely studied in centralized settings, overlooking key constraints of federated systems, including privacy, limited communication, and client heterogeneity. Federated Continual Learning (FCL) emerges at the intersection of FL and CL, aiming to support lifelong, adaptive, and privacy-aware learning over distributed and non-stationary data. This survey provides a comprehensive and systematic overview of FCL. We first present a formal definition of the FCL problem and clarify its distinctive characteristics. We then analyze the limitations of classical FL under non-stationary conditions, highlighting how CL principles support long-term adaptation. To organize the rapidly growing literature, we propose a multi-dimensional taxonomy of FCL approaches. Furthermore, we review representative application domains and data modalities, summarize commonly used evaluation metrics, and discuss experimental perspectives for assessing long-term performance and forgetting. Finally, we highlight key open challenges, including handling extreme heterogeneity under temporal drift, designing scalable and privacy-preserving memory mechanisms, and establishing standardized benchmarks. This survey aims to serve as a reference and a roadmap for advancing FCL toward robust and deployable real-world systems.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 20 of its 94 references that are in the map. First posted on arXiv 9 Jun 2026.

Builds on

20 of 94 references.

References · 20

  1. 2016Learning without Forgettingcited by 2,465
  2. 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,313
  3. 2018Experience Replay for Continual Learningcited by 1,074
  4. 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 860
  5. 2024Continual Learning of Large Language Models: A Comprehensive Surveycited by 228
  6. 2023Heterogeneous Federated Learning: State-of-the-art and Research Challengescited by 160
  7. 2021Self-Supervised Models are Continual Learnerscited by 149
  8. 2020Continual Prototype Evolution: Learning Online from Non-Stationary Data Streamscited by 143
  9. 2022Continual Pre-Training Mitigates Forgetting in Language and Visioncited by 82
  10. 2023Federated Continual Learning via Knowledge Fusion: A Surveycited by 53
  11. 2021Non-IID data and Continual Learning processes in Federated Learning: A long road aheadcited by 36
  12. 2021Concept drift detection and adaptation for federated and continual learningcited by 32
8 more
  1. 2022HFedMS: Heterogeneous Federated Learning with Memorable Data Semantics in Industrial Metaversecited by 14
  2. 2023DYNAMITE: Dynamic Interplay of Mini-Batch Size and Aggregation Frequency for Federated Learning with Static and Streaming Datasetcited by 14
  3. 2025Federated Continual Learning: Concepts, Challenges, and Solutionscited by 13
  4. 2022Spatial-Temporal Federated Learning for Lifelong Person Re-identification on Distributed Edgescited by 12
  5. 2022SHED: A Newton-type algorithm for federated learning based on incremental Hessian eigenvector sharingcited by 11
  6. 2023On the Local Cache Update Rules in Streaming Federated Learningcited by 8
  7. 2025SacFL: Self-Adaptive Federated Continual Learning for Resource-Constrained End Devicescited by 8
  8. 2022Self-supervised On-device Federated Learning from Unlabeled Streamscited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.