mlsanityData to 14 Oct 2026

Enhancing Federated Class-Incremental Learning via Spatial-Temporal Statistics Aggregation

arXiv 2506.01327 ↗First posted 2 Jun 2025cs.LG cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Federated Class-Incremental Learning (FCIL) enables Class-Incremental Learning (CIL) from distributed data. Existing FCIL methods typically integrate old knowledge preservation into local client training. However, these methods cannot avoid spatial-temporal client drift caused by data heterogeneity and often incur significant computational and communication overhead, limiting practical deployment. To address these challenges simultaneously, we propose a novel approach, Spatial-Temporal Statistics Aggregation (STSA), which provides a unified framework to aggregate feature statistics both spatially (across clients) and temporally (across stages). The aggregated feature statistics are unaffected by data heterogeneity and can be used to update the classifier in closed form at each stage. Additionally, we introduce STSA-E, a communication-efficient variant with theoretical guarantees, achieving similar performance to STSA-E with much lower communication overhead. Extensive experiments on three widely used FCIL datasets, with varying degrees of data heterogeneity, show that our method outperforms state-of-the-art FCIL methods in terms of performance, flexibility, and both communication and computation efficiency. The code is available at https://github.com/Yuqin-G/STSA.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 49 of its 73 references that are in the map. First posted on arXiv 2 Jun 2025.

Builds on

49 of 73 references.

References · 49

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
  4. 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
  5. 2019Advances and Open Problems in Federated Learningcited by 3,046
  6. 2016Learning without Forgettingcited by 2,496
  7. 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,850
  8. 2017Deep Image Priorcited by 1,098
  9. 2022DualPrompt: Complementary Prompting for Rehearsal-free Continual Learningcited by 642
  10. 2019Gradient based sample selection for online continual learningcited by 571
  11. 2022CODA-Prompt: COntinual Decomposed Attention-based Prompting for Rehearsal-Free Continual Learningcited by 450
  12. 2021Data-Free Knowledge Distillation for Heterogeneous Federated Learningcited by 383
37 more
  1. 2021Federated Learning on Non-IID Data: A Surveycited by 346
  2. 2021No Fear of Heterogeneity: Classifier Calibration for Federated Learning with Non-IID Datacited by 241
  3. 2023Class-Incremental Learning: A Surveycited by 209
  4. 2023Revisiting Class-Incremental Learning with Pre-Trained Models: Generalizability and Adaptivity are All You Needcited by 184
  5. 2022Fine-tuning Global Model via Data-Free Knowledge Distillation for Non-IID Federated Learningcited by 172
  6. 2023RanPAC: Random Projections and Pre-trained Models for Continual Learningcited by 164
  7. 2020Federated Continual Learning with Weighted Inter-client Transfercited by 161
  8. 2024Continual Learning with Pre-Trained Models: A Surveycited by 154
  9. 2019Uncertainty-based Continual Learning with Adaptive Regularizationcited by 146
  10. 2022Federated Learning from Pre-Trained Models: A Contrastive Learning Approachcited by 142
  11. 2022Federated Class-Incremental Learningcited by 127
  12. 2024Expandable Subspace Ensemble for Pre-Trained Model-Based Class-Incremental Learningcited by 117
  13. 2020Continual Deep Learning by Functional Regularisation of Memorable Pastcited by 105
  14. 2021On Learning the Geodesic Path for Incremental Learningcited by 85
  15. 2023TARGET: Federated Class-Continual Learning via Exemplar-Free Distillationcited by 65
  16. 2022ACIL: Analytic Class-Incremental Learning with Absolute Memorization and Privacy Protectioncited by 57
  17. 2023Better Generative Replay for Continual Federated Learningcited by 55
  18. 2023No One Left Behind: Real-World Federated Class-Incremental Learningcited by 53
  19. 2023Federated Continual Learning via Knowledge Fusion: A Surveycited by 53
  20. 2023A Data-Free Approach to Mitigate Catastrophic Forgetting in Federated Class Incremental Learning for Vision Taskscited by 41
  21. 2023Eliminating Domain Bias for Federated Learning in Representation Spacecited by 38
  22. 2024Towards Efficient Replay in Federated Incremental Learningcited by 33
  23. 2024Understanding Forgetting in Continual Learning with Linear Regressioncited by 30
  24. 2024Enhancing One-Shot Federated Learning Through Data and Ensemble Co-Boostingcited by 27
  25. 2023DFRD: Data-Free Robustness Distillation for Heterogeneous Federated Learningcited by 24
  26. 2024Unleashing the Power of Continual Learning on Non-Centralized Devices: A Surveycited by 23
  27. 2024Personalized Federated Continual Learning via Multi-granularity Promptcited by 20
  28. 2024Text-Enhanced Data-free Approach for Federated Class-Incremental Learningcited by 16
  29. 2022An elementary analysis of ridge regression with random designcited by 15
  30. 2022FECAM: Frequency Enhanced Channel Attention Mechanism for Time Series Forecastingcited by 15
  31. 2024LMAgent: A Large-scale Multimodal Agents Society for Multi-user Simulationcited by 15
  32. 2024Rehearsal-Free Continual Federated Learning with Synergistic Synaptic Intelligencecited by 15
  33. 2023Fed-CPrompt: Contrastive Prompt for Rehearsal-Free Federated Continual Learningcited by 12
  34. 2024Enhancing Federated Domain Adaptation with Multi-Domain Prototype-Based Federated Fine-Tuningcited by 6
  35. 2025Capture Global Feature Statistics for One-Shot Federated Learningcited by 6
  36. 2023Federated Class-Incremental Learning with Promptingcited by 5
  37. 2024PIP: Prototypes-Injected Prompt for Federated Class Incremental Learningcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.