Enhancing Federated Class-Incremental Learning via Spatial-Temporal Statistics Aggregation
Not on the map. Why?
Abstract (arXiv)
Federated Class-Incremental Learning (FCIL) enables Class-Incremental Learning (CIL) from distributed data. Existing FCIL methods typically integrate old knowledge preservation into local client training. However, these methods cannot avoid spatial-temporal client drift caused by data heterogeneity and often incur significant computational and communication overhead, limiting practical deployment. To address these challenges simultaneously, we propose a novel approach, Spatial-Temporal Statistics Aggregation (STSA), which provides a unified framework to aggregate feature statistics both spatially (across clients) and temporally (across stages). The aggregated feature statistics are unaffected by data heterogeneity and can be used to update the classifier in closed form at each stage. Additionally, we introduce STSA-E, a communication-efficient variant with theoretical guarantees, achieving similar performance to STSA-E with much lower communication overhead. Extensive experiments on three widely used FCIL datasets, with varying degrees of data heterogeneity, show that our method outperforms state-of-the-art FCIL methods in terms of performance, flexibility, and both communication and computation efficiency. The code is available at https://github.com/Yuqin-G/STSA.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 49 of its 73 references that are in the map. First posted on arXiv 2 Jun 2025.
Builds on
49 of 73 references.
References · 49
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
- 2019Advances and Open Problems in Federated Learningcited by 3,046
- 2016Learning without Forgettingcited by 2,496
- 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,850
- 2017Deep Image Priorcited by 1,098
- 2022DualPrompt: Complementary Prompting for Rehearsal-free Continual Learningcited by 642
- 2019Gradient based sample selection for online continual learningcited by 571
- 2022CODA-Prompt: COntinual Decomposed Attention-based Prompting for Rehearsal-Free Continual Learningcited by 450
- 2021Data-Free Knowledge Distillation for Heterogeneous Federated Learningcited by 383
37 more
- 2021Federated Learning on Non-IID Data: A Surveycited by 346
- 2021No Fear of Heterogeneity: Classifier Calibration for Federated Learning with Non-IID Datacited by 241
- 2023Class-Incremental Learning: A Surveycited by 209
- 2023Revisiting Class-Incremental Learning with Pre-Trained Models: Generalizability and Adaptivity are All You Needcited by 184
- 2022Fine-tuning Global Model via Data-Free Knowledge Distillation for Non-IID Federated Learningcited by 172
- 2023RanPAC: Random Projections and Pre-trained Models for Continual Learningcited by 164
- 2020Federated Continual Learning with Weighted Inter-client Transfercited by 161
- 2024Continual Learning with Pre-Trained Models: A Surveycited by 154
- 2019Uncertainty-based Continual Learning with Adaptive Regularizationcited by 146
- 2022Federated Learning from Pre-Trained Models: A Contrastive Learning Approachcited by 142
- 2022Federated Class-Incremental Learningcited by 127
- 2024Expandable Subspace Ensemble for Pre-Trained Model-Based Class-Incremental Learningcited by 117
- 2020Continual Deep Learning by Functional Regularisation of Memorable Pastcited by 105
- 2021On Learning the Geodesic Path for Incremental Learningcited by 85
- 2023TARGET: Federated Class-Continual Learning via Exemplar-Free Distillationcited by 65
- 2022ACIL: Analytic Class-Incremental Learning with Absolute Memorization and Privacy Protectioncited by 57
- 2023Better Generative Replay for Continual Federated Learningcited by 55
- 2023No One Left Behind: Real-World Federated Class-Incremental Learningcited by 53
- 2023Federated Continual Learning via Knowledge Fusion: A Surveycited by 53
- 2023A Data-Free Approach to Mitigate Catastrophic Forgetting in Federated Class Incremental Learning for Vision Taskscited by 41
- 2023Eliminating Domain Bias for Federated Learning in Representation Spacecited by 38
- 2024Towards Efficient Replay in Federated Incremental Learningcited by 33
- 2024Understanding Forgetting in Continual Learning with Linear Regressioncited by 30
- 2024Enhancing One-Shot Federated Learning Through Data and Ensemble Co-Boostingcited by 27
- 2023DFRD: Data-Free Robustness Distillation for Heterogeneous Federated Learningcited by 24
- 2024Unleashing the Power of Continual Learning on Non-Centralized Devices: A Surveycited by 23
- 2024Personalized Federated Continual Learning via Multi-granularity Promptcited by 20
- 2024Text-Enhanced Data-free Approach for Federated Class-Incremental Learningcited by 16
- 2022An elementary analysis of ridge regression with random designcited by 15
- 2022FECAM: Frequency Enhanced Channel Attention Mechanism for Time Series Forecastingcited by 15
- 2024LMAgent: A Large-scale Multimodal Agents Society for Multi-user Simulationcited by 15
- 2024Rehearsal-Free Continual Federated Learning with Synergistic Synaptic Intelligencecited by 15
- 2023Fed-CPrompt: Contrastive Prompt for Rehearsal-Free Federated Continual Learningcited by 12
- 2024Enhancing Federated Domain Adaptation with Multi-Domain Prototype-Based Federated Fine-Tuningcited by 6
- 2025Capture Global Feature Statistics for One-Shot Federated Learningcited by 6
- 2023Federated Class-Incremental Learning with Promptingcited by 5
- 2024PIP: Prototypes-Injected Prompt for Federated Class Incremental Learningcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.