When the Cross-Silo Federation Goes Offline: Continual Learning for Site Onboarding with Limited Unlabeled Data
Not on the map. Why?
Abstract (arXiv)
An organization often holds too little labeled data to train a model that generalizes, and the records that would supply the rest sit with organizations that cannot release them. Cross-silo federated learning offers a way through, since participants exchange model parameters rather than records, but it ordinarily settles two aspects of the arrangement in advance, the participating sites and the classes the model can predict, and deployment can breach both. A new site joins after training, once the established sites have finished their engagement and gone offline, and its records arrive unlabeled, mixing conditions the model already recognizes with conditions no participant has observed. We present an autonomous three-stage procedure that expands the model entirely at the joining site: reconstruction experts screen for novelty, clustering separates the flagged records into candidate conditions, and class means describe the old classes, all inside one shared representation. Those classes were learned from records that never leave their owners, so the usual defenses against forgetting are unavailable, and the procedure supplies the evidence they would have carried from either of two dissimilar sources, prototypes held by the federation or records held by the joining site. On a real industrial condition-monitoring dataset, run end to end with no label consulted, either source holds old-class accuracy at 0.868 or above with forgetting at most 0.063, and the two differ by 0.021, so a configuration can be chosen by the disclosure it permits rather than the accuracy it delivers. Both keep old- and new-class accuracy in balance where every alternative we measure gives up one for the other, and both retain more of the old classes than distillation- and regularization-based baselines. The balance still holds with only 6 labeled records per arriving condition and 3 retained per old class.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 27 references that are in the map. First posted on arXiv 4 Oct 2026.
Builds on
22 of 27 references.
References · 22
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
- 2019Advances and Open Problems in Federated Learningcited by 3,046
- 2016Learning without Forgettingcited by 2,496
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
- 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,333
- 2019Federated Learning: Challenges, Methods, and Future Directionscited by 1,538
- 2020Energy-based Out-of-distribution Detectioncited by 1,299
- 2020Dark Experience for General Continual Learning: a Strong, Simple Baselinecited by 911
- 2020The Future of Digital Health with Federated Learningcited by 633
- 2015Towards Open Set Deep Networkscited by 538
- 2020Class-incremental learning: survey and performance evaluation on image classificationcited by 449
10 more
- 2020Federated Continual Learning with Weighted Inter-client Transfercited by 161
- 2021Federated Learning for Open Bankingcited by 141
- 2022Federated Class-Incremental Learningcited by 127
- 2023TARGET: Federated Class-Continual Learning via Exemplar-Free Distillationcited by 65
- 2023Few-Shot Class-Incremental Learning via Training-Free Prototype Calibrationcited by 46
- 2023Federated Generalized Category Discoverycited by 27
- 2024Federated Continual Learning for Edge-AI: A Comprehensive Surveycited by 11
- 2023Towards Unbiased Training in Federated Open-world Semi-supervised Learningcited by 7
- 2022Federated Learning for Autoencoder-based Condition Monitoring in the Industrial Internet of Thingscited by 2
- 2026Adaptive Unknown Fault Detection and Few-Shot Continual Learning for Condition Monitoring in Ultrasonic Metal Weldingcited by 2
Built on by
Not cited yet.