mlsanityData to 14 Oct 2026

Generalized Incremental Learning under Concept Drift across Evolving Data Streams

arXiv 2506.05736 ↗First posted 6 Jun 2025cs.LG cs.AIcited by 7

Not on the map. Why?

Abstract (arXiv)

Real-world data streams exhibit inherent non-stationarity characterized by concept drift, posing significant challenges for adaptive learning systems. While existing methods address isolated distribution shifts, they overlook the critical co-evolution of label spaces and distributions under limited supervision and persistent uncertainty. To address this, we formalize Generalized Incremental Learning under Concept Drift (GILCD), characterizing the joint evolution of distributions and label spaces in open-environment streaming contexts, and propose a novel framework called Calibrated Source-Free Adaptation (CSFA). First, CSFA introduces a training-free prototype calibration mechanism that dynamically fuses emerging prototypes with base representations, enabling stable new-class identification without optimization overhead. Second, we design a novel source-free adaptation algorithm, i.e., Reliable Surrogate Gap Sharpness-aware (RSGS) minimization. It integrates sharpness-aware perturbation loss optimization with surrogate gap minimization, while employing entropy-based uncertainty filtering to discard unreliable samples. This mechanism ensures robust distribution alignment and mitigates generalization degradation caused by uncertainties. Thus, CSFA establishes a unified framework for stable adaptation to evolving semantics and distributions in open-world streaming scenarios. Extensive experiments validate the superior performance and effectiveness of CSFA compared to SOTA approaches.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 35 of its 70 references that are in the map. First posted on arXiv 6 Jun 2025.

Builds on

35 of 70 references.

References · 35

  1. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  2. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  3. 2017Prototypical Networks for Few-shot Learningcited by 3,015
  4. 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,877
  5. 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,333
  6. 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,591
  7. 2020Sharpness-Aware Minimization for Efficiently Improving Generalizationcited by 1,417
  8. 2021Learning to Prompt for Continual Learningcited by 944
  9. 2020Do We Really Need to Access the Source Data? Source Hypothesis Transfer for Unsupervised Domain Adaptationcited by 848
  10. 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 766
  11. 2013Domain Generalization via Invariant Feature Representationcited by 623
  12. 2020Learning under Concept Drift: A Reviewcited by 477
23 more
  1. 2020Class-incremental learning: survey and performance evaluation on image classificationcited by 449
  2. 2023Towards Stable Test-Time Adaptation in Dynamic Wild Worldcited by 415
  3. 2023A Comprehensive Survey on Test-Time Adaptation under Distribution Shiftscited by 359
  4. 2021DER: Dynamically Expandable Representation for Class Incremental Learningcited by 355
  5. 2022Contrastive Test-Time Adaptationcited by 261
  6. 2020Few-Shot Class-Incremental Learningcited by 251
  7. 2023Class-Incremental Learning: A Surveycited by 209
  8. 2021Few-Shot Incremental Learning with Continually Evolved Classifierscited by 187
  9. 2022Surrogate Gap Minimization Improves Sharpness-Aware Trainingcited by 172
  10. 2020Incremental Learning In Online Scenariocited by 71
  11. 2023Few-Shot Class-Incremental Learning via Training-Free Prototype Calibrationcited by 46
  12. 2023On the Robustness of Open-World Test-Time Training: Self-Training with Dynamic Prototype Expansioncited by 34
  13. 2019When does Diversity Help Generalization in Classification Ensembles?cited by 27
  14. 2023Few-shot Class-incremental Learning for Classification and Object Detection: A Surveycited by 25
  15. 2023Invariant Collaborative Filtering to Popularity Distribution Shiftcited by 23
  16. 2024Adapting Multi-modal Large Language Model to Concept Drift From Pre-training Onwardscited by 19
  17. 2023Online Boosting Adaptive Learning under Concept Drift for Multistream Classificationcited by 17
  18. 2025Learning Robust Spectral Dynamics for Temporal Domain Generalizationcited by 14
  19. 2013Online Ensemble Learning for Imbalanced Data Streamscited by 12
  20. 2020Adaptation Strategies for Automated Machine Learning on Evolving Datacited by 12
  21. 2019ATL: Autonomous Knowledge Transfer from Many Streaming Processescited by 9
  22. 2022Boost Test-Time Performance with Closed-Loop Inferencecited by 7
  23. 2025Walking the Tightrope: Disentangling Beneficial and Detrimental Drifts in Non-Stationary Custom-Tuningcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 6.

7 papers.