mlsanityData to 14 Oct 2026

Continuous Evolution Pool: Taming Recurring Concept Drift in Online Time Series Forecasting

arXiv 2506.14790 ↗First posted 28 May 2025cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

Recurring concept drift is pervasive in real-world online time series, where the underlying data-generating process repeatedly alternates between a small set of regimes, most notably daily or seasonal cycles that dominate energy, traffic, and weather patterns, and is therefore a central obstacle to reliable long-horizon forecasting. This problem poses a dual challenge in online time series forecasting: mitigating catastrophic forgetting while operating under strict constraints that prevent storing or replaying historical raw samples. Existing approaches predominantly rely on parameter updates or experience replay, which inevitably suffer from knowledge overwriting or stale replay buffers. To address this, the Continuous Evolution Pool (CEP), a replay-free framework that maintains a dynamic pool of specialized forecasters, is proposed. Instead of storing raw samples, CEP utilizes lightweight statistical genes to decouple concept identification from forecasting. Specifically, it employs a retrieval mechanism to identify the nearest concept based on gene similarity, an evolution strategy to spawn new forecasters upon detecting distribution shifts, and an elimination policy to prune obsolete models under memory constraints. Experiments on real-world datasets demonstrate that CEP significantly outperforms state-of-the-art baselines, reducing forecasting error by up to 24% on datasets with pronounced recurring drift without accessing historical ground truth.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 26 of its 60 references that are in the map. First posted on arXiv 28 May 2025.

Builds on

26 of 60 references.

References · 26

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  3. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  4. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  5. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  6. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  7. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
  8. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
  9. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
  10. 2020Dark Experience for General Continual Learning: a Strong, Simple Baselinecited by 911
  11. 2024Chronos: Learning the Language of Time Seriescited by 759
  12. 2023A decoder-only foundation model for time-series forecastingcited by 692
14 more
  1. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
  2. 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 391
  3. 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 346
  4. 2023A Survey on Graph Neural Networks for Time Series: Forecasting, Classification, Imputation, and Anomaly Detectioncited by 145
  5. 2021AdaRNN: Adaptive Learning and Forecasting of Time Seriescited by 121
  6. 2023OneNet: Enhancing Time Series Forecasting Models under Concept Drift by Online Ensemblingcited by 74
  7. 2017On Quadratic Penalties in Elastic Weight Consolidationcited by 55
  8. 2023SegRNN: Segment Recurrent Neural Network for Long-Term Time Series Forecastingcited by 55
  9. 2022Learning Fast and Slow for Online Time Series Forecastingcited by 45
  10. 2024Online Drift Detection with Maximum Concept Discrepancycited by 12
  11. 2024Addressing Prediction Delays in Time Series Forecasting: A Continuous GRU Approach with Derivative Regularizationcited by 7
  12. 2018Concept-drifting Data Streams are Time Series; The Case for Continuous Adaptationcited by 6
  13. 2023Quilt: Robust Data Segment Selection against Concept Driftscited by 5
  14. 2022A Polynomial-time Decentralised Algorithm for Coordinated Management of Multiple Intersectionscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.