mlsanityData to 7 Oct 2026

Distribution-aware Online Continual Learning for Urban Spatio-Temporal Forecasting

arXiv 2411.15893 ↗First posted 24 Nov 2024cs.LG cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Urban spatio-temporal (ST) forecasting is crucial for various urban applications such as intelligent scheduling and trip planning. Previous studies focus on modeling ST correlations among urban locations in offline settings, which often neglect the non-stationary nature of urban ST data, particularly, distribution shifts over time. This oversight can lead to degraded performance in real-world scenarios. In this paper, we first analyze the distribution shifts in urban ST data, and then introduce DOST, a novel online continual learning framework tailored for ST data characteristics. DOST employs an adaptive ST network equipped with a variable-independent adapter to address the unique distribution shifts at each urban location dynamically. Further, to accommodate the gradual nature of these shifts, we also develop an awake-hibernate learning strategy that intermittently fine-tunes the adapter during the online phase to reduce computational overhead. This strategy integrates a streaming memory update mechanism designed for urban ST sequential data, enabling effective network adaptation to new patterns while preventing catastrophic forgetting. Experimental results confirm DOST's superiority over state-of-the-art models on four real-world datasets, providing online forecasts within an average of 0.1 seconds and achieving a 12.89% reduction in forecast errors compared to baseline models.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 21 of its 89 references that are in the map. First posted on arXiv 24 Nov 2024.

Builds on

21 of 89 references.

References · 21

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  4. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  5. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  6. 2017Gradient Episodic Memory for Continual Learningcited by 1,871
  7. 2017Decoupled Weight Decay Regularizationcited by 1,722
  8. 2020Dark Experience for General Continual Learning: a Strong, Simple Baselinecited by 895
  9. 2023LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attentioncited by 776
  10. 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 525
  11. 2019On Tiny Episodic Memories in Continual Learningcited by 299
  12. 2020Spatial-Temporal Transformer Networks for Traffic Flow Forecastingcited by 179
9 more
  1. 2023Towards Better Dynamic Graph Learning: New Architecture and Unified Librarycited by 154
  2. 2023Exploring Progress in Multivariate Time Series Forecasting: Comprehensive Benchmarking and Heterogeneity Analysiscited by 113
  3. 2023OneNet: Enhancing Time Series Forecasting Models under Concept Drift by Online Ensemblingcited by 71
  4. 2021AutoCTS: Automated Correlated Time Series Forecasting -- Extended Versioncited by 48
  5. 2022Learning Fast and Slow for Online Time Series Forecastingcited by 43
  6. 2024A Unified Replay-based Continuous Learning Framework for Spatio-Temporal Prediction on Streaming Datacited by 39
  7. 2017Diffusion Convolutional Recurrent Neural Network: Data-Driven Traffic Forecastingcited by 36
  8. 2023SIESTA: Efficient Online Continual Learning with Sleepcited by 24
  9. 2024FlashST: A Simple and Universal Prompt-Tuning Framework for Traffic Predictioncited by 18

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.