Beyond Fixed Variables: Expanding-variate Time Series Forecasting via Flat Scheme and Spatio-temporal Focal Learning
Not on the map. Why?
Abstract (arXiv)
Multivariate Time Series Forecasting (MTSF) has long been a key research focus. Traditionally, these studies assume a fixed number of variables, but in real-world applications, Cyber-Physical Systems often expand as new sensors are deployed, increasing variables in MTSF. In light of this, we introduce a novel task, Expanding-variate Time Series Forecasting (EVTSF). This task presents unique challenges, specifically (1) handling inconsistent data shapes caused by adding new variables, and (2) addressing imbalanced spatio-temporal learning, where expanding variables have limited observed data due to the necessity for timely operation. To address these challenges, we propose STEV, a flexible spatio-temporal forecasting framework. STEV includes a new Flat Scheme to tackle the inconsistent data shape issue, which extends the graph-based spatio-temporal modeling architecture into 1D space by flattening the 2D samples along the variable dimension, making the model variable-scale-agnostic while still preserving dynamic spatial correlations through a holistic graph. We introduce a novel Spatio-temporal Focal Learning strategy that incorporates a negative filter to resolve potential conflicts between contrastive learning and graph representation, and a focal contrastive loss as its core to guide the framework to focus on optimizing the expanding variables. We benchmark EVTSF performance using three real-world datasets and compare it against three potential solutions employing SOTA MTSF models tailored for EVSTF. Experimental results show that STEV significantly outperforms its competitors, particularly on expanding variables. Notably, STEV, with only 5% of observations from the expanding period, is on par with SOTA MTSF models trained with complete observations. Further exploration of various expanding strategies underscores the generalizability of STEV in real-world applications.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 31 of its 45 references that are in the map. First posted on arXiv 21 Feb 2025.
Builds on
31 of 45 references.
References · 31
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,434
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
- 2017Gradient Episodic Memory for Continual Learningcited by 1,898
- 2016WaveNet: A Generative Model for Raw Audiocited by 1,722
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,436
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
- 2015Multi-Scale Context Aggregation by Dilated Convolutionscited by 1,133
19 more
- 2018Experience Replay for Continual Learningcited by 1,095
- 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 829
- 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 753
- 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 632
- 2020Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networkscited by 566
- 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 530
- 2021TS2Vec: Towards Universal Representation of Time Seriescited by 471
- 2020Understanding the Behaviour of Contrastive Losscited by 398
- 2016Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Predictioncited by 333
- 2020WeatherBench: A benchmark dataset for data-driven weather forecastingcited by 275
- 2021Unsupervised Representation Learning for Time Series with Temporal Neighborhood Codingcited by 224
- 2023FourierGNN: Rethinking Multivariate Time Series Forecasting from a Pure Graph Perspectivecited by 127
- 2023LargeST: A Benchmark Dataset for Large-Scale Traffic Forecastingcited by 118
- 2020Inductive Graph Neural Networks for Spatiotemporal Krigingcited by 91
- 2023Contrast Everything: A Hierarchical Contrastive Framework for Medical Time-Seriescited by 59
- 2023TimesURL: Self-supervised Contrastive Learning for Universal Time Series Representation Learningcited by 52
- 2023MSGNet: Learning Multi-Scale Inter-Series Correlations for Multivariate Time Series Forecastingcited by 50
- 2021TrafficStream: A Streaming Traffic Flow Forecasting Framework Based on Graph Neural Networks and Continual Learningcited by 42
- 2023Learning Time-aware Graph Structures for Spatially Correlated Time Series Forecastingcited by 7
Built on by
Citing papers per year: 2026: 2.
2 papers.