mlsanityData to 14 Oct 2026

Dynamic Graph Learning-Neural Network for Multivariate Time Series Modeling

arXiv 2112.03273 ↗First posted 6 Dec 2021cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Multivariate time series forecasting is a challenging task because the data involves a mixture of long- and short-term patterns, with dynamic spatio-temporal dependencies among variables. Existing graph neural networks (GNN) typically model multivariate relationships with a pre-defined spatial graph or learned fixed adjacency graph. It limits the application of GNN and fails to handle the above challenges. In this paper, we propose a novel framework, namely static- and dynamic-graph learning-neural network (SDGL). The model acquires static and dynamic graph matrices from data to model long- and short-term patterns respectively. Static matric is developed to capture the fixed long-term association pattern via node embeddings, and we leverage graph regularity for controlling the quality of the learned static graph. To capture dynamic dependencies among variables, we propose dynamic graphs learning method to generate time-varying matrices based on changing node features and static node embeddings. And in the method, we integrate the learned static graph information as inductive bias to construct dynamic graphs and local spatio-temporal patterns better. Extensive experiments are conducted on two traffic datasets with extra structural information and four time series datasets, which show that our approach achieves state-of-the-art performance on almost all datasets. If the paper is accepted, I will open the source code on github.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 36 references that are in the map. First posted on arXiv 6 Dec 2021.

Builds on

23 of 36 references.

References · 23

  1. 2017Attention Is All You Needcited by 60,361
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  3. 2017Graph Attention Networkscited by 8,923
  4. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  5. 2014Going Deeper with Convolutionscited by 4,241
  6. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  7. 2016WaveNet: A Generative Model for Raw Audiocited by 1,722
  8. 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,136
  9. 2020On Layer Normalization in the Transformer Architecturecited by 922
  10. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 879
  11. 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 829
  12. 2016Language Modeling with Gated Convolutional Networkscited by 702
11 more
  1. 2020Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networkscited by 566
  2. 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 530
  3. 2019GMAN: A Graph Multi-Attention Network for Traffic Predictioncited by 434
  4. 2021Attention is Not All You Need: Pure Attention Loses Rank Doubly Exponentially with Depthcited by 419
  5. 2020Towards Deeper Graph Neural Networkscited by 296
  6. 2017A Dual-Stage Attention-Based Recurrent Neural Network for Time Series Predictioncited by 245
  7. 2020Iterative Deep Graph Learning for Graph Neural Networks: Better and Robust Node Embeddingscited by 214
  8. 2020Spatial-Temporal Fusion Graph Neural Networks for Traffic Flow Forecastingcited by 213
  9. 2019Think Globally, Act Locally: A Deep Neural Network Approach to High-Dimensional Time Series Forecastingcited by 161
  10. 2018Temporal Pattern Attention for Multivariate Time Series Forecastingcited by 125
  11. 2020AM-GCN: Adaptive Multi-channel Graph Convolutional Networkscited by 121

Built on by

Not cited yet.