mlsanityData to 14 Oct 2026

Spatio-Temporal Meta Contrastive Learning

arXiv 2310.17678 ↗First posted 26 Oct 2023cs.LGcited by 11

Not on the map. Why?

Abstract (arXiv)

Spatio-temporal prediction is crucial in numerous real-world applications, including traffic forecasting and crime prediction, which aim to improve public transportation and safety management. Many state-of-the-art models demonstrate the strong capability of spatio-temporal graph neural networks (STGNN) to capture complex spatio-temporal correlations. However, despite their effectiveness, existing approaches do not adequately address several key challenges. Data quality issues, such as data scarcity and sparsity, lead to data noise and a lack of supervised signals, which significantly limit the performance of STGNN. Although recent STGNN models with contrastive learning aim to address these challenges, most of them use pre-defined augmentation strategies that heavily depend on manual design and cannot be customized for different Spatio-Temporal Graph (STG) scenarios. To tackle these challenges, we propose a new spatio-temporal contrastive learning (CL4ST) framework to encode robust and generalizable STG representations via the STG augmentation paradigm. Specifically, we design the meta view generator to automatically construct node and edge augmentation views for each disentangled spatial and temporal graph in a data-driven manner. The meta view generator employs meta networks with parameterized generative model to customize the augmentations for each input. This personalizes the augmentation strategies for every STG and endows the learning framework with spatio-temporal-aware information. Additionally, we integrate a unified spatio-temporal graph attention network with the proposed meta view generator and two-branch graph contrastive learning paradigms. Extensive experiments demonstrate that our CL4ST significantly improves performance over various state-of-the-art baselines in traffic and crime prediction.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 33 of its 56 references that are in the map. First posted on arXiv 26 Oct 2023.

Builds on

33 of 56 references.

References · 33

  1. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  3. 2017Graph Attention Networkscited by 8,923
  4. 2018How Powerful are Graph Neural Networks?cited by 4,393
  5. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,739
  6. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,436
  7. 2020Graph Contrastive Learning with Augmentationscited by 1,208
  8. 2016The Concrete Distribution: A Continuous Relaxation of Discrete Random Variablescited by 1,148
  9. 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,136
  10. 2018Deep Graph Infomaxcited by 1,106
  11. 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 829
  12. 2020Contrastive Multi-View Representation Learning on Graphscited by 652
21 more
  1. 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 530
  2. 2019GMAN: A Graph Multi-Attention Network for Traffic Predictioncited by 434
  3. 2016Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Predictioncited by 333
  4. 2021Spectral Temporal Graph Neural Network for Multivariate Time-series Forecastingcited by 299
  5. 2021Graph Contrastive Learning Automatedcited by 287
  6. 2020Spatial-Temporal Fusion Graph Neural Networks for Traffic Flow Forecastingcited by 213
  7. 2021Spatial-Temporal Graph ODE Networks for Traffic Flow Forecastingcited by 210
  8. 2021Adversarial Graph Augmentation to Improve Graph Contrastive Learningcited by 200
  9. 2020CLEAR: Contrastive Learning for Sentence Representationcited by 186
  10. 2018Deep Multi-View Spatial-Temporal Network for Taxi Demand Predictioncited by 162
  11. 2022Spatial-Temporal Identity: A Simple yet Effective Baseline for Multivariate Time Series Forecastingcited by 151
  12. 2021Graph Neural Controlled Differential Equations for Traffic Forecastingcited by 133
  13. 2018Revisiting Spatial-Temporal Similarity: A Deep Learning Framework for Traffic Predictioncited by 122
  14. 2021DL-Traff: Survey and Benchmark of Deep Learning Models for Urban Traffic Predictioncited by 73
  15. 2021AutoGCL: Automated Graph Contrastive Learning via Learnable View Generatorscited by 73
  16. 2021Z-GCNETs: Time Zigzags at Graph Convolutional Networks for Time Series Forecastingcited by 67
  17. 2022Spatial-Temporal Hypergraph Self-Supervised Learning for Crime Predictioncited by 39
  18. 2021When Do Contrastive Learning Signals Help Spatio-Temporal Graph Forecasting?cited by 36
  19. 2022Spatial-Temporal Sequential Hypergraph Network for Crime Prediction with Dynamic Multiplex Relation Learningcited by 32
  20. 2019UrbanFM: Inferring Fine-Grained Urban Flowscited by 31
  21. 2023Automated Spatio-Temporal Graph Contrastive Learningcited by 24

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 5; 2025: 4; 2026: 2.

11 papers.