mlsanityData to 7 Oct 2026

ST-LoRA: Low-rank Adaptation for Spatio-Temporal Forecasting

arXiv 2404.07919 ↗First posted 11 Apr 2024cs.LG cs.AIcited by 9

Not on the map. Why?

Abstract (arXiv)

Spatio-temporal forecasting is essential for understanding future dynamics within real-world systems by leveraging historical data from multiple locations. Existing methods often prioritize the development of intricate neural networks to capture the complex dependencies of the data. These methods neglect node-level heterogeneity and face over-parameterization when attempting to model node-specific characteristics. In this paper, we present a novel low-rank adaptation framework for existing spatio-temporal prediction models, termed model, which alleviates the aforementioned problems through node-level adjustments. Specifically, we introduce the node-adaptive low-rank layer and node-specific predictor, capturing the complex functional characteristics of nodes while maintaining computational efficiency. Extensive experiments on multiple real-world datasets demonstrate that our method consistently achieves superior performance across various forecasting models with minimal computational overhead, improving performance by 7% with only 1% additional parameter cost. The source code is available at https://github.com/RWLinno/ST-LoRA.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 30 of its 59 references that are in the map. First posted on arXiv 11 Apr 2024.

Builds on

30 of 59 references.

References · 30

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  4. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
  5. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
  6. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  7. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
  8. 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
  9. 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 820
  10. 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 615
  11. 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 525
  12. 2021Compacter: Efficient Low-Rank Hypercomplex Adapter Layerscited by 458
18 more
  1. 2024LoRA+: Efficient Low Rank Adaptation of Large Modelscited by 365
  2. 2015Recent Advances in Convolutional Neural Networkscited by 360
  3. 2022DyLoRA: Parameter Efficient Tuning of Pre-trained Models using Dynamic Search-Free Low-Rank Adaptationcited by 229
  4. 2021Spatial-Temporal Graph ODE Networks for Traffic Flow Forecastingcited by 209
  5. 2022ST-Adapter: Parameter-Efficient Image-to-Video Transfer Learningcited by 192
  6. 2019Deep Learning for Spatio-Temporal Data Mining: A Surveycited by 171
  7. 2018Deep Multi-View Spatial-Temporal Network for Taxi Demand Predictioncited by 162
  8. 2023Spatio-Temporal Graph Neural Networks for Predictive Learning in Urban Computing: A Surveycited by 140
  9. 2022Decoupled Dynamic Spatial-Temporal Graph Neural Network for Traffic Forecastingcited by 122
  10. 2022Pre-training Enhanced Spatial-temporal Graph Neural Network for Multivariate Time Series Forecastingcited by 117
  11. 2023LargeST: A Benchmark Dataset for Large-Scale Traffic Forecastingcited by 116
  12. 2022Spatio-Temporal Meta-Graph Learning for Traffic Forecastingcited by 88
  13. 2023UrbanCLIP: Learning Text-enhanced Urban Region Profiling with Contrastive Language-Image Pretraining from the Webcited by 77
  14. 2022AirFormer: Predicting Nationwide Air Quality in China with Transformerscited by 73
  15. 2024Position: What Can Large Language Models Tell Us about Time Series Analysiscited by 47
  16. 2024MTLoRA: A Low-Rank Adaptation Approach for Efficient Multi-Task Learningcited by 44
  17. 2022Spatial-Temporal Hypergraph Self-Supervised Learning for Crime Predictioncited by 39
  18. 2023Spatial-Temporal-Decoupled Masked Pre-training for Spatiotemporal Forecastingcited by 27

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 4; 2026: 2.

9 papers.