ST-LoRA: Low-rank Adaptation for Spatio-Temporal Forecasting
Not on the map. Why?
Abstract (arXiv)
Spatio-temporal forecasting is essential for understanding future dynamics within real-world systems by leveraging historical data from multiple locations. Existing methods often prioritize the development of intricate neural networks to capture the complex dependencies of the data. These methods neglect node-level heterogeneity and face over-parameterization when attempting to model node-specific characteristics. In this paper, we present a novel low-rank adaptation framework for existing spatio-temporal prediction models, termed model, which alleviates the aforementioned problems through node-level adjustments. Specifically, we introduce the node-adaptive low-rank layer and node-specific predictor, capturing the complex functional characteristics of nodes while maintaining computational efficiency. Extensive experiments on multiple real-world datasets demonstrate that our method consistently achieves superior performance across various forecasting models with minimal computational overhead, improving performance by 7% with only 1% additional parameter cost. The source code is available at https://github.com/RWLinno/ST-LoRA.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 30 of its 59 references that are in the map. First posted on arXiv 11 Apr 2024.
Builds on
30 of 59 references.
References · 30
- 2017Attention Is All You Needcited by 59,932
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
- 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
- 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 820
- 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 615
- 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 525
- 2021Compacter: Efficient Low-Rank Hypercomplex Adapter Layerscited by 458
18 more
- 2024LoRA+: Efficient Low Rank Adaptation of Large Modelscited by 365
- 2015Recent Advances in Convolutional Neural Networkscited by 360
- 2022DyLoRA: Parameter Efficient Tuning of Pre-trained Models using Dynamic Search-Free Low-Rank Adaptationcited by 229
- 2021Spatial-Temporal Graph ODE Networks for Traffic Flow Forecastingcited by 209
- 2022ST-Adapter: Parameter-Efficient Image-to-Video Transfer Learningcited by 192
- 2019Deep Learning for Spatio-Temporal Data Mining: A Surveycited by 171
- 2018Deep Multi-View Spatial-Temporal Network for Taxi Demand Predictioncited by 162
- 2023Spatio-Temporal Graph Neural Networks for Predictive Learning in Urban Computing: A Surveycited by 140
- 2022Decoupled Dynamic Spatial-Temporal Graph Neural Network for Traffic Forecastingcited by 122
- 2022Pre-training Enhanced Spatial-temporal Graph Neural Network for Multivariate Time Series Forecastingcited by 117
- 2023LargeST: A Benchmark Dataset for Large-Scale Traffic Forecastingcited by 116
- 2022Spatio-Temporal Meta-Graph Learning for Traffic Forecastingcited by 88
- 2023UrbanCLIP: Learning Text-enhanced Urban Region Profiling with Contrastive Language-Image Pretraining from the Webcited by 77
- 2022AirFormer: Predicting Nationwide Air Quality in China with Transformerscited by 73
- 2024Position: What Can Large Language Models Tell Us about Time Series Analysiscited by 47
- 2024MTLoRA: A Low-Rank Adaptation Approach for Efficient Multi-Task Learningcited by 44
- 2022Spatial-Temporal Hypergraph Self-Supervised Learning for Crime Predictioncited by 39
- 2023Spatial-Temporal-Decoupled Masked Pre-training for Spatiotemporal Forecastingcited by 27
Built on by
Citing papers per year: 2024: 3; 2025: 4; 2026: 2.
9 papers.
- 2024Low-Rank Adaptation for Foundation Models: A Comprehensive Reviewcited by 35
- 2025Accurate Parameter-Efficient Test-Time Adaptation for Time Series Forecastingcited by 13
- 2024Expand and Compress: Exploring Tuning Principles for Continual Spatio-Temporal Graph Forecastingcited by 10
- 2025Vision-Enhanced Time Series Forecasting via Latent Diffusion Modelscited by 9
- 2024Cross Space and Time: A Spatio-Temporal Unitized Model for Traffic Flow Forecastingcited by 3
- 2025RAST: A Retrieval Augmented Spatio-Temporal Framework for Traffic Predictioncited by 1
- 2026A General ReLearner: Empowering Spatiotemporal Prediction by Re-learning Input-label Residualcited by 1
- 2025Parameter-Efficient Fine-Tuning for HAR: Integrating LoRA and QLoRA into Transformer Modelscited by 0
- 2026Graph-Conditioned Mixture of Graph Neural Network Experts for Traffic Forecastingcited by 0
- 2026Graph-Conditioned Mixture of Graph Neural Network Experts for Traffic Forecasting28 May 2026
- 2026A General ReLearner: Empowering Spatiotemporal Prediction by Re-learning Input-label Residual30 Jan 2026
- 2025Parameter-Efficient Fine-Tuning for HAR: Integrating LoRA and QLoRA into Transformer Models19 Dec 2025
- 2025RAST: A Retrieval Augmented Spatio-Temporal Framework for Traffic Prediction14 Aug 2025
- 2025Accurate Parameter-Efficient Test-Time Adaptation for Time Series Forecasting29 Jun 2025
- 2025Vision-Enhanced Time Series Forecasting via Latent Diffusion Models16 Feb 2025
- 2024Low-Rank Adaptation for Foundation Models: A Comprehensive Review31 Dec 2024
- 2024Cross Space and Time: A Spatio-Temporal Unitized Model for Traffic Flow Forecasting14 Nov 2024
- 2024Expand and Compress: Exploring Tuning Principles for Continual Spatio-Temporal Graph Forecasting16 Oct 2024