LightCTS: A Lightweight Framework for Correlated Time Series Forecasting
Not on the map. Why?
Abstract (arXiv)
Correlated time series (CTS) forecasting plays an essential role in many practical applications, such as traffic management and server load control. Many deep learning models have been proposed to improve the accuracy of CTS forecasting. However, while models have become increasingly complex and computationally intensive, they struggle to improve accuracy. Pursuing a different direction, this study aims instead to enable much more efficient, lightweight models that preserve accuracy while being able to be deployed on resource-constrained devices. To achieve this goal, we characterize popular CTS forecasting models and yield two observations that indicate directions for lightweight CTS forecasting. On this basis, we propose the LightCTS framework that adopts plain stacking of temporal and spatial operators instead of alternate stacking that is much more computationally expensive. Moreover, LightCTS features light temporal and spatial operator modules, called L-TCN and GL-Former, that offer improved computational efficiency without compromising their feature extraction capabilities. LightCTS also encompasses a last-shot compression scheme to reduce redundant temporal features and speed up subsequent computations. Experiments with single-step and multi-step forecasting benchmark datasets show that LightCTS is capable of nearly state-of-the-art accuracy at much reduced computational and storage overheads.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 42 of its 74 references that are in the map. First posted on arXiv 23 Feb 2023.
Builds on
42 of 74 references.
References · 42
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
- 2017Squeeze-and-Excitation Networkscited by 4,763
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,827
- 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,540
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
- 2015Learning both Weights and Connections for Efficient Neural Networkscited by 1,998
30 more
- 2019Searching for MobileNetV3cited by 1,984
- 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
- 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,414
- 2017ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devicescited by 1,194
- 2019TinyBERT: Distilling BERT for Natural Language Understandingcited by 1,153
- 2015Multi-Scale Context Aggregation by Dilated Convolutionscited by 1,128
- 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
- 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 869
- 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 820
- 2019Are Sixteen Heads Really Better than One?cited by 803
- 2021MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformercited by 636
- 2020Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networkscited by 563
- 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 525
- 2019Diffusion Improves Graph Learningcited by 414
- 2019GhostNet: More Features from Cheap Operationscited by 410
- 2017NISP: Pruning Networks using Neuron Importance Score Propagationcited by 228
- 2016Temporal Convolutional Networks: A Unified Approach to Action Segmentationcited by 199
- 2020Spatial-Temporal Transformer Networks for Traffic Flow Forecastingcited by 179
- 2018Temporal Pattern Attention for Multivariate Time Series Forecastingcited by 125
- 2017Shift: A Zero FLOP, Zero Parameter Alternative to Spatial Convolutionscited by 93
- 2021Dynamic Slimmable Networkcited by 83
- 2019Multi-Range Attentive Bicomponent Graph Convolutional Network for Traffic Forecastingcited by 69
- 2021AutoCTS: Automated Correlated Time Series Forecasting -- Extended Versioncited by 48
- 2021Long-Range Transformers for Dynamic Spatiotemporal Forecastingcited by 46
- 2022Multi-Scale Adaptive Graph Neural Network for Multivariate Time Series Forecastingcited by 42
- 2018Deep Air Quality Forecasting Using Hybrid Deep Learning Frameworkcited by 33
- 2021A survey on multi-objective hyperparameter optimization algorithms for Machine Learningcited by 24
- 2018A Memory-Network Based Solution for Multivariate Time-Series Forecastingcited by 21
- 2021BN-NAS: Neural Architecture Search with Batch Normalizationcited by 21
- 2020An Efficient Method of Training Small Models for Regression Problems with Knowledge Distillationcited by 14
Built on by
Citing papers per year: 2023: 1; 2024: 8; 2025: 5; 2026: 4.
18 papers.
Sort:
By area:
- 2023Large Models for Time Series and Spatio-Temporal Data: A Survey and Outlookcited by 109
- 2024Universal Time-Series Representation Learning: A Surveycited by 28
- 2024LightTR: A Lightweight Framework for Federated Trajectory Recoverycited by 19
- 2024AutoSTF: Decoupled Neural Architecture Search for Cost-Effective Automated Spatio-Temporal Forecastingcited by 9
- 2025Multimodal Conditioned Diffusive Time Series Forecastingcited by 8
- 2024E2USD: Efficient-yet-effective Unsupervised State Detection for Multivariate Time Seriescited by 7
- 2024NRFormer: Nationwide Nuclear Radiation Forecasting with Spatio-Temporal Transformercited by 4
- 2024Scalable Transformer for High Dimensional Multivariate Time Series Forecastingcited by 3
- 2024WaveRoRA: Wavelet Rotary Route Attention for Multivariate Time Series Forecastingcited by 3
- 2025Pace: Physics-Aware Attentive Temporal Convolutional Network for Battery Health Estimationcited by 2
- 2026Effective Dataset Distillation for Spatio-Temporal Forecasting with Bi-dimensional Compressioncited by 2
- 2025HADL Framework for Noise Resilient Long-Term Time Series Forecastingcited by 1
6 more
- 2025LLMs Meet Cross-Modal Time Series Analytics: Overview and Directionscited by 1
- 2024Online Algorithm for Node Feature Forecasting in Temporal Graphscited by 0
- 2025Accurate and Efficient Multivariate Time Series Forecasting via Offline Clusteringcited by 0
- 2026Impute On-Demand: Adaptive Correlated Time Series Imputation for Changing Environmentscited by 0
- 2026Atmospheric Diffusion-Guided Spatio-Temporal Transformer for Nuclear Radiation Forecastingcited by 0
- 2026F2STNet: Fair and Federated Spectral-Temporal Modeling for Graph Forecastingcited by 0
- 2026F2STNet: Fair and Federated Spectral-Temporal Modeling for Graph Forecasting10 Aug 2026
- 2026Impute On-Demand: Adaptive Correlated Time Series Imputation for Changing Environments26 Jul 2026
- 2026Atmospheric Diffusion-Guided Spatio-Temporal Transformer for Nuclear Radiation Forecasting12 Jun 2026
- 2026Effective Dataset Distillation for Spatio-Temporal Forecasting with Bi-dimensional Compression11 Mar 2026
- 2025Pace: Physics-Aware Attentive Temporal Convolutional Network for Battery Health Estimation12 Dec 2025
- 2025LLMs Meet Cross-Modal Time Series Analytics: Overview and Directions13 Jul 2025
- 2025Accurate and Efficient Multivariate Time Series Forecasting via Offline Clustering9 May 2025
- 2025Multimodal Conditioned Diffusive Time Series Forecasting28 Apr 2025
- 2025HADL Framework for Noise Resilient Long-Term Time Series Forecasting14 Feb 2025
- 2024WaveRoRA: Wavelet Rotary Route Attention for Multivariate Time Series Forecasting30 Oct 2024
- 2024NRFormer: Nationwide Nuclear Radiation Forecasting with Spatio-Temporal Transformer15 Oct 2024
- 2024AutoSTF: Decoupled Neural Architecture Search for Cost-Effective Automated Spatio-Temporal Forecasting25 Sep 2024
6 more
- 2024Scalable Transformer for High Dimensional Multivariate Time Series Forecasting8 Aug 2024
- 2024LightTR: A Lightweight Framework for Federated Trajectory Recovery6 May 2024
- 2024E2USD: Efficient-yet-effective Unsupervised State Detection for Multivariate Time Series21 Feb 2024
- 2024Online Algorithm for Node Feature Forecasting in Temporal Graphs30 Jan 2024
- 2024Universal Time-Series Representation Learning: A Survey8 Jan 2024
- 2023Large Models for Time Series and Spatio-Temporal Data: A Survey and Outlook16 Oct 2023
- 2025Multimodal Conditioned Diffusive Time Series Forecastingcited by 8
- 2025Multimodal Conditioned Diffusive Time Series Forecasting28 Apr 2025
- 2023Large Models for Time Series and Spatio-Temporal Data: A Survey and Outlookcited by 109
- 2024Universal Time-Series Representation Learning: A Surveycited by 28
- 2024LightTR: A Lightweight Framework for Federated Trajectory Recoverycited by 19
- 2024AutoSTF: Decoupled Neural Architecture Search for Cost-Effective Automated Spatio-Temporal Forecastingcited by 9
- 2024E2USD: Efficient-yet-effective Unsupervised State Detection for Multivariate Time Seriescited by 7
- 2024NRFormer: Nationwide Nuclear Radiation Forecasting with Spatio-Temporal Transformercited by 4
- 2024Scalable Transformer for High Dimensional Multivariate Time Series Forecastingcited by 3
- 2024WaveRoRA: Wavelet Rotary Route Attention for Multivariate Time Series Forecastingcited by 3
- 2025Pace: Physics-Aware Attentive Temporal Convolutional Network for Battery Health Estimationcited by 2
- 2026Effective Dataset Distillation for Spatio-Temporal Forecasting with Bi-dimensional Compressioncited by 2
- 2025HADL Framework for Noise Resilient Long-Term Time Series Forecastingcited by 1
- 2025LLMs Meet Cross-Modal Time Series Analytics: Overview and Directionscited by 1
12 most cited of 17 All 17 (JSON)
- 2026F2STNet: Fair and Federated Spectral-Temporal Modeling for Graph Forecasting10 Aug 2026
- 2026Impute On-Demand: Adaptive Correlated Time Series Imputation for Changing Environments26 Jul 2026
- 2026Atmospheric Diffusion-Guided Spatio-Temporal Transformer for Nuclear Radiation Forecasting12 Jun 2026
- 2026Effective Dataset Distillation for Spatio-Temporal Forecasting with Bi-dimensional Compression11 Mar 2026
- 2025Pace: Physics-Aware Attentive Temporal Convolutional Network for Battery Health Estimation12 Dec 2025
- 2025LLMs Meet Cross-Modal Time Series Analytics: Overview and Directions13 Jul 2025
- 2025Accurate and Efficient Multivariate Time Series Forecasting via Offline Clustering9 May 2025
- 2025HADL Framework for Noise Resilient Long-Term Time Series Forecasting14 Feb 2025
- 2024WaveRoRA: Wavelet Rotary Route Attention for Multivariate Time Series Forecasting30 Oct 2024
- 2024NRFormer: Nationwide Nuclear Radiation Forecasting with Spatio-Temporal Transformer15 Oct 2024
- 2024AutoSTF: Decoupled Neural Architecture Search for Cost-Effective Automated Spatio-Temporal Forecasting25 Sep 2024
- 2024Scalable Transformer for High Dimensional Multivariate Time Series Forecasting8 Aug 2024
12 newest of 17 All 17 (JSON)