mlsanityData to 7 Oct 2026

LightCTS: A Lightweight Framework for Correlated Time Series Forecasting

arXiv 2302.11974 ↗First posted 23 Feb 2023cs.LG cs.AI cs.DBcited by 18

Not on the map. Why?

Abstract (arXiv)

Correlated time series (CTS) forecasting plays an essential role in many practical applications, such as traffic management and server load control. Many deep learning models have been proposed to improve the accuracy of CTS forecasting. However, while models have become increasingly complex and computationally intensive, they struggle to improve accuracy. Pursuing a different direction, this study aims instead to enable much more efficient, lightweight models that preserve accuracy while being able to be deployed on resource-constrained devices. To achieve this goal, we characterize popular CTS forecasting models and yield two observations that indicate directions for lightweight CTS forecasting. On this basis, we propose the LightCTS framework that adopts plain stacking of temporal and spatial operators instead of alternate stacking that is much more computationally expensive. Moreover, LightCTS features light temporal and spatial operator modules, called L-TCN and GL-Former, that offer improved computational efficiency without compromising their feature extraction capabilities. LightCTS also encompasses a last-shot compression scheme to reduce redundant temporal features and speed up subsequent computations. Experiments with single-step and multi-step forecasting benchmark datasets show that LightCTS is capable of nearly state-of-the-art accuracy at much reduced computational and storage overheads.

Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 42 of its 74 references that are in the map. First posted on arXiv 23 Feb 2023.

Builds on

42 of 74 references.

References · 42

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  4. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  5. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
  6. 2017Squeeze-and-Excitation Networkscited by 4,763
  7. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,827
  8. 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,540
  9. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
  10. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  11. 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
  12. 2015Learning both Weights and Connections for Efficient Neural Networkscited by 1,998
30 more
  1. 2019Searching for MobileNetV3cited by 1,984
  2. 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
  3. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,414
  4. 2017ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devicescited by 1,194
  5. 2019TinyBERT: Distilling BERT for Natural Language Understandingcited by 1,153
  6. 2015Multi-Scale Context Aggregation by Dilated Convolutionscited by 1,128
  7. 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
  8. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 869
  9. 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 820
  10. 2019Are Sixteen Heads Really Better than One?cited by 803
  11. 2021MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformercited by 636
  12. 2020Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networkscited by 563
  13. 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 525
  14. 2019Diffusion Improves Graph Learningcited by 414
  15. 2019GhostNet: More Features from Cheap Operationscited by 410
  16. 2017NISP: Pruning Networks using Neuron Importance Score Propagationcited by 228
  17. 2016Temporal Convolutional Networks: A Unified Approach to Action Segmentationcited by 199
  18. 2020Spatial-Temporal Transformer Networks for Traffic Flow Forecastingcited by 179
  19. 2018Temporal Pattern Attention for Multivariate Time Series Forecastingcited by 125
  20. 2017Shift: A Zero FLOP, Zero Parameter Alternative to Spatial Convolutionscited by 93
  21. 2021Dynamic Slimmable Networkcited by 83
  22. 2019Multi-Range Attentive Bicomponent Graph Convolutional Network for Traffic Forecastingcited by 69
  23. 2021AutoCTS: Automated Correlated Time Series Forecasting -- Extended Versioncited by 48
  24. 2021Long-Range Transformers for Dynamic Spatiotemporal Forecastingcited by 46
  25. 2022Multi-Scale Adaptive Graph Neural Network for Multivariate Time Series Forecastingcited by 42
  26. 2018Deep Air Quality Forecasting Using Hybrid Deep Learning Frameworkcited by 33
  27. 2021A survey on multi-objective hyperparameter optimization algorithms for Machine Learningcited by 24
  28. 2018A Memory-Network Based Solution for Multivariate Time-Series Forecastingcited by 21
  29. 2021BN-NAS: Neural Architecture Search with Batch Normalizationcited by 21
  30. 2020An Efficient Method of Training Small Models for Regression Problems with Knowledge Distillationcited by 14

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 8; 2025: 5; 2026: 4.

18 papers.

Sort:

By area:

  1. 2023Large Models for Time Series and Spatio-Temporal Data: A Survey and Outlookcited by 109
  2. 2024Universal Time-Series Representation Learning: A Surveycited by 28
  3. 2024LightTR: A Lightweight Framework for Federated Trajectory Recoverycited by 19
  4. 2024AutoSTF: Decoupled Neural Architecture Search for Cost-Effective Automated Spatio-Temporal Forecastingcited by 9
  5. 2025Multimodal Conditioned Diffusive Time Series Forecastingcited by 8
  6. 2024E2USD: Efficient-yet-effective Unsupervised State Detection for Multivariate Time Seriescited by 7
  7. 2024NRFormer: Nationwide Nuclear Radiation Forecasting with Spatio-Temporal Transformercited by 4
  8. 2024Scalable Transformer for High Dimensional Multivariate Time Series Forecastingcited by 3
  9. 2024WaveRoRA: Wavelet Rotary Route Attention for Multivariate Time Series Forecastingcited by 3
  10. 2025Pace: Physics-Aware Attentive Temporal Convolutional Network for Battery Health Estimationcited by 2
  11. 2026Effective Dataset Distillation for Spatio-Temporal Forecasting with Bi-dimensional Compressioncited by 2
  12. 2025HADL Framework for Noise Resilient Long-Term Time Series Forecastingcited by 1
6 more
  1. 2025LLMs Meet Cross-Modal Time Series Analytics: Overview and Directionscited by 1
  2. 2024Online Algorithm for Node Feature Forecasting in Temporal Graphscited by 0
  3. 2025Accurate and Efficient Multivariate Time Series Forecasting via Offline Clusteringcited by 0
  4. 2026Impute On-Demand: Adaptive Correlated Time Series Imputation for Changing Environmentscited by 0
  5. 2026Atmospheric Diffusion-Guided Spatio-Temporal Transformer for Nuclear Radiation Forecastingcited by 0
  6. 2026F2STNet: Fair and Federated Spectral-Temporal Modeling for Graph Forecastingcited by 0