mlsanityData to 7 Oct 2026

Channel-Aware Low-Rank Adaptation in Time Series Forecasting

arXiv 2407.17246 ↗First posted 24 Jul 2024cs.LGcited by 12

Not on the map. Why?

Abstract (arXiv)

The balance between model capacity and generalization has been a key focus of recent discussions in long-term time series forecasting. Two representative channel strategies are closely associated with model expressivity and robustness, including channel independence (CI) and channel dependence (CD). The former adopts individual channel treatment and has been shown to be more robust to distribution shifts, but lacks sufficient capacity to model meaningful channel interactions. The latter is more expressive for representing complex cross-channel dependencies, but is prone to overfitting. To balance the two strategies, we present a channel-aware low-rank adaptation method to condition CD models on identity-aware individual components. As a plug-in solution, it is adaptable for a wide range of backbone architectures. Extensive experiments show that it can consistently and significantly improve the performance of both CI and CD models with demonstrated efficiency and flexibility. The code is available at https://github.com/tongnie/C-LoRA.

Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 10 of its 21 references that are in the map. First posted on arXiv 24 Jul 2024.

Builds on

10 of 21 references.

References · 10

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  3. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  4. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  5. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
  6. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
  7. 2023LargeST: A Benchmark Dataset for Large-Scale Traffic Forecastingcited by 116
  8. 2023ImputeFormer: Low Rankness-Induced Transformers for Generalizable Spatiotemporal Imputationcited by 50
  9. 2023Taming Local Effects in Graph-based Spatiotemporal Forecastingcited by 37
  10. 2022Correlating sparse sensing for large-scale traffic speed estimation: A Laplacian-enhanced low-rank tensor kriging approachcited by 17

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 11.

12 papers.