mlsanityData to 14 Oct 2026

Long-term Wind Power Forecasting with Hierarchical Spatial-Temporal Transformer

arXiv 2305.18724 ↗First posted 30 May 2023cs.LG cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Wind power is attracting increasing attention around the world due to its renewable, pollution-free, and other advantages. However, safely and stably integrating the high permeability intermittent power energy into electric power systems remains challenging. Accurate wind power forecasting (WPF) can effectively reduce power fluctuations in power system operations. Existing methods are mainly designed for short-term predictions and lack effective spatial-temporal feature augmentation. In this work, we propose a novel end-to-end wind power forecasting model named Hierarchical Spatial-Temporal Transformer Network (HSTTN) to address the long-term WPF problems. Specifically, we construct an hourglass-shaped encoder-decoder framework with skip-connections to jointly model representations aggregated in hierarchical temporal scales, which benefits long-term forecasting. Based on this framework, we capture the inter-scale long-range temporal dependencies and global spatial correlations with two parallel Transformer skeletons and strengthen the intra-scale connections with downsampling and upsampling operations. Moreover, the complementary information from spatial and temporal features is fused and propagated in each other via Contextual Fusion Blocks (CFBs) to promote the prediction further. Extensive experimental results on two large-scale real-world datasets demonstrate the superior performance of our HSTTN over existing solutions.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 17 of its 49 references that are in the map. First posted on arXiv 30 May 2023.

Builds on

17 of 49 references.

References · 17

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  4. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  5. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  6. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  7. 2020Spatial-Temporal Transformer Networks for Traffic Flow Forecastingcited by 180
  8. 2022UMT: Unified Multi-modal Transformers for Joint Video Moment Retrieval and Highlight Detectioncited by 148
  9. 2019The role of artificial intelligence in achieving the Sustainable Development Goalscited by 100
  10. 2023CLIP-Count: Towards Text-Guided Zero-Shot Object Countingcited by 83
  11. 2021GroupFormer: Group Activity Recognition with Clustered Spatial-Temporal Transformercited by 54
  12. 2022RSTT: Real-time Spatial Temporal Transformer for Space-Time Video Super-Resolutioncited by 44
5 more
  1. 2022Preformer: Predictive Transformer with Multi-Scale Segment-wise Correlations for Long-Term Time Series Forecastingcited by 23
  2. 2021Online Metro Origin-Destination Prediction via Heterogeneous Information Aggregationcited by 12
  3. 2022Expressing Multivariate Time Series as Graphs with Time Series Attention Transformercited by 5
  4. 2021Road Network Guided Fine-Grained Urban Traffic Flow Inferencecited by 4
  5. 2022View-Disentangled Transformer for Brain Lesion Detectioncited by 4

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.