mlsanityData to 14 Oct 2026

TCNFormer: Temporal Convolutional Network Former for Short-Term Wind Speed Forecasting

arXiv 2408.15737 ↗First posted 27 Aug 2024cs.LG cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Global environmental challenges and rising energy demands have led to extensive exploration of wind energy technologies. Accurate wind speed forecasting (WSF) is crucial for optimizing wind energy capture and ensuring system stability. However, predicting wind speed remains challenging due to its inherent randomness, fluctuation, and unpredictability. This study proposes the Temporal Convolutional Network Former (TCNFormer) for short-term (12-hour) wind speed forecasting. The TCNFormer integrates the Temporal Convolutional Network (TCN) and transformer encoder to capture the spatio-temporal features of wind speed. The transformer encoder consists of two distinct attention mechanisms: causal temporal multi-head self-attention (CT-MSA) and temporal external attention (TEA). CT-MSA ensures that the output of a step derives only from previous steps, i.e., causality. Locality is also introduced to improve efficiency. TEA explores potential relationships between different sample sequences in wind speed data. This study utilizes wind speed data from the NASA Prediction of Worldwide Energy Resources (NASA POWER) of Patenga Sea Beach, Chittagong, Bangladesh (latitude 22.2352deg N, longitude 91.7914deg E) over a year (six seasons). The findings indicate that the TCNFormer outperforms state-of-the-art models in prediction accuracy. The proposed TCNFormer presents a promising method for spatio-temporal WSF and may achieve desirable performance in real-world applications of wind power systems.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 14 of its 52 references that are in the map. First posted on arXiv 27 Aug 2024.

Builds on

14 of 52 references.

References · 14

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
  4. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  5. 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,476
  6. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,013
  7. 2019Graph WaveNet for Deep Spatial-Temporal Graph Modelingcited by 829
  8. 2023Koopa: Learning Non-stationary Time Series Dynamics with Koopman Predictorscited by 113
  9. 2022AirFormer: Predicting Nationwide Air Quality in China with Transformerscited by 73
  10. 2021Z-GCNETs: Time Zigzags at Graph Convolutional Networks for Time Series Forecastingcited by 67
  11. 2022Triformer: Triangular, Variable-Specific Attentions for Long Sequence Multivariate Time Series Forecasting--Full Versioncited by 59
  12. 2022Bridging the Gap Between Vision Transformers and Convolutional Neural Networks on Small Datasetscited by 29
2 more
  1. 2019Medical Time Series Classification with Hierarchical Attention-based Temporal Convolutional Networks: A Case Study of Myotonic Dystrophy Diagnosiscited by 10
  2. 2022A Vision Transformer-Based Approach to Bearing Fault Classification via Vibration Signalscited by 3

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.