Extreme precipitation forecasting using attention augmented convolutions
Not on the map. Why?
Abstract (arXiv)
Extreme precipitation wreaks havoc throughout the world, causing billions of dollars in damage and uprooting communities, ecosystems, and economies. Accurate extreme precipitation prediction allows more time for preparation and disaster risk management for such extreme events. In this paper, we focus on short-term extreme precipitation forecasting (up to a 12-hour ahead-of-time prediction) from a sequence of sea level pressure and zonal wind anomalies. Although existing machine learning approaches have shown promising results, the associated model and climate uncertainties may reduce their reliability. To address this issue, we propose a self-attention augmented convolution mechanism for extreme precipitation forecasting, systematically combining attention scores with traditional convolutions to enrich feature data and reduce the expected errors of the results. The proposed network architecture is further fused with a highway neural network layer to gain the benefits of unimpeded information flow across several layers. Our experimental results show that the framework outperforms classical convolutional models by 12%. The proposed method increases machine learning as a tool for gaining insights into the physical causes of changing extremes, lowering uncertainty in future forecasts.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 9 of its 17 references that are in the map. First posted on arXiv 31 Jan 2022.
Builds on
9 of 17 references.
References · 9
- 2017Attention Is All You Needcited by 59,932
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
- 2019On the Relationship between Self-Attention and Convolutional Layerscited by 299
- 2018QANet: Combining Local Convolution with Global Self-Attention for Reading Comprehensioncited by 164
- 2019Analog forecasting of extreme-causing weather patterns using deep learningcited by 33
- 2019Convolutional Self-Attention Networkscited by 32
- 2016Application of Deep Convolutional Neural Networks for Detecting Extreme Weather in Climate Datasetscited by 31
- 2020Sub-Seasonal Climate Forecasting via Machine Learning: Challenges, Analysis, and Advancescited by 15
- 2021Extreme Precipitation Seasonal Forecast Using a Transformer Neural Networkcited by 2
Built on by
Citing papers per year: 2025: 1.
1 paper.