Skillful Twelve Hour Precipitation Forecasts using Large Context Neural Networks
Not on the map. Why?
Abstract (arXiv)
The problem of forecasting weather has been scientifically studied for centuries due to its high impact on human lives, transportation, food production and energy management, among others. Current operational forecasting models are based on physics and use supercomputers to simulate the atmosphere to make forecasts hours and days in advance. Better physics-based forecasts require improvements in the models themselves, which can be a substantial scientific challenge, as well as improvements in the underlying resolution, which can be computationally prohibitive. An emerging class of weather models based on neural networks represents a paradigm shift in weather forecasting: the models learn the required transformations from data instead of relying on hand-coded physics and are computationally efficient. For neural models, however, each additional hour of lead time poses a substantial challenge as it requires capturing ever larger spatial contexts and increases the uncertainty of the prediction. In this work, we present a neural network that is capable of large-scale precipitation forecasting up to twelve hours ahead and, starting from the same atmospheric state, the model achieves greater skill than the state-of-the-art physics-based models HRRR and HREF that currently operate in the Continental United States. Interpretability analyses reinforce the observation that the model learns to emulate advanced physics principles. These results represent a substantial step towards establishing a new paradigm of efficient forecasting with neural networks.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 14 of its 35 references that are in the map. First posted on arXiv 14 Nov 2021.
Builds on
14 of 35 references.
References · 14
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
- 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
- 2021Skillful Precipitation Nowcasting using Deep Generative Models of Radarcited by 308
- 2020MetNet: A Neural Weather Model for Precipitation Forecastingcited by 128
- 2021GSPMD: General and Scalable Parallelization for ML Computation Graphscited by 109
- 2018Neural networks for post-processing ensemble weather forecastscited by 95
- 2020SmaAt-UNet: Precipitation Nowcasting using a Small Attention-UNet Architecturecited by 71
- 2016Neural Machine Translation in Linear Timecited by 65
- 2019Machine Learning for Precipitation Nowcasting from Radar Imagescited by 56
- 2020A review of radar-based nowcasting of precipitation and applicable machine learning techniquescited by 19
Built on by
Citing papers per year: 2022: 14; 2023: 3; 2024: 2; 2025: 0; 2026: 1.
20 papers.
Sort:
By area:
- 2022Forecasting Global Weather with Graph Neural Networkscited by 165
- 2022Earthformer: Exploring Space-Time Transformers for Earth System Forecastingcited by 146
- 2023PreDiff: Precipitation Nowcasting with Latent Diffusion Modelscited by 96
- 2022A Generative Deep Learning Approach to Stochastic Downscaling of Precipitation Forecastscited by 64
- 2022SimPer: Simple Self-Supervised Learning of Periodic Targetscited by 44
- 2022Robust Hybrid Learning With Expert Augmentationcited by 17
- 2022WeatherBench Probability: A benchmark dataset for probabilistic medium-range weather forecasting along with deep learning baseline modelscited by 16
- 2022Traffic4cast at NeurIPS 2021 -- Temporal and Spatial Few-Shot Transfer Learning in Gridded Geo-Spatial Processescited by 15
- 2022Spatial Mixture-of-Expertscited by 14
- 2022Global Extreme Heat Forecasting Using Neural Weather Modelscited by 13
- 2022ENS-10: A Dataset For Post-Processing Ensemble Weather Forecastscited by 13
- 2022Benchmark Dataset for Precipitation Forecasting by Post-Processing the Numerical Weather Predictioncited by 5
8 more
- 2022Forecasting large-scale circulation regimes using deformable convolutional neural networks and global spatiotemporal climate datacited by 3
- 2022Deep-Learning-Based Precipitation Nowcasting with Ground Weather Station Data and Radar Datacited by 3
- 2023Inductive biases in deep learning models for weather predictioncited by 3
- 2024Evidential Deep Learning for Probabilistic Modelling of Extreme Storm Eventscited by 2
- 2023RainAI -- Precipitation Nowcasting from Satellite Datacited by 1
- 2022Tools for Extracting Spatio-Temporal Patterns in Meteorological Image Sequences: From Feature Engineering to Attention-Based Neural Networkscited by 0
- 2024Multi-Source Temporal Attention Network for Precipitation Nowcastingcited by 0
- 2026TSSM: Triaxial State Space Model for Global Station Weather Forecasting with Temporal-Variable-Historical Modelingcited by 0
- 2026TSSM: Triaxial State Space Model for Global Station Weather Forecasting with Temporal-Variable-Historical Modeling14 Jul 2026
- 2024Evidential Deep Learning for Probabilistic Modelling of Extreme Storm Events18 Dec 2024
- 2024Multi-Source Temporal Attention Network for Precipitation Nowcasting11 Oct 2024
- 2023RainAI -- Precipitation Nowcasting from Satellite Data30 Nov 2023
- 2023PreDiff: Precipitation Nowcasting with Latent Diffusion Models19 Jul 2023
- 2023Inductive biases in deep learning models for weather prediction6 Apr 2023
- 2022Spatial Mixture-of-Experts24 Nov 2022
- 2022Tools for Extracting Spatio-Temporal Patterns in Meteorological Image Sequences: From Feature Engineering to Attention-Based Neural Networks22 Oct 2022
- 2022Deep-Learning-Based Precipitation Nowcasting with Ground Weather Station Data and Radar Data20 Oct 2022
- 2022SimPer: Simple Self-Supervised Learning of Periodic Targets6 Oct 2022
- 2022Earthformer: Exploring Space-Time Transformers for Earth System Forecasting12 Jul 2022
- 2022Benchmark Dataset for Precipitation Forecasting by Post-Processing the Numerical Weather Prediction30 Jun 2022
8 more
- 2022ENS-10: A Dataset For Post-Processing Ensemble Weather Forecasts29 Jun 2022
- 2022Global Extreme Heat Forecasting Using Neural Weather Models23 May 2022
- 2022WeatherBench Probability: A benchmark dataset for probabilistic medium-range weather forecasting along with deep learning baseline models2 May 2022
- 2022A Generative Deep Learning Approach to Stochastic Downscaling of Precipitation Forecasts5 Apr 2022
- 2022Traffic4cast at NeurIPS 2021 -- Temporal and Spatial Few-Shot Transfer Learning in Gridded Geo-Spatial Processes31 Mar 2022
- 2022Forecasting Global Weather with Graph Neural Networks15 Feb 2022
- 2022Forecasting large-scale circulation regimes using deformable convolutional neural networks and global spatiotemporal climate data10 Feb 2022
- 2022Robust Hybrid Learning With Expert Augmentation8 Feb 2022
- 2022Spatial Mixture-of-Expertscited by 14
- 2022Spatial Mixture-of-Experts24 Nov 2022
- 2022Forecasting Global Weather with Graph Neural Networkscited by 165
- 2022Earthformer: Exploring Space-Time Transformers for Earth System Forecastingcited by 146
- 2022A Generative Deep Learning Approach to Stochastic Downscaling of Precipitation Forecastscited by 64
- 2022SimPer: Simple Self-Supervised Learning of Periodic Targetscited by 44
- 2022Robust Hybrid Learning With Expert Augmentationcited by 17
- 2022WeatherBench Probability: A benchmark dataset for probabilistic medium-range weather forecasting along with deep learning baseline modelscited by 16
- 2022Traffic4cast at NeurIPS 2021 -- Temporal and Spatial Few-Shot Transfer Learning in Gridded Geo-Spatial Processescited by 15
- 2022Global Extreme Heat Forecasting Using Neural Weather Modelscited by 13
- 2022ENS-10: A Dataset For Post-Processing Ensemble Weather Forecastscited by 13
- 2022Benchmark Dataset for Precipitation Forecasting by Post-Processing the Numerical Weather Predictioncited by 5
- 2022Forecasting large-scale circulation regimes using deformable convolutional neural networks and global spatiotemporal climate datacited by 3
- 2022Deep-Learning-Based Precipitation Nowcasting with Ground Weather Station Data and Radar Datacited by 3
12 most cited of 18 All 18 (JSON)
- 2026TSSM: Triaxial State Space Model for Global Station Weather Forecasting with Temporal-Variable-Historical Modeling14 Jul 2026
- 2024Evidential Deep Learning for Probabilistic Modelling of Extreme Storm Events18 Dec 2024
- 2024Multi-Source Temporal Attention Network for Precipitation Nowcasting11 Oct 2024
- 2023RainAI -- Precipitation Nowcasting from Satellite Data30 Nov 2023
- 2023Inductive biases in deep learning models for weather prediction6 Apr 2023
- 2022Tools for Extracting Spatio-Temporal Patterns in Meteorological Image Sequences: From Feature Engineering to Attention-Based Neural Networks22 Oct 2022
- 2022Deep-Learning-Based Precipitation Nowcasting with Ground Weather Station Data and Radar Data20 Oct 2022
- 2022SimPer: Simple Self-Supervised Learning of Periodic Targets6 Oct 2022
- 2022Earthformer: Exploring Space-Time Transformers for Earth System Forecasting12 Jul 2022
- 2022Benchmark Dataset for Precipitation Forecasting by Post-Processing the Numerical Weather Prediction30 Jun 2022
- 2022ENS-10: A Dataset For Post-Processing Ensemble Weather Forecasts29 Jun 2022
- 2022Global Extreme Heat Forecasting Using Neural Weather Models23 May 2022
12 newest of 18 All 18 (JSON)