mlsanityData to 7 Oct 2026

Skillful Twelve Hour Precipitation Forecasts using Large Context Neural Networks

arXiv 2111.07470 ↗First posted 14 Nov 2021cs.LG physics.ao-phcited by 20

Not on the map. Why?

Abstract (arXiv)

The problem of forecasting weather has been scientifically studied for centuries due to its high impact on human lives, transportation, food production and energy management, among others. Current operational forecasting models are based on physics and use supercomputers to simulate the atmosphere to make forecasts hours and days in advance. Better physics-based forecasts require improvements in the models themselves, which can be a substantial scientific challenge, as well as improvements in the underlying resolution, which can be computationally prohibitive. An emerging class of weather models based on neural networks represents a paradigm shift in weather forecasting: the models learn the required transformations from data instead of relying on hand-coded physics and are computationally efficient. For neural models, however, each additional hour of lead time poses a substantial challenge as it requires capturing ever larger spatial contexts and increases the uncertainty of the prediction. In this work, we present a neural network that is capable of large-scale precipitation forecasting up to twelve hours ahead and, starting from the same atmospheric state, the model achieves greater skill than the state-of-the-art physics-based models HRRR and HREF that currently operate in the Continental United States. Interpretability analyses reinforce the observation that the model learns to emulate advanced physics principles. These results represent a substantial step towards establishing a new paradigm of efficient forecasting with neural networks.

Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 14 of its 35 references that are in the map. First posted on arXiv 14 Nov 2021.

Builds on

14 of 35 references.

References · 14

  1. 2017Axiomatic Attribution for Deep Networkscited by 3,350
  2. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
  3. 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
  4. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
  5. 2021Skillful Precipitation Nowcasting using Deep Generative Models of Radarcited by 308
  6. 2020MetNet: A Neural Weather Model for Precipitation Forecastingcited by 128
  7. 2021GSPMD: General and Scalable Parallelization for ML Computation Graphscited by 109
  8. 2018Neural networks for post-processing ensemble weather forecastscited by 95
  9. 2020SmaAt-UNet: Precipitation Nowcasting using a Small Attention-UNet Architecturecited by 71
  10. 2016Neural Machine Translation in Linear Timecited by 65
  11. 2019Machine Learning for Precipitation Nowcasting from Radar Imagescited by 56
  12. 2020A review of radar-based nowcasting of precipitation and applicable machine learning techniquescited by 19
2 more
  1. 2020Wind speed prediction using multidimensional convolutional neural networkscited by 17
  2. 2020PlumeNet: Large-Scale Air Quality Forecasting Using A Convolutional LSTM Networkcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 14; 2023: 3; 2024: 2; 2025: 0; 2026: 1.

20 papers.

Sort:

By area:

  1. 2022Forecasting Global Weather with Graph Neural Networkscited by 165
  2. 2022Earthformer: Exploring Space-Time Transformers for Earth System Forecastingcited by 146
  3. 2023PreDiff: Precipitation Nowcasting with Latent Diffusion Modelscited by 96
  4. 2022A Generative Deep Learning Approach to Stochastic Downscaling of Precipitation Forecastscited by 64
  5. 2022SimPer: Simple Self-Supervised Learning of Periodic Targetscited by 44
  6. 2022Robust Hybrid Learning With Expert Augmentationcited by 17
  7. 2022WeatherBench Probability: A benchmark dataset for probabilistic medium-range weather forecasting along with deep learning baseline modelscited by 16
  8. 2022Traffic4cast at NeurIPS 2021 -- Temporal and Spatial Few-Shot Transfer Learning in Gridded Geo-Spatial Processescited by 15
  9. 2022Spatial Mixture-of-Expertscited by 14
  10. 2022Global Extreme Heat Forecasting Using Neural Weather Modelscited by 13
  11. 2022ENS-10: A Dataset For Post-Processing Ensemble Weather Forecastscited by 13
  12. 2022Benchmark Dataset for Precipitation Forecasting by Post-Processing the Numerical Weather Predictioncited by 5
8 more
  1. 2022Forecasting large-scale circulation regimes using deformable convolutional neural networks and global spatiotemporal climate datacited by 3
  2. 2022Deep-Learning-Based Precipitation Nowcasting with Ground Weather Station Data and Radar Datacited by 3
  3. 2023Inductive biases in deep learning models for weather predictioncited by 3
  4. 2024Evidential Deep Learning for Probabilistic Modelling of Extreme Storm Eventscited by 2
  5. 2023RainAI -- Precipitation Nowcasting from Satellite Datacited by 1
  6. 2022Tools for Extracting Spatio-Temporal Patterns in Meteorological Image Sequences: From Feature Engineering to Attention-Based Neural Networkscited by 0
  7. 2024Multi-Source Temporal Attention Network for Precipitation Nowcastingcited by 0
  8. 2026TSSM: Triaxial State Space Model for Global Station Weather Forecasting with Temporal-Variable-Historical Modelingcited by 0