Deep Learning for Day Forecasts from Sparse Observations
Not on the map. Why?
Abstract (arXiv)
Deep neural networks offer an alternative paradigm for modeling weather conditions. The ability of neural models to make a prediction in less than a second once the data is available and to do so with very high temporal and spatial resolution, and the ability to learn directly from atmospheric observations, are just some of these models' unique advantages. Neural models trained using atmospheric observations, the highest fidelity and lowest latency data, have to date achieved good performance only up to twelve hours of lead time when compared with state-of-the-art probabilistic Numerical Weather Prediction models and only for the sole variable of precipitation. In this paper, we present MetNet-3 that extends significantly both the lead time range and the variables that an observation based neural model can predict well. MetNet-3 learns from both dense and sparse data sensors and makes predictions up to 24 hours ahead for precipitation, wind, temperature and dew point. MetNet-3 introduces a key densification technique that implicitly captures data assimilation and produces spatially dense forecasts in spite of the network training on extremely sparse targets. MetNet-3 has a high temporal and spatial resolution of, respectively, up to 2 minutes and 1 km as well as a low operational latency. We find that MetNet-3 is able to outperform the best single- and multi-member NWPs such as HRRR and ENS over the CONUS region for up to 24 hours ahead setting a new performance milestone for observation based neural models. MetNet-3 is operational and its forecasts are served in Google Search in conjunction with other models.
Key facts. Cited by 72 papers in the map (data through 14 Oct 2026). Builds on 25 of its 37 references that are in the map. First posted on arXiv 6 Jun 2023.
Builds on
25 of 37 references.
References · 25
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2016Layer Normalizationcited by 5,669
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
- 2017Squeeze-and-Excitation Networkscited by 4,789
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
- 2016Gaussian Error Linear Units (GELUs)cited by 3,502
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2019Generating Long Sequences with Sparse Transformerscited by 1,546
- 2017Mixed Precision Trainingcited by 1,156
- 2016Deep Networks with Stochastic Depthcited by 979
13 more
- 2020On Layer Normalization in the Transformer Architecturecited by 922
- 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
- 2023Scaling Vision Transformers to 22 Billion Parameterscited by 694
- 2022MaxViT: Multi-Axis Vision Transformercited by 476
- 2023ClimaX: A foundation model for weather and climatecited by 337
- 2020WeatherBench: A benchmark dataset for data-driven weather forecastingcited by 275
- 2022GraphCast: Learning skillful medium-range global weather forecastingcited by 267
- 2022FourCastNet: Accelerating Global High-Resolution Weather Forecasting using Adaptive Fourier Neural Operatorscited by 188
- 2023FengWu: Pushing the Skillful Global Medium-range Weather Forecast beyond 10 Days Leadcited by 175
- 2022Forecasting Global Weather with Graph Neural Networkscited by 168
- 2022Pangu-Weather: A 3D High-Resolution Model for Fast and Accurate Global Weather Forecastcited by 166
- 2020MetNet: A Neural Weather Model for Precipitation Forecastingcited by 131
- 2021GSPMD: General and Scalable Parallelization for ML Computation Graphscited by 111
Built on by
Citing papers per year: 2023: 10; 2024: 26; 2025: 18; 2026: 18.
72 papers.
Sort:
By area:
- 2023WeatherBench 2: A benchmark for the next generation of data-driven global weather modelscited by 236
- 2023GenCast: Diffusion-based ensemble forecasting for medium-range weathercited by 177
- 2023Scaling transformer neural networks for skillful and reliable medium-range weather forecastingcited by 110
- 2024DiffDA: a Diffusion Model for Weather-scale Data Assimilationcited by 61
- 2024Training of Physical Neural Networkscited by 49
- 2023Foundation Models for Weather and Climate Data Understanding: A Comprehensive Surveycited by 34
- 2024Kilometer-Scale Convection Allowing Model Emulation using Generative Diffusion Modelingcited by 32
- 2024Prithvi WxC: Foundation Model for Weather and Climatecited by 31
- 2024Universal Physics Transformers: A Framework For Efficiently Scaling Neural Operatorscited by 27
- 2024Generative Data Assimilation of Sparse Weather Station Observations at Kilometer Scalescited by 27
- 2024Generalizing Weather Forecast to Fine-grained Temporal Scales via Physics-AI Hybrid Modelingcited by 23
- 2023AI Foundation Models for Weather and Climate: Applications, Design, and Implementationcited by 21
38 more
- 2025Appa: Bending Weather Dynamics with Latent Diffusion Models for Global Data Assimilationcited by 20
- 2024Data driven weather forecasts trained and initialised directly from observationscited by 19
- 2024Validating Deep Learning Weather Forecast Models on Recent High-Impact Extreme Eventscited by 14
- 2024Deep learning for precipitation nowcasting: A survey from the perspective of time series forecastingcited by 14
- 2023Do AI models produce better weather forecasts than physics-based models? A quantitative evaluation case study of Storm Ciar'ancited by 12
- 2025ZAPBench: A Benchmark for Whole-Brain Activity Prediction in Zebrafishcited by 10
- 2026Decoupled Diffusion Sampling for Inverse Problems on Function Spacescited by 10
- 2024Local Off-Grid Weather Forecasting with Multi-Modal Earth Observation Datacited by 9
- 2024WeatherReal: A Benchmark Based on In-Situ Observations for Evaluating Weather Modelscited by 8
- 2026Earth System Foundation Model (ESFM): A unified framework for heterogeneous data integration and forecastingcited by 8
- 2024ArchesWeather: An efficient AI weather forecasting model at 1.5deg resolutioncited by 6
- 2024Deep Bayesian Filter for Bayes-faithful Data Assimilationcited by 6
- 2024OMG-HD: A High-Resolution AI Weather Model for End-to-End Forecasts from Observationscited by 6
- 2025Agentic AI Framework for Cloudburst Prediction and Coordinated Responsecited by 6
- 2024Improving Global Weather and Ocean Wave Forecast with Large Artificial Intelligence Modelscited by 5
- 2025Forecasting Whole-Brain Neuronal Activity from Volumetric Videocited by 5
- 2025PEAR: Equal Area Weather Forecasting on the Spherecited by 5
- 2023Sim2Real for Environmental Neural Processescited by 4
- 2024Modulated Adaptive Fourier Neural Operators for Temporal Interpolation of Weather Forecastscited by 4
- 2025DUNIA: Pixel-Sized Embeddings via Cross-Modal Alignment for Earth Observation Applicationscited by 4
- 2025Observation-guided Interpolation Using Graph Neural Networks for High-Resolution Nowcasting in Switzerlandcited by 4
- 2024Regional Weather Variable Predictions by Machine Learning with Near-Surface Observational and Atmospheric Numerical Datacited by 3
- 2025How to use score-based diffusion in earth system science: A satellite nowcasting examplecited by 3
- 2024ACE Metric: Advection and Convection Evaluation for Accurate Weather Forecastingcited by 2
- 2025A Diffusion-Based Framework for High-Resolution Precipitation Forecasting over CONUScited by 2
- 2026PDE foundation models are skillful AI weather emulators for the Martian atmospherecited by 2
- 2026Pointwise is Pointless? A Multimodal Ablation Study for Precipitation Nowcasting with Graph Neural Networkscited by 2
- 2026RainODE: Continuous-Time Precipitation Forecasting with Latent Neural ODEscited by 2
- 2026WeatherNext 3: Increasing resolution and performance of global weather models with raw observationscited by 2
- 2023Leveraging AI for Natural Disaster Management : Takeaways From The Moroccan Earthquakecited by 1
- 2023RainAI -- Precipitation Nowcasting from Satellite Datacited by 1
- 2024Off to new Shores: A Dataset & Benchmark for (near-)coastal Flood Inundation Forecastingcited by 1
- 2024YanTian: An Application Platform for AI Global Weather Forecasting Modelscited by 1
- 2024A Monte Carlo Framework for Calibrated Uncertainty Estimation in Sequence Predictioncited by 1
- 2025IndiaWeatherBench: A Dataset and Benchmark for Data-Driven Regional Weather Forecasting over Indiacited by 1
- 2025Probability calibration for precipitation nowcastingcited by 1
- 2025Precipitation nowcasting of satellite data using physically-aligned neural networkscited by 1
- 2025Observation-driven correction of numerical weather prediction for marine windscited by 1
50 most cited of 72 All 72 (JSON)
- 2026PING: physics informed graph neural network for advection-diffusion processes with applications to solar power forecasting13 Oct 2026
- 2026West-WRF AI 2-km: High-Resolution Prediction of Integrated Vapor Transport and Precipitation22 Sep 2026
- 2026WeatherNext 3: Increasing resolution and performance of global weather models with raw observations3 Sep 2026
- 2026Earth observation embeddings are effective sub-grid descriptors for probabilistic weather downscaling12 Aug 2026
- 2026Geospatial Diffusion-based Evolution Synthesis (GeoDES) for Storm-Centered Weather Augmentation21 Jul 2026
- 2026RainODE: Continuous-Time Precipitation Forecasting with Latent Neural ODEs29 Jun 2026
- 2026Pointwise is Pointless? A Multimodal Ablation Study for Precipitation Nowcasting with Graph Neural Networks16 Jun 2026
- 2026Towards a Foundation Model for the Martian Atmosphere16 May 2026
- 2026From Drops to Grid: Noise-Aware Spatio-Temporal Neural Process for Rainfall Estimation7 May 2026
- 2026Earth System Foundation Model (ESFM): A unified framework for heterogeneous data integration and forecasting20 Apr 2026
- 2026Accurate Precipitation Forecast by Efficiently Learning from Massive Atmospheric Variables and Unbalanced Distribution27 Mar 2026
- 2026Pure and physics-guided deep learning approaches for spatio-temporal groundwater level prediction26 Mar 2026
38 more
- 2026A Distribution-to-Distribution Neural Probabilistic Forecasting Framework for Dynamical Systems26 Mar 2026
- 2026FusionCast: Enhancing Precipitation Nowcasting with Asymmetric Cross-Modal Fusion and Future Radar Priors2 Mar 2026
- 2026PDE foundation models are skillful AI weather emulators for the Martian atmosphere16 Feb 2026
- 2026FlowDA: Accurate, Low-Latency Weather Data Assimilation via Flow Matching6 Feb 2026
- 2026Decoupled Diffusion Sampling for Inverse Problems on Function Spaces30 Jan 2026
- 2026STIPP: Space-time in situ postprocessing over the French Alps using proper scoring rules6 Jan 2026
- 2025A Diffusion-Based Framework for High-Resolution Precipitation Forecasting over CONUS9 Dec 2025
- 2025FuXi-Nowcast: Environment-conditioned deep learning for severe convection nowcasting3 Dec 2025
- 2025Observation-driven correction of numerical weather prediction for marine winds3 Dec 2025
- 2025PIANO: Physics-informed Dual Neural Operator for Precipitation Nowcasting30 Nov 2025
- 2025Agentic AI Framework for Cloudburst Prediction and Coordinated Response27 Nov 2025
- 2025Precipitation nowcasting of satellite data using physically-aligned neural networks7 Nov 2025
- 2025Probability calibration for precipitation nowcasting1 Oct 2025
- 2025Advanced Torrential Loss Function for Precipitation Forecasting1 Sep 2025
- 2025IndiaWeatherBench: A Dataset and Benchmark for Data-Driven Regional Weather Forecasting over India31 Aug 2025
- 2025Observation-guided Interpolation Using Graph Neural Networks for High-Resolution Nowcasting in Switzerland16 Aug 2025
- 2025PEAR: Equal Area Weather Forecasting on the Sphere23 May 2025
- 2025How to use score-based diffusion in earth system science: A satellite nowcasting example15 May 2025
- 2025Appa: Bending Weather Dynamics with Latent Diffusion Models for Global Data Assimilation25 Apr 2025
- 2025ZAPBench: A Benchmark for Whole-Brain Activity Prediction in Zebrafish4 Mar 2025
- 2025Forecasting Whole-Brain Neuronal Activity from Volumetric Video27 Feb 2025
- 2025DUNIA: Pixel-Sized Embeddings via Cross-Modal Alignment for Earth Observation Applications24 Feb 2025
- 2025Integrating Weather Station Data and Radar for Precipitation Nowcasting: SmaAt-fUsion and SmaAt-Krige-GNet22 Feb 2025
- 2025Skillful Nowcasting of Convective Clouds With a Cascade Diffusion Model16 Feb 2025
- 2024OMG-HD: A High-Resolution AI Weather Model for End-to-End Forecasts from Observations24 Dec 2024
- 2024Regional Weather Variable Predictions by Machine Learning with Near-Surface Observational and Atmospheric Numerical Data11 Dec 2024
- 2024A Monte Carlo Framework for Calibrated Uncertainty Estimation in Sequence Prediction30 Oct 2024
- 2024Modulated Adaptive Fourier Neural Operators for Temporal Interpolation of Weather Forecasts24 Oct 2024
- 2024Local Off-Grid Weather Forecasting with Multi-Modal Earth Observation Data16 Oct 2024
- 2024Multi-Source Temporal Attention Network for Precipitation Nowcasting11 Oct 2024
- 2024YanTian: An Application Platform for AI Global Weather Forecasting Models6 Oct 2024
- 2024Off to new Shores: A Dataset & Benchmark for (near-)coastal Flood Inundation Forecasting27 Sep 2024
- 2024Prithvi WxC: Foundation Model for Weather and Climate20 Sep 2024
- 2024WeatherReal: A Benchmark Based on In-Situ Observations for Evaluating Weather Models14 Sep 2024
- 2024Kilometer-Scale Convection Allowing Model Emulation using Generative Diffusion Modeling20 Aug 2024
- 2024Data driven weather forecasts trained and initialised directly from observations22 Jul 2024
- 2024Generative Data Assimilation of Sparse Weather Station Observations at Kilometer Scales19 Jun 2024
- 2024Deep learning for precipitation nowcasting: A survey from the perspective of time series forecasting7 Jun 2024
50 newest of 72 All 72 (JSON)
- 2024DiffDA: a Diffusion Model for Weather-scale Data Assimilationcited by 61
- 2024Kilometer-Scale Convection Allowing Model Emulation using Generative Diffusion Modelingcited by 32
- 2025Appa: Bending Weather Dynamics with Latent Diffusion Models for Global Data Assimilationcited by 20
- 2026Decoupled Diffusion Sampling for Inverse Problems on Function Spacescited by 10
- 2025How to use score-based diffusion in earth system science: A satellite nowcasting examplecited by 3
- 2025Skillful Nowcasting of Convective Clouds With a Cascade Diffusion Modelcited by 0
- 2026FlowDA: Accurate, Low-Latency Weather Data Assimilation via Flow Matchingcited by 0
- 2026FlowDA: Accurate, Low-Latency Weather Data Assimilation via Flow Matching6 Feb 2026
- 2026Decoupled Diffusion Sampling for Inverse Problems on Function Spaces30 Jan 2026
- 2025How to use score-based diffusion in earth system science: A satellite nowcasting example15 May 2025
- 2025Appa: Bending Weather Dynamics with Latent Diffusion Models for Global Data Assimilation25 Apr 2025
- 2025Skillful Nowcasting of Convective Clouds With a Cascade Diffusion Model16 Feb 2025
- 2024Kilometer-Scale Convection Allowing Model Emulation using Generative Diffusion Modeling20 Aug 2024
- 2024DiffDA: a Diffusion Model for Weather-scale Data Assimilation11 Jan 2024
- 2023WeatherBench 2: A benchmark for the next generation of data-driven global weather modelscited by 236
- 2023GenCast: Diffusion-based ensemble forecasting for medium-range weathercited by 177
- 2023Scaling transformer neural networks for skillful and reliable medium-range weather forecastingcited by 110
- 2024Training of Physical Neural Networkscited by 49
- 2023Foundation Models for Weather and Climate Data Understanding: A Comprehensive Surveycited by 34
- 2024Prithvi WxC: Foundation Model for Weather and Climatecited by 31
- 2024Universal Physics Transformers: A Framework For Efficiently Scaling Neural Operatorscited by 27
- 2024Generative Data Assimilation of Sparse Weather Station Observations at Kilometer Scalescited by 27
- 2024Generalizing Weather Forecast to Fine-grained Temporal Scales via Physics-AI Hybrid Modelingcited by 23
- 2023AI Foundation Models for Weather and Climate: Applications, Design, and Implementationcited by 21
- 2024Data driven weather forecasts trained and initialised directly from observationscited by 19
- 2024Validating Deep Learning Weather Forecast Models on Recent High-Impact Extreme Eventscited by 14
12 most cited of 65 All 65 (JSON)
- 2026PING: physics informed graph neural network for advection-diffusion processes with applications to solar power forecasting13 Oct 2026
- 2026West-WRF AI 2-km: High-Resolution Prediction of Integrated Vapor Transport and Precipitation22 Sep 2026
- 2026WeatherNext 3: Increasing resolution and performance of global weather models with raw observations3 Sep 2026
- 2026Earth observation embeddings are effective sub-grid descriptors for probabilistic weather downscaling12 Aug 2026
- 2026Geospatial Diffusion-based Evolution Synthesis (GeoDES) for Storm-Centered Weather Augmentation21 Jul 2026
- 2026RainODE: Continuous-Time Precipitation Forecasting with Latent Neural ODEs29 Jun 2026
- 2026Pointwise is Pointless? A Multimodal Ablation Study for Precipitation Nowcasting with Graph Neural Networks16 Jun 2026
- 2026Towards a Foundation Model for the Martian Atmosphere16 May 2026
- 2026From Drops to Grid: Noise-Aware Spatio-Temporal Neural Process for Rainfall Estimation7 May 2026
- 2026Earth System Foundation Model (ESFM): A unified framework for heterogeneous data integration and forecasting20 Apr 2026
- 2026Accurate Precipitation Forecast by Efficiently Learning from Massive Atmospheric Variables and Unbalanced Distribution27 Mar 2026
- 2026Pure and physics-guided deep learning approaches for spatio-temporal groundwater level prediction26 Mar 2026
12 newest of 65 All 65 (JSON)