mlsanityData to 14 Oct 2026

Deep Learning for Day Forecasts from Sparse Observations

arXiv 2306.06079 ↗First posted 6 Jun 2023physics.ao-ph cs.LGcited by 72

Not on the map. Why?

Abstract (arXiv)

Deep neural networks offer an alternative paradigm for modeling weather conditions. The ability of neural models to make a prediction in less than a second once the data is available and to do so with very high temporal and spatial resolution, and the ability to learn directly from atmospheric observations, are just some of these models' unique advantages. Neural models trained using atmospheric observations, the highest fidelity and lowest latency data, have to date achieved good performance only up to twelve hours of lead time when compared with state-of-the-art probabilistic Numerical Weather Prediction models and only for the sole variable of precipitation. In this paper, we present MetNet-3 that extends significantly both the lead time range and the variables that an observation based neural model can predict well. MetNet-3 learns from both dense and sparse data sensors and makes predictions up to 24 hours ahead for precipitation, wind, temperature and dew point. MetNet-3 introduces a key densification technique that implicitly captures data assimilation and produces spatially dense forecasts in spite of the network training on extremely sparse targets. MetNet-3 has a high temporal and spatial resolution of, respectively, up to 2 minutes and 1 km as well as a low operational latency. We find that MetNet-3 is able to outperform the best single- and multi-member NWPs such as HRRR and ENS over the CONUS region for up to 24 hours ahead setting a new performance milestone for observation based neural models. MetNet-3 is operational and its forecasts are served in Google Search in conjunction with other models.

Key facts. Cited by 72 papers in the map (data through 14 Oct 2026). Builds on 25 of its 37 references that are in the map. First posted on arXiv 6 Jun 2023.

Builds on

25 of 37 references.

References · 25

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2016Layer Normalizationcited by 5,669
  5. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
  6. 2017Squeeze-and-Excitation Networkscited by 4,789
  7. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
  8. 2016Gaussian Error Linear Units (GELUs)cited by 3,502
  9. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  10. 2019Generating Long Sequences with Sparse Transformerscited by 1,546
  11. 2017Mixed Precision Trainingcited by 1,156
  12. 2016Deep Networks with Stochastic Depthcited by 979
13 more
  1. 2020On Layer Normalization in the Transformer Architecturecited by 922
  2. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
  3. 2023Scaling Vision Transformers to 22 Billion Parameterscited by 694
  4. 2022MaxViT: Multi-Axis Vision Transformercited by 476
  5. 2023ClimaX: A foundation model for weather and climatecited by 337
  6. 2020WeatherBench: A benchmark dataset for data-driven weather forecastingcited by 275
  7. 2022GraphCast: Learning skillful medium-range global weather forecastingcited by 267
  8. 2022FourCastNet: Accelerating Global High-Resolution Weather Forecasting using Adaptive Fourier Neural Operatorscited by 188
  9. 2023FengWu: Pushing the Skillful Global Medium-range Weather Forecast beyond 10 Days Leadcited by 175
  10. 2022Forecasting Global Weather with Graph Neural Networkscited by 168
  11. 2022Pangu-Weather: A 3D High-Resolution Model for Fast and Accurate Global Weather Forecastcited by 166
  12. 2020MetNet: A Neural Weather Model for Precipitation Forecastingcited by 131
  13. 2021GSPMD: General and Scalable Parallelization for ML Computation Graphscited by 111

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 10; 2024: 26; 2025: 18; 2026: 18.

72 papers.

Sort:

By area:

  1. 2023WeatherBench 2: A benchmark for the next generation of data-driven global weather modelscited by 236
  2. 2023GenCast: Diffusion-based ensemble forecasting for medium-range weathercited by 177
  3. 2023Scaling transformer neural networks for skillful and reliable medium-range weather forecastingcited by 110
  4. 2024DiffDA: a Diffusion Model for Weather-scale Data Assimilationcited by 61
  5. 2024Training of Physical Neural Networkscited by 49
  6. 2023Foundation Models for Weather and Climate Data Understanding: A Comprehensive Surveycited by 34
  7. 2024Kilometer-Scale Convection Allowing Model Emulation using Generative Diffusion Modelingcited by 32
  8. 2024Prithvi WxC: Foundation Model for Weather and Climatecited by 31
  9. 2024Universal Physics Transformers: A Framework For Efficiently Scaling Neural Operatorscited by 27
  10. 2024Generative Data Assimilation of Sparse Weather Station Observations at Kilometer Scalescited by 27
  11. 2024Generalizing Weather Forecast to Fine-grained Temporal Scales via Physics-AI Hybrid Modelingcited by 23
  12. 2023AI Foundation Models for Weather and Climate: Applications, Design, and Implementationcited by 21
38 more
  1. 2025Appa: Bending Weather Dynamics with Latent Diffusion Models for Global Data Assimilationcited by 20
  2. 2024Data driven weather forecasts trained and initialised directly from observationscited by 19
  3. 2024Validating Deep Learning Weather Forecast Models on Recent High-Impact Extreme Eventscited by 14
  4. 2024Deep learning for precipitation nowcasting: A survey from the perspective of time series forecastingcited by 14
  5. 2023Do AI models produce better weather forecasts than physics-based models? A quantitative evaluation case study of Storm Ciar'ancited by 12
  6. 2025ZAPBench: A Benchmark for Whole-Brain Activity Prediction in Zebrafishcited by 10
  7. 2026Decoupled Diffusion Sampling for Inverse Problems on Function Spacescited by 10
  8. 2024Local Off-Grid Weather Forecasting with Multi-Modal Earth Observation Datacited by 9
  9. 2024WeatherReal: A Benchmark Based on In-Situ Observations for Evaluating Weather Modelscited by 8
  10. 2026Earth System Foundation Model (ESFM): A unified framework for heterogeneous data integration and forecastingcited by 8
  11. 2024ArchesWeather: An efficient AI weather forecasting model at 1.5deg resolutioncited by 6
  12. 2024Deep Bayesian Filter for Bayes-faithful Data Assimilationcited by 6
  13. 2024OMG-HD: A High-Resolution AI Weather Model for End-to-End Forecasts from Observationscited by 6
  14. 2025Agentic AI Framework for Cloudburst Prediction and Coordinated Responsecited by 6
  15. 2024Improving Global Weather and Ocean Wave Forecast with Large Artificial Intelligence Modelscited by 5
  16. 2025Forecasting Whole-Brain Neuronal Activity from Volumetric Videocited by 5
  17. 2025PEAR: Equal Area Weather Forecasting on the Spherecited by 5
  18. 2023Sim2Real for Environmental Neural Processescited by 4
  19. 2024Modulated Adaptive Fourier Neural Operators for Temporal Interpolation of Weather Forecastscited by 4
  20. 2025DUNIA: Pixel-Sized Embeddings via Cross-Modal Alignment for Earth Observation Applicationscited by 4
  21. 2025Observation-guided Interpolation Using Graph Neural Networks for High-Resolution Nowcasting in Switzerlandcited by 4
  22. 2024Regional Weather Variable Predictions by Machine Learning with Near-Surface Observational and Atmospheric Numerical Datacited by 3
  23. 2025How to use score-based diffusion in earth system science: A satellite nowcasting examplecited by 3
  24. 2024ACE Metric: Advection and Convection Evaluation for Accurate Weather Forecastingcited by 2
  25. 2025A Diffusion-Based Framework for High-Resolution Precipitation Forecasting over CONUScited by 2
  26. 2026PDE foundation models are skillful AI weather emulators for the Martian atmospherecited by 2
  27. 2026Pointwise is Pointless? A Multimodal Ablation Study for Precipitation Nowcasting with Graph Neural Networkscited by 2
  28. 2026RainODE: Continuous-Time Precipitation Forecasting with Latent Neural ODEscited by 2
  29. 2026WeatherNext 3: Increasing resolution and performance of global weather models with raw observationscited by 2
  30. 2023Leveraging AI for Natural Disaster Management : Takeaways From The Moroccan Earthquakecited by 1
  31. 2023RainAI -- Precipitation Nowcasting from Satellite Datacited by 1
  32. 2024Off to new Shores: A Dataset & Benchmark for (near-)coastal Flood Inundation Forecastingcited by 1
  33. 2024YanTian: An Application Platform for AI Global Weather Forecasting Modelscited by 1
  34. 2024A Monte Carlo Framework for Calibrated Uncertainty Estimation in Sequence Predictioncited by 1
  35. 2025IndiaWeatherBench: A Dataset and Benchmark for Data-Driven Regional Weather Forecasting over Indiacited by 1
  36. 2025Probability calibration for precipitation nowcastingcited by 1
  37. 2025Precipitation nowcasting of satellite data using physically-aligned neural networkscited by 1
  38. 2025Observation-driven correction of numerical weather prediction for marine windscited by 1

50 most cited of 72 All 72 (JSON)