Advancing Parsimonious Deep Learning Weather Prediction using the HEALPix Mesh
Not on the map. Why?
Abstract (arXiv)
We present a parsimonious deep learning weather prediction model to forecast seven atmospheric variables with 3-h time resolution for up to one-year lead times on a 110-km global mesh using the Hierarchical Equal Area isoLatitude Pixelization (HEALPix). In comparison to state-of-the-art (SOTA) machine learning (ML) weather forecast models, such as Pangu-Weather and GraphCast, our DLWP-HPX model uses coarser resolution and far fewer prognostic variables. Yet, at one-week lead times, its skill is only about one day behind both SOTA ML forecast models and the SOTA numerical weather prediction model from the European Centre for Medium-Range Weather Forecasts. We report several improvements in model design, including switching from the cubed sphere to the HEALPix mesh, inverting the channel depth of the U-Net, and introducing gated recurrent units (GRU) on each level of the U-Net hierarchy. The consistent east-west orientation of all cells on the HEALPix mesh facilitates the development of location-invariant convolution kernels that successfully propagate weather patterns across the globe without requiring separate kernels for the polar and equatorial faces of the cube sphere. Without any loss of spectral power after the first two days, the model can be unrolled autoregressively for hundreds of steps into the future to generate realistic states of the atmosphere that respect seasonal trends, as showcased in one-year simulations.
Key facts. Cited by 28 papers in the map (data through 14 Oct 2026). Builds on 31 of its 70 references that are in the map. First posted on arXiv 11 Sep 2023.
Builds on
31 of 70 references.
References · 31
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
- 2022A ConvNet for the 2020scited by 3,579
- 2016Gaussian Error Linear Units (GELUs)cited by 3,502
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
19 more
- 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,525
- 2018Relational inductive biases, deep learning, and graph networkscited by 1,360
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 868
- 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
- 2020UNet 3+: A Full-Scale Connected UNet for Medical Image Segmentationcited by 332
- 2022GraphCast: Learning skillful medium-range global weather forecastingcited by 267
- 2023WeatherBench 2: A benchmark for the next generation of data-driven global weather modelscited by 236
- 2023Spherical Fourier Neural Operators: Learning Stable Dynamics on the Spherecited by 233
- 2022FourCastNet: Accelerating Global High-Resolution Weather Forecasting using Adaptive Fourier Neural Operatorscited by 188
- 2023FengWu: Pushing the Skillful Global Medium-range Weather Forecast beyond 10 Days Leadcited by 175
- 2022Forecasting Global Weather with Graph Neural Networkscited by 168
- 2015Delving Deeper into Convolutional Networks for Learning Video Representationscited by 148
- 2020Improving data-driven global weather prediction using deep convolutional neural networks on a cubed spherecited by 96
- 2021Sub-seasonal forecasting with a large ensemble of deep-learning weather prediction modelscited by 79
- 2018DeepSphere: Efficient spherical Convolutional Neural Network with HEALPix sampling for cosmological applicationscited by 62
- 2022SwinVRNN: A Data-Driven Ensemble Forecasting Model via Learned Distribution Perturbationcited by 32
- 2022Global Extreme Heat Forecasting Using Neural Weather Modelscited by 13
- 2021CIRA Guide to Custom Loss Functions for Neural Networks in Environmental Sciences -- Version 1cited by 8
- 2023Inductive biases in deep learning models for weather predictioncited by 3
Built on by
Citing papers per year: 2024: 8; 2025: 11; 2026: 9.
28 papers.
Sort:
- 2024ACE2: Accurately learning subseasonal to decadal atmospheric variability and forced responsescited by 54
- 2024LUCIE: A Lightweight Uncoupled ClImate Emulator with long-term stability and physical consistency for O(1000)-member ensemblescited by 30
- 2024Samudra: An AI Global Ocean Emulator for Climatecited by 27
- 2024Coupled Ocean-Atmosphere Dynamics in a Machine Learning Earth System Modelcited by 21
- 2024Huge Ensembles Part I: Design of Ensemble Weather Forecasts using Spherical Fourier Neural Operatorscited by 18
- 2024Analyzing and Exploring Training Recipes for Large-Scale Transformer-Based Weather Predictioncited by 15
- 2026U-Cast: A Surprisingly Simple and Efficient Frontier Probabilistic AI Weather Forecastercited by 12
- 2025Attention on the Spherecited by 10
- 2025EnScale: Temporally-consistent multivariate generative downscaling via proper scoring rulescited by 10
- 2025Atmospheric Predictability Beyond 30 Days with Machine Learningcited by 5
- 2025PEAR: Equal Area Weather Forecasting on the Spherecited by 5
- 2025Causal Climate Emulation with Bayesian Filteringcited by 5
16 more
- 2026(Sparse) Attention to the Details: Preserving Spectral Fidelity in ML-based Weather Forecasting Modelscited by 5
- 2024Community Research Earth Digital Intelligence Twin (CREDIT)cited by 4
- 2025BeamVQ: Beam Search with Vector Quantization to Mitigate Data Scarcity in Physical Spatiotemporal Forecastingcited by 4
- 2026Can AI Weather Models Predict Beyond Two Weeks? A Quantitative Benchmark and Analysis of Long Rolloutscited by 4
- 2025Score-based generative emulation of impact-relevant Earth system model outputscited by 3
- 2025MoWE : A Mixture of Weather Expertscited by 2
- 2026Examining Fast Radiatively Driven Responses Using Machine-Learning Weather Emulatorscited by 2
- 2025Exploring Design Choices for Autoregressive Deep Learning Climate Modelscited by 1
- 2025Crowdsourcing the Frontier: Advancing Hybrid Physics-ML Climate Simulation via a 50,000 Kaggle Competitioncited by 1
- 2024On the importance of learning non-local dynamics for stable data-driven climate modeling: A 1D gravity wave-QBO testbedcited by 0
- 2025AtmosMJ: Revisiting Gating Mechanism for AI Weather Forecasting Beyond the Year Scalecited by 0
- 2026Searth Transformer: A Transformer Architecture Incorporating Earth's Geospheric Physical Priors for Global Mid-Range Weather Forecastingcited by 0
- 2026Scaling Storm-Resolving Atmospheric AI Simulation to the Entire Planetcited by 0
- 2026Rescene: band-limited stochastic forcing turns a frozen neural weather operator into a climate emulatorcited by 0
- 2026Learning Hierarchical Causal Representations of the Effects of Forcings on Temperature in Climate Modelscited by 0
- 2026S3N: A Spherical Spiral Scanning Network for Weather Forecastingcited by 0
- 2026S3N: A Spherical Spiral Scanning Network for Weather Forecasting3 Oct 2026
- 2026Learning Hierarchical Causal Representations of the Effects of Forcings on Temperature in Climate Models25 Sep 2026
- 2026Rescene: band-limited stochastic forcing turns a frozen neural weather operator into a climate emulator30 Jul 2026
- 2026Scaling Storm-Resolving Atmospheric AI Simulation to the Entire Planet30 Jun 2026
- 2026Can AI Weather Models Predict Beyond Two Weeks? A Quantitative Benchmark and Analysis of Long Rollouts28 May 2026
- 2026U-Cast: A Surprisingly Simple and Efficient Frontier Probabilistic AI Weather Forecaster10 Apr 2026
- 2026(Sparse) Attention to the Details: Preserving Spectral Fidelity in ML-based Weather Forecasting Models6 Apr 2026
- 2026Examining Fast Radiatively Driven Responses Using Machine-Learning Weather Emulators17 Feb 2026
- 2026Searth Transformer: A Transformer Architecture Incorporating Earth's Geospheric Physical Priors for Global Mid-Range Weather Forecasting14 Jan 2026
- 2025Crowdsourcing the Frontier: Advancing Hybrid Physics-ML Climate Simulation via a 50,000 Kaggle Competition26 Nov 2025
- 2025Score-based generative emulation of impact-relevant Earth system model outputs5 Oct 2025
- 2025EnScale: Temporally-consistent multivariate generative downscaling via proper scoring rules30 Sep 2025
16 more
- 2025MoWE : A Mixture of Weather Experts10 Sep 2025
- 2025Causal Climate Emulation with Bayesian Filtering11 Jun 2025
- 2025AtmosMJ: Revisiting Gating Mechanism for AI Weather Forecasting Beyond the Year Scale11 Jun 2025
- 2025PEAR: Equal Area Weather Forecasting on the Sphere23 May 2025
- 2025Attention on the Sphere16 May 2025
- 2025Exploring Design Choices for Autoregressive Deep Learning Climate Models5 May 2025
- 2025Atmospheric Predictability Beyond 30 Days with Machine Learning28 Apr 2025
- 2025BeamVQ: Beam Search with Vector Quantization to Mitigate Data Scarcity in Physical Spatiotemporal Forecasting26 Feb 2025
- 2024Samudra: An AI Global Ocean Emulator for Climate5 Dec 2024
- 2024ACE2: Accurately learning subseasonal to decadal atmospheric variability and forced responses18 Nov 2024
- 2024Community Research Earth Digital Intelligence Twin (CREDIT)9 Nov 2024
- 2024Huge Ensembles Part I: Design of Ensemble Weather Forecasts using Spherical Fourier Neural Operators6 Aug 2024
- 2024On the importance of learning non-local dynamics for stable data-driven climate modeling: A 1D gravity wave-QBO testbed7 Jul 2024
- 2024Coupled Ocean-Atmosphere Dynamics in a Machine Learning Earth System Model12 Jun 2024
- 2024LUCIE: A Lightweight Uncoupled ClImate Emulator with long-term stability and physical consistency for O(1000)-member ensembles25 May 2024
- 2024Analyzing and Exploring Training Recipes for Large-Scale Transformer-Based Weather Prediction30 Apr 2024
- 2024ACE2: Accurately learning subseasonal to decadal atmospheric variability and forced responsescited by 54
- 2024LUCIE: A Lightweight Uncoupled ClImate Emulator with long-term stability and physical consistency for O(1000)-member ensemblescited by 30
- 2024Samudra: An AI Global Ocean Emulator for Climatecited by 27
- 2024Coupled Ocean-Atmosphere Dynamics in a Machine Learning Earth System Modelcited by 21
- 2024Huge Ensembles Part I: Design of Ensemble Weather Forecasts using Spherical Fourier Neural Operatorscited by 18
- 2024Analyzing and Exploring Training Recipes for Large-Scale Transformer-Based Weather Predictioncited by 15
- 2026U-Cast: A Surprisingly Simple and Efficient Frontier Probabilistic AI Weather Forecastercited by 12
- 2025Attention on the Spherecited by 10
- 2025EnScale: Temporally-consistent multivariate generative downscaling via proper scoring rulescited by 10
- 2025Atmospheric Predictability Beyond 30 Days with Machine Learningcited by 5
- 2025PEAR: Equal Area Weather Forecasting on the Spherecited by 5
- 2025Causal Climate Emulation with Bayesian Filteringcited by 5
12 most cited of 28 All 28 (JSON)
- 2026S3N: A Spherical Spiral Scanning Network for Weather Forecasting3 Oct 2026
- 2026Learning Hierarchical Causal Representations of the Effects of Forcings on Temperature in Climate Models25 Sep 2026
- 2026Rescene: band-limited stochastic forcing turns a frozen neural weather operator into a climate emulator30 Jul 2026
- 2026Scaling Storm-Resolving Atmospheric AI Simulation to the Entire Planet30 Jun 2026
- 2026Can AI Weather Models Predict Beyond Two Weeks? A Quantitative Benchmark and Analysis of Long Rollouts28 May 2026
- 2026U-Cast: A Surprisingly Simple and Efficient Frontier Probabilistic AI Weather Forecaster10 Apr 2026
- 2026(Sparse) Attention to the Details: Preserving Spectral Fidelity in ML-based Weather Forecasting Models6 Apr 2026
- 2026Examining Fast Radiatively Driven Responses Using Machine-Learning Weather Emulators17 Feb 2026
- 2026Searth Transformer: A Transformer Architecture Incorporating Earth's Geospheric Physical Priors for Global Mid-Range Weather Forecasting14 Jan 2026
- 2025Crowdsourcing the Frontier: Advancing Hybrid Physics-ML Climate Simulation via a 50,000 Kaggle Competition26 Nov 2025
- 2025Score-based generative emulation of impact-relevant Earth system model outputs5 Oct 2025
- 2025EnScale: Temporally-consistent multivariate generative downscaling via proper scoring rules30 Sep 2025
12 newest of 28 All 28 (JSON)