FastNet: Improving the physical consistency of machine-learning weather prediction models through loss function design
Not on the map. Why?
Abstract (arXiv)
Machine learning weather prediction (MLWP) models have demonstrated remarkable potential in delivering accurate forecasts at significantly reduced computational cost compared to traditional numerical weather prediction (NWP) systems. However, challenges remain in ensuring the physical consistency of MLWP outputs, particularly in deterministic settings. This study presents FastNet, a graph neural network (GNN)-based global prediction model, and investigates the impact of alternative loss function designs on improving the physical realism of its forecasts. We explore three key modifications to the standard mean squared error (MSE) loss: (1) a modified spherical harmonic (MSH) loss that penalises spectral amplitude errors to reduce blurring and enhance small-scale structure retention; (2) inclusion of horizontal gradient terms in the loss to suppress non-physical artefacts; and (3) an alternative wind representation that decouples speed and direction to better capture extreme wind events. Results show that while the MSH and gradient-based losses textitalone may slightly degrade RMSE scores, when trained in combination the model exhibits very similar MSE performance to an MSE-trained model while at the same time significantly improving spectral fidelity and physical consistency. The alternative wind representation further improves wind speed accuracy and reduces directional bias. Collectively, these findings highlight the importance of loss function design as a mechanism for embedding domain knowledge into MLWP models and advancing their operational readiness.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 13 of its 30 references that are in the map. First posted on arXiv 22 Sep 2025.
Builds on
13 of 30 references.
References · 13
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 868
- 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
- 2016Interaction Networks for Learning about Objects, Relations and Physicscited by 509
- 2020WeatherBench: A benchmark dataset for data-driven weather forecastingcited by 275
- 2023Neural General Circulation Models for Weather and Climatecited by 239
- 2023Spherical Fourier Neural Operators: Learning Stable Dynamics on the Spherecited by 233
- 2022Forecasting Global Weather with Graph Neural Networkscited by 168
- 2020Improving data-driven global weather prediction using deep convolutional neural networks on a cubed spherecited by 96
- 2025FourCastNet 3: A geometric approach to probabilistic machine-learning weather forecasting at scalecited by 62
- 2025Deep Learning is Not So Mysterious or Differentcited by 56
- 2025Fixing the Double Penalty in Data-Driven Weather Forecasting Through a Modified Spherical Harmonic Loss Functioncited by 28
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026PhysMetrics.Weather: An Evaluation Framework for Physical Consistency in ML Weather Modelscited by 5
- 2026The Recipe Matters More Than the Kitchen:Mathematical Foundations of the AI Weather Prediction Pipelinecited by 3
- 2026Sonny: Breaking the Compute Wall in Medium-Range Weather Forecastingcited by 2
- 2026The physics of AI weather modelscited by 2
- 2026FlowDA: Accurate, Low-Latency Weather Data Assimilation via Flow Matchingcited by 0
- 2026PhysMetrics.Weather: An Evaluation Framework for Physical Consistency in ML Weather Models9 Jun 2026
- 2026The physics of AI weather models22 May 2026
- 2026The Recipe Matters More Than the Kitchen:Mathematical Foundations of the AI Weather Prediction Pipeline1 Apr 2026
- 2026Sonny: Breaking the Compute Wall in Medium-Range Weather Forecasting22 Mar 2026
- 2026FlowDA: Accurate, Low-Latency Weather Data Assimilation via Flow Matching6 Feb 2026