mlsanityData to 14 Oct 2026

AtmosMJ: Revisiting Gating Mechanism for AI Weather Forecasting Beyond the Year Scale

arXiv 2506.09733 ↗First posted 11 Jun 2025cs.LG cs.AI cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

The advent of Large Weather Models (LWMs) has marked a turning point in data-driven forecasting, with many models now outperforming traditional numerical systems in the medium range. However, achieving stable, long-range autoregressive forecasts beyond a few weeks remains a significant challenge. Prevailing state-of-the-art models that achieve year-long stability, such as SFNO and DLWP-HPX, have relied on transforming input data onto non-standard spatial domains like spherical harmonics or HEALPix meshes. This has led to the prevailing assumption that such representations are necessary to enforce physical consistency and long-term stability. This paper challenges that assumption by investigating whether comparable long-range performance can be achieved on the standard latitude-longitude grid. We introduce AtmosMJ, a deep convolutional network that operates directly on ERA5 data without any spherical remapping. The model's stability is enabled by a novel Gated Residual Fusion (GRF) mechanism, which adaptively moderates feature updates to prevent error accumulation over long recursive simulations. Our results demonstrate that AtmosMJ produces stable and physically plausible forecasts for about 500 days. In quantitative evaluations, it achieves competitive 10-day forecast accuracy against models like Pangu-Weather and GraphCast, all while requiring a remarkably low training budget of 5.7 days on a V100 GPU. Our findings suggest that efficient architectural design, rather than non-standard data representation, can be the key to unlocking stable and computationally efficient long-range weather prediction.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 17 references that are in the map. First posted on arXiv 11 Jun 2025.

Builds on

12 of 17 references.

References · 12

  1. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
  2. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
  3. 2022GraphCast: Learning skillful medium-range global weather forecastingcited by 267
  4. 2023FuXi: A cascade machine learning forecasting system for 15-day global weather forecastcited by 241
  5. 2023Neural General Circulation Models for Weather and Climatecited by 239
  6. 2023WeatherBench 2: A benchmark for the next generation of data-driven global weather modelscited by 236
  7. 2023Spherical Fourier Neural Operators: Learning Stable Dynamics on the Spherecited by 233
  8. 2023Scaling transformer neural networks for skillful and reliable medium-range weather forecastingcited by 110
  9. 2023InceptionNeXt: When Inception Meets ConvNeXtcited by 86
  10. 2023Advancing Parsimonious Deep Learning Weather Prediction using the HEALPix Meshcited by 28
  11. 2024KARINA: An Efficient Deep Learning Model for Global Weather Forecastcited by 9
  12. 2024ArchesWeather: An efficient AI weather forecasting model at 1.5deg resolutioncited by 6

Built on by

Not cited yet.