mlsanityData to 14 Oct 2026

The physics of AI weather models

arXiv 2605.23778 ↗First posted 22 May 2026physics.ao-ph cs.LG physics.comp-phcited by 2

Not on the map. Why?

Abstract (arXiv)

Could it be that AI weather models are solving physical equations, although they may not be the equations used by conventional NWP models? We compute correlations of forecast skill and Centered Kernel Alignment, providing evidence that different AI weather models represent the atmosphere in similar ways, despite differences in architecture and capacity. We argue that the architecture and training of the AI models constrains the form of the physical laws that they might simulate. In particular, we propose that the models implement a particle description of the atmosphere, where the latent variables at each mesh point correspond to the position of a particle in the high dimensional latent space. We hypothesize that the movement of the particles follows a gradient flow in the latent space towards a minimum of a learned free energy functional. Analysis of the GraphCast and Aurora models show that they make changes on large spatial scales in the early processor layers and move to smaller scale with increasing layer depth, consistent with the gradient flow hypothesis.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 23 of its 47 references that are in the map. First posted on arXiv 22 May 2026.

Builds on

23 of 47 references.

References · 23

  1. 2018Neural Ordinary Differential Equationscited by 3,779
  2. 2019Similarity of Neural Network Representations Revisitedcited by 1,755
  3. 2016Deep Networks with Stochastic Depthcited by 979
  4. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
  5. 2023Eliciting Latent Predictions from Transformers with the Tuned Lenscited by 623
  6. 2024Mechanistic Interpretability for AI Safety -- A Reviewcited by 422
  7. 2022FourCastNet: Accelerating Global High-Resolution Weather Forecasting using Adaptive Fourier Neural Operatorscited by 188
  8. 2023GenCast: Diffusion-based ensemble forecasting for medium-range weathercited by 177
  9. 2021Sinkformers: Transformers with Doubly Stochastic Attentioncited by 138
  10. 2017A Bayesian Perspective on Generalization and Stochastic Gradient Descentcited by 135
  11. 2025Skillful joint probabilistic weather forecasting from marginalscited by 63
  12. 2025FourCastNet 3: A geometric approach to probabilistic machine-learning weather forecasting at scalecited by 62
11 more
  1. 2021Optimizing Functionals on the Space of Probabilities with Input Convex Neural Networkscited by 53
  2. 2020A Mathematical Theory of Attentioncited by 46
  3. 2025A Survey on Mechanistic Interpretability for Multi-Modal Foundation Modelscited by 34
  4. 2025The Mean-Field Dynamics of Transformerscited by 30
  5. 2024A Foundation Model for the Earth Systemcited by 25
  6. 2025Universally Converging Representations of Matter Across Scientific Foundation Modelscited by 14
  7. 2025Towards mechanistic understanding in a data-driven weather model: internal activations reveal interpretable physical featurescited by 12
  8. 2024ArchesWeather: An efficient AI weather forecasting model at 1.5deg resolutioncited by 6
  9. 2025Optimal and Diffusion Transports in Machine Learningcited by 6
  10. 2025FastNet: Improving the physical consistency of machine-learning weather prediction models through loss function designcited by 5
  11. 2026Mechanistic Interpretability Tool for AI Weather Modelscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.