mlsanityData to 14 Oct 2026

Does Aurora Encode Atmospheric Structure? Latent Regime Analysis and Attribution

arXiv 2606.26361 ↗First posted 24 Jun 2026cs.LG physics.ao-phcited by 0

Not on the map. Why?

Abstract (arXiv)

ML foundation models are able to emulate atmospheric dynamics accurately and efficiently but operate as opaque ``black boxes''. We investigate the internal representations of the Aurora model using spatially pooled PCA and layer-wise relevance propagation (LRP). We find evidence that Aurora's latent space is primarily organized by seasonal cycles, whereas extreme storm events do not form a linearly separable cluster. LRP indicates that the model attends to features consistent with the 3D vertical structure of the Great Storm of 1987. Perturbation tests show masking relevant regions degrades forecasts 3.31× more than random masking. These findings suggest that Aurora learns meteorological coherence and vertical structure without explicit instruction.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 28 references that are in the map. First posted on arXiv 24 Jun 2026.

Builds on

17 of 28 references.

References · 17

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  3. 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,301
  4. 2021Perceiver: General Perception with Iterative Attentioncited by 1,104
  5. 2016Training Deep Nets with Sublinear Memory Costcited by 848
  6. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
  7. 2017Understanding the Effective Receptive Field in Deep Convolutional Neural Networkscited by 553
  8. 2015Evaluating the visualization of what a Deep Neural Network has learnedcited by 419
  9. 2016Layer-wise Relevance Propagation for Neural Networks with Local Renormalization Layerscited by 199
  10. 2022Pangu-Weather: A 3D High-Resolution Model for Fast and Accurate Global Weather Forecastcited by 166
  11. 2021Software for Dataset-wide XAI: From Local Explanations to Global Insights with Zennit, CoRelAy, and ViRelAycited by 55
  12. 2025The Origins of Representation Manifolds in Large Language Modelscited by 51
5 more
  1. 2019Physically Interpretable Neural Networks for the Geosciences: Applications to Earth System Variabilitycited by 44
  2. 2024LeGrad: An Explainability Method for Vision Transformers via Feature Formation Sensitivitycited by 33
  3. 2025Towards mechanistic understanding in a data-driven weather model: internal activations reveal interpretable physical featurescited by 12
  4. 2020Evaluation, Tuning and Interpretation of Neural Networks for Meteorological Applicationscited by 7
  5. 2025Physical Consistency of Aurora's Encoder: A Quantitative Studycited by 1

Built on by

Not cited yet.