Scaling Storm-Resolving Atmospheric AI Simulation to the Entire Planet
Not on the map. Why?
Abstract (arXiv)
Kilometer-scale convection shapes precipitation extremes, tropical organization, and cloud feedbacks, but most global atmospheric models approximate these processes at 25-100 km resolution. Global storm-resolving physics models resolve convective systems explicitly, but at a cost -- roughly one MWh per simulated day on exascale supercomputers -- that limits long-duration simulation. We introduce STRATA (Storm-resolving Tile-based autoRegressive Atmosphere Transformer Architecture), the first autoregressive AI emulator for global storm-resolving atmospheric dynamics. STRATA is trained on the highest-resolution atmospheric dataset yet used for global AI emulation: 17 days of SCREAM physics-model output at 4.9-km resolution (~25 million grid cells) sampled every 10 minutes. Our central premise is that on 10-minute timescales atmospheric dynamics are predominantly local, so training on small spatial tiles trades scarce global temporal samples for abundant local spatial samples and enables global rollout via overlapping-tile blending. STRATA combines 3D patch embedding and local 3D neighborhood attention, a novel Stereographic Rotary Position Embedding (StereoRoPE) for grid-invariant encoding, and a pixel-space de-aliasing decoder that suppresses patch-scale rollout artifacts. An iso-FLOP scaling study reveals that km-scale emulation requires ~10x more FLOPs per grid point than coarse-resolution AI weather models, consistent with the higher information density of convective-scale dynamics. Trained on only 17 days of data, STRATA produces stable 24-hour global rollouts with realistic km-scale dynamics across diverse regimes, though large-scale biases develop with lead time. It achieves 48 simulation days per megawatt-hour -- about 50 times better energy efficiency than the SCREAM physics model -- and 741 simulated days per wall-clock day at 512 H100 GPUs. Code and dataset are publicly available.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 56 references that are in the map. First posted on arXiv 30 Jun 2026.
Builds on
28 of 56 references.
References · 28
- 2017Attention Is All You Needcited by 60,361
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2022Training Compute-Optimal Large Language Modelscited by 3,019
- 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
- 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 536
- 2019Making Convolutional Networks Shift-Invariant Againcited by 391
- 2025Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Freecited by 283
- 2020Query-Key Normalization for Transformerscited by 280
- 2023FuXi: A cascade machine learning forecasting system for 15-day global weather forecastcited by 241
- 2023Neural General Circulation Models for Weather and Climatecited by 239
16 more
- 2024Rotary Position Embedding for Vision Transformercited by 236
- 2023Spherical Fourier Neural Operators: Learning Stable Dynamics on the Spherecited by 233
- 2023GenCast: Diffusion-based ensemble forecasting for medium-range weathercited by 177
- 2022Forecasting Global Weather with Graph Neural Networkscited by 168
- 2023Residual Corrective Diffusion Modeling for Km-scale Atmospheric Downscalingcited by 110
- 2023Scaling transformer neural networks for skillful and reliable medium-range weather forecastingcited by 110
- 2025PixelDiT: Pixel Diffusion Transformers for Image Generationcited by 83
- 2025FourCastNet 3: A geometric approach to probabilistic machine-learning weather forecasting at scalecited by 62
- 2024ACE2: Accurately learning subseasonal to decadal atmospheric variability and forced responsescited by 54
- 2024Kilometer-Scale Convection Allowing Model Emulation using Generative Diffusion Modelingcited by 32
- 2023Advancing Parsimonious Deep Learning Weather Prediction using the HEALPix Meshcited by 28
- 2024Probabilistic Emulation of a Global Climate Model with Spherical DYffusioncited by 21
- 2025Generalized Neighborhood Attention: Multi-dimensional Sparse Attention at the Speed of Lightcited by 18
- 2026Demystifying Data-Driven Probabilistic Medium-Range Weather Forecastingcited by 15
- 2026Scaling Laws of Global Weather Modelscited by 9
- 2025HRRRCast: a data-driven emulator for regional weather forecasting at convection allowing scalescited by 7
Built on by
Not cited yet.