Searth Transformer: A Transformer Architecture Incorporating Earth's Geospheric Physical Priors for Global Mid-Range Weather Forecasting
Not on the map. Why?
Abstract (arXiv)
Accurate global medium-range weather forecasting is fundamental to Earth system science. Most existing Transformer-based forecasting models adopt vision-centric architectures that neglect the Earth's spherical geometry and zonal periodicity. In addition, conventional autoregressive training is computationally expensive and limits forecast horizons due to error accumulation. To address these challenges, we propose the Shifted Earth Transformer (Searth Transformer), a physics-informed architecture that incorporates zonal periodicity and meridional boundaries into window-based self-attention for physically consistent global information exchange. We further introduce a Relay Autoregressive (RAR) fine-tuning strategy that enables learning long-range atmospheric evolution under constrained memory and computational budgets. Based on these methods, we develop YanTian, a global medium-range weather forecasting model. YanTian achieves higher accuracy than the high-resolution forecast of the European Centre for Medium-Range Weather Forecasts and performs competitively with state-of-the-art AI models at one-degree resolution, while requiring roughly 200 times lower computational cost than standard autoregressive fine-tuning. Furthermore, YanTian attains a longer skillful forecast lead time for Z500 (10.3 days) than HRES (9 days). Beyond weather forecasting, this work establishes a robust algorithmic foundation for predictive modeling of complex global-scale geophysical circulation systems, offering new pathways for Earth system science.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 39 references that are in the map. First posted on arXiv 14 Jan 2026.
Builds on
21 of 39 references.
References · 21
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2017Mixed Precision Trainingcited by 1,135
- 2021Transformers in Vision: A Surveycited by 1,009
- 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 748
- 2020WeatherBench: A benchmark dataset for data-driven weather forecastingcited by 272
9 more
- 2023FuXi: A cascade machine learning forecasting system for 15-day global weather forecastcited by 237
- 2023WeatherBench 2: A benchmark for the next generation of data-driven global weather modelscited by 227
- 2023Spherical Fourier Neural Operators: Learning Stable Dynamics on the Spherecited by 225
- 2016FractalNet: Ultra-Deep Neural Networks without Residualscited by 216
- 2023FengWu: Pushing the Skillful Global Medium-range Weather Forecast beyond 10 Days Leadcited by 170
- 2025OneForecast: A Universal Framework for Global and Regional Weather Forecastingcited by 30
- 2023Advancing Parsimonious Deep Learning Weather Prediction using the HEALPix Meshcited by 27
- 2024PuYun: Medium-Range Global Weather Forecasting Using Large Kernel Attention Convolutional Networkscited by 2
- 2024YanTian: An Application Platform for AI Global Weather Forecasting Modelscited by 1
Built on by
Not cited yet.