Physics-Guided Multimodal Transformers are the Necessary Foundation for the Next Generation of Meteorological Science
Not on the map. Why?
Abstract (arXiv)
This position paper argues that the next generation of artificial intelligence in meteorological and climate sciences must transition from fragmented hybrid heuristics toward a unified paradigm of physics-guided multimodal transformers. While purely data-driven models have achieved significant gains in predictive accuracy, they often treat atmospheric processes as mere visual patterns, frequently producing results that lack scientific consistency or violate fundamental physical laws. We contend that current ``hybrid'' attempts to bridge this gap remain ad-hoc and struggle to scale across the heterogeneous nature of meteorological data ranging from satellite imagery to sparse sensor measurements. We argue that the transformer architecture, through its inherent capacity for cross-modal alignment, provides the only viable foundation for a systematic integration of domain knowledge via physical constraint embedding and physics-informed loss functions. By advocating for this unified architectural shift, we aim to steer the community away from ``black-box'' curve fitting and toward AI systems that are inherently falsifiable, scientifically grounded, and robust enough to address the existential challenges of extreme weather and climate change.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 38 references that are in the map. First posted on arXiv 19 Apr 2025.
Builds on
16 of 38 references.
References · 16
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
- 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
- 2023Neural General Circulation Models for Weather and Climatecited by 239
- 2022Pangu-Weather: A 3D High-Resolution Model for Fast and Accurate Global Weather Forecastcited by 166
- 2020MetNet: A Neural Weather Model for Precipitation Forecastingcited by 131
- 2019Neural Machine Translation with Byte-Level Subwordscited by 115
- 2017DeepSD: Generating High Resolution Climate Change Projections through Single Image Super-Resolutioncited by 82
- 2024ClimODE: Climate and Weather Forecasting with Physics-informed Neural ODEscited by 82
- 2019Towards Learning Universal, Regional, and Local Hydrological Behaviors via Machine-Learning Applied to Large-Sample Datasetscited by 69
- 2016Application of Deep Convolutional Neural Networks for Detecting Extreme Weather in Climate Datasetscited by 31
4 more
- 2022Physically Constrained Generative Adversarial Networks for Improving Precipitation Fields from Earth System Modelscited by 29
- 2023W-MAE: Pre-trained weather model with masked autoencoder for multi-variable weather forecastingcited by 29
- 2024FuXi Weather: A data-to-forecast machine learning system for global weathercited by 21
- 2024Advancing Heatwave Forecasting via Distribution Informed-Graph Neural Networks (DI-GNNs): Integrating Extreme Value Theory with GNNscited by 1
Built on by
Not cited yet.