Mitigating Time Discretization Challenges with WeatherODE: A Sandwich Physics-Driven Neural ODE for Weather Forecasting
Not on the map. Why?
Abstract (arXiv)
In the field of weather forecasting, traditional models often grapple with discretization errors and time-dependent source discrepancies, which limit their predictive performance. In this paper, we present WeatherODE, a novel one-stage, physics-driven ordinary differential equation (ODE) model designed to enhance weather forecasting accuracy. By leveraging wave equation theory and integrating a time-dependent source model, WeatherODE effectively addresses the challenges associated with time-discretization error and dynamic atmospheric processes. Moreover, we design a CNN-ViT-CNN sandwich structure, facilitating efficient learning dynamics tailored for distinct yet interrelated tasks with varying optimization biases in advection equation estimation. Through rigorous experiments, WeatherODE demonstrates superior performance in both global and regional weather forecasting tasks, outperforming recent state-of-the-art approaches by significant margins of over 40.0% and 31.8% in root mean square error (RMSE), respectively. The source code is available at urlhttps://github.com/DAMO-DI-ML/WeatherODE.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 22 of its 33 references that are in the map. First posted on arXiv 9 Oct 2024.
Builds on
22 of 33 references.
References · 22
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
- 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 527
- 2021Physics-informed neural networks (PINNs) for fluid mechanics: A reviewcited by 473
- 2023ClimaX: A foundation model for weather and climatecited by 337
- 2020WeatherBench: A benchmark dataset for data-driven weather forecastingcited by 275
- 2022GraphCast: Learning skillful medium-range global weather forecastingcited by 267
10 more
- 2023FuXi: A cascade machine learning forecasting system for 15-day global weather forecastcited by 241
- 2023Neural General Circulation Models for Weather and Climatecited by 239
- 2023FengWu: Pushing the Skillful Global Medium-range Weather Forecast beyond 10 Days Leadcited by 175
- 2022Forecasting Global Weather with Graph Neural Networkscited by 168
- 2024ClimODE: Climate and Weather Forecasting with Physics-informed Neural ODEscited by 82
- 2021Sub-seasonal forecasting with a large ensemble of deep-learning weather prediction modelscited by 79
- 2022Stabilized Neural Ordinary Differential Equations for Long-Time Forecasting of Dynamical Systemscited by 50
- 2022SwinVRNN: A Data-Driven Ensemble Forecasting Model via Learned Distribution Perturbationcited by 32
- 2024FengWu-GHR: Learning the Kilometer-scale Medium-range Global Weather Forecastingcited by 30
- 2024DeepPhysiNet: Bridging Deep Learning and Atmospheric Physics for Accurate and Continuous Weather Modelingcited by 12
Built on by
Citing papers per year: 2025: 3; 2026: 3.
6 papers.
- 2025Bridging Past and Future: Distribution-Aware Alignment for Time Series Forecastingcited by 20
- 2025Deep Learning and Foundation Models for Weather Prediction: A Surveycited by 16
- 2025FuXi-RTM: A Physics-Guided Prediction Framework with Radiative Transfer Modelingcited by 2
- 2026RainODE: Continuous-Time Precipitation Forecasting with Latent Neural ODEscited by 2
- 2026Accurate, Efficient, and Explainable Deep Learning Approaches for Environmental Science Problemscited by 0
- 2026Learning Continuous Regional Temperature Fields with Lead-Time and Resolution Queriescited by 0
- 2026Learning Continuous Regional Temperature Fields with Lead-Time and Resolution Queries26 Aug 2026
- 2026RainODE: Continuous-Time Precipitation Forecasting with Latent Neural ODEs29 Jun 2026
- 2026Accurate, Efficient, and Explainable Deep Learning Approaches for Environmental Science Problems19 May 2026
- 2025Bridging Past and Future: Distribution-Aware Alignment for Time Series Forecasting17 Sep 2025
- 2025FuXi-RTM: A Physics-Guided Prediction Framework with Radiative Transfer Modeling25 Mar 2025
- 2025Deep Learning and Foundation Models for Weather Prediction: A Survey12 Jan 2025