mlsanityData to 14 Oct 2026

Mitigating Time Discretization Challenges with WeatherODE: A Sandwich Physics-Driven Neural ODE for Weather Forecasting

arXiv 2410.06560 ↗First posted 9 Oct 2024cs.LG cs.AIcited by 6

Not on the map. Why?

Abstract (arXiv)

In the field of weather forecasting, traditional models often grapple with discretization errors and time-dependent source discrepancies, which limit their predictive performance. In this paper, we present WeatherODE, a novel one-stage, physics-driven ordinary differential equation (ODE) model designed to enhance weather forecasting accuracy. By leveraging wave equation theory and integrating a time-dependent source model, WeatherODE effectively addresses the challenges associated with time-discretization error and dynamic atmospheric processes. Moreover, we design a CNN-ViT-CNN sandwich structure, facilitating efficient learning dynamics tailored for distinct yet interrelated tasks with varying optimization biases in advection equation estimation. Through rigorous experiments, WeatherODE demonstrates superior performance in both global and regional weather forecasting tasks, outperforming recent state-of-the-art approaches by significant margins of over 40.0% and 31.8% in root mean square error (RMSE), respectively. The source code is available at urlhttps://github.com/DAMO-DI-ML/WeatherODE.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 22 of its 33 references that are in the map. First posted on arXiv 9 Oct 2024.

Builds on

22 of 33 references.

References · 22

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  5. 2022Scalable Diffusion Models with Transformerscited by 6,054
  6. 2018Neural Ordinary Differential Equationscited by 3,779
  7. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
  8. 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 527
  9. 2021Physics-informed neural networks (PINNs) for fluid mechanics: A reviewcited by 473
  10. 2023ClimaX: A foundation model for weather and climatecited by 337
  11. 2020WeatherBench: A benchmark dataset for data-driven weather forecastingcited by 275
  12. 2022GraphCast: Learning skillful medium-range global weather forecastingcited by 267
10 more
  1. 2023FuXi: A cascade machine learning forecasting system for 15-day global weather forecastcited by 241
  2. 2023Neural General Circulation Models for Weather and Climatecited by 239
  3. 2023FengWu: Pushing the Skillful Global Medium-range Weather Forecast beyond 10 Days Leadcited by 175
  4. 2022Forecasting Global Weather with Graph Neural Networkscited by 168
  5. 2024ClimODE: Climate and Weather Forecasting with Physics-informed Neural ODEscited by 82
  6. 2021Sub-seasonal forecasting with a large ensemble of deep-learning weather prediction modelscited by 79
  7. 2022Stabilized Neural Ordinary Differential Equations for Long-Time Forecasting of Dynamical Systemscited by 50
  8. 2022SwinVRNN: A Data-Driven Ensemble Forecasting Model via Learned Distribution Perturbationcited by 32
  9. 2024FengWu-GHR: Learning the Kilometer-scale Medium-range Global Weather Forecastingcited by 30
  10. 2024DeepPhysiNet: Bridging Deep Learning and Atmospheric Physics for Accurate and Continuous Weather Modelingcited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 3.

6 papers.