mlsanityData to 7 Oct 2026

Generalizing Weather Forecast to Fine-grained Temporal Scales via Physics-AI Hybrid Modeling

arXiv 2405.13796 ↗First posted 22 May 2024cs.LG cs.AIcited by 23

Not on the map. Why?

Abstract (arXiv)

Data-driven artificial intelligence (AI) models have made significant advancements in weather forecasting, particularly in medium-range and nowcasting. However, most data-driven weather forecasting models are black-box systems that focus on learning data mapping rather than fine-grained physical evolution in the time dimension. Consequently, the limitations in the temporal scale of datasets prevent these models from forecasting at finer time scales. This paper proposes a physics-AI hybrid model (i.e., WeatherGFT) which generalizes weather forecasts to finer-grained temporal scales beyond training dataset. Specifically, we employ a carefully designed PDE kernel to simulate physical evolution on a small time scale (e.g., 300 seconds) and use a parallel neural networks with a learnable router for bias correction. Furthermore, we introduce a lead time-aware training framework to promote the generalization of the model at different lead times. The weight analysis of physics-AI modules indicates that physics conducts major evolution while AI performs corrections adaptively. Extensive experiments show that WeatherGFT trained on an hourly dataset, effectively generalizes forecasts across multiple time scales, including 30-minute, which is even smaller than the dataset's temporal resolution.

Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). Builds on 34 of its 65 references that are in the map. First posted on arXiv 22 May 2024.

Builds on

34 of 65 references.

References · 34

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,571
  6. 2018A Survey Of Methods For Explaining Black Box Modelscited by 970
  7. 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 516
  8. 2021Physics-informed neural networks (PINNs) for fluid mechanics: A reviewcited by 470
  9. 2020WeatherBench: A benchmark dataset for data-driven weather forecastingcited by 272
  10. 2021Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformerscited by 237
  11. 2023FuXi: A cascade machine learning forecasting system for 15-day global weather forecastcited by 237
  12. 2022FourCastNet: Accelerating Global High-Resolution Weather Forecasting using Adaptive Fourier Neural Operatorscited by 188
22 more
  1. 2022SimVP: Simpler yet Better Video Predictioncited by 181
  2. 2023FengWu: Pushing the Skillful Global Medium-range Weather Forecast beyond 10 Days Leadcited by 170
  3. 2022Forecasting Global Weather with Graph Neural Networkscited by 165
  4. 2022Earthformer: Exploring Space-Time Transformers for Earth System Forecastingcited by 146
  5. 2017Convergence Analysis of Two-layer Neural Networks with ReLU Activationcited by 137
  6. 2023Scaling transformer neural networks for skillful and reliable medium-range weather forecastingcited by 106
  7. 2020FLAVR: Flow-Agnostic Video Representations for Fast Frame Interpolationcited by 97
  8. 2017Comparative Study of CNN and RNN for Natural Language Processingcited by 81
  9. 2024ClimODE: Climate and Weather Forecasting with Physics-informed Neural ODEscited by 78
  10. 2023Deep Learning for Day Forecasts from Sparse Observationscited by 70
  11. 2024CasCast: Skillful High-resolution Precipitation Nowcasting via Cascaded Modellingcited by 52
  12. 2022A Unified Pyramid Recurrent Network for Video Frame Interpolationcited by 39
  13. 2024FengWu-GHR: Learning the Kilometer-scale Medium-range Global Weather Forecastingcited by 30
  14. 2020Permute, Quantize, and Fine-tune: Efficient Compression of Neural Networkscited by 28
  15. 2024Scaling physics-informed hard constraints with mixture-of-expertscited by 24
  16. 2023FengWu-4DVar: Coupling the Data-driven Weather Forecasting Model with 4D Variational Assimilationcited by 22
  17. 2024CRA5: Extreme Compression of ERA5 for Portable Global Climate and Weather Research via an Efficient Variational Transformercited by 22
  18. 2023Towards an end-to-end artificial intelligence driven global weather forecasting systemcited by 20
  19. 2024ExtremeCast: Boosting Extreme Value Prediction for Global Weather Forecastcited by 19
  20. 2021Combining distribution-based neural networks to predict weather forecast probabilitiescited by 18
  21. 2024DeepPhysiNet: Bridging Deep Learning and Atmospheric Physics for Accurate and Continuous Weather Modelingcited by 11
  22. 2021Physics-Informed Neural Network Method for Solving One-Dimensional Advection Equation Using PyTorchcited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 4; 2025: 9; 2026: 10.

23 papers.

Sort:

By area:

  1. 2024Air Quality Prediction with Physics-Guided Dual Neural ODEs in Open Systemscited by 25
  2. 2024WeatherGFM: Learning A Weather Generalist Foundation Model via In-context Learningcited by 12
  3. 2025PhyDA: Physics-Guided Diffusion Models for Data Assimilation in Atmospheric Systemscited by 9
  4. 2024PredBench: Benchmarking Spatio-Temporal Prediction across Diverse Disciplinescited by 6
  5. 2025STCast: Adaptive Boundary Alignment for Global and Regional Weather Forecastingcited by 6
  6. 2024VA-MoE: Variables-Adaptive Mixture of Experts for Incremental Weather Forecastingcited by 5
  7. 2026EMFormer: Efficient Multi-Scale Transformer for Accumulative Context Weather Forecastingcited by 3
  8. 2025RainPro-8: An Efficient Deep Learning Model to Estimate Rainfall Probabilities Over 8 Hourscited by 2
  9. 2025FuXi-RTM: A Physics-Guided Prediction Framework with Radiative Transfer Modelingcited by 1
  10. 2025Physics-Assisted and Topology-Informed Deep Learning for Weather Predictioncited by 1
  11. 2025XiChen: A global weather observation-to-forecast machine learning system via four-dimensional variational gradient-guided flexible assimilationcited by 1
  12. 2025DAWP: A framework for global observation forecasting via Data Assimilation and Weather Prediction in satellite observation spacecited by 1
11 more
  1. 2025Breaking Scale Anchoring: Frequency Representation Learning for Accurate High-Resolution Inference from Low-Resolution Trainingcited by 1
  2. 2026VeinCast: Physics-Guided Dynamic Field Graphs with Graph-Conditioned Fusion for Global Medium-Range Weather Forecastingcited by 1
  3. 2026StationPDE: Station-Oriented Surface PDE Learning for Multi-Station Multivariate Weather Forecastingcited by 1
  4. 2025SSTODE: Ocean-Atmosphere Physics-Informed Neural ODEs for Sea Surface Temperature Predictioncited by 0
  5. 2026Sharpness-Aware Hybrid Model Learning for Architecture-Agnostic Parameter Estimationcited by 0
  6. 2026Station2Radar: query conditioned gaussian splatting for precipitation fieldcited by 0
  7. 2026Generative 3D Gaussian Splatting for Arbitrary-ResolutionAtmospheric Downscaling and Forecastingcited by 0
  8. 2026Physics-Constrained Neural Networks for Improved Short-Term Weather Forecasting: A Case Study over the South Pacificcited by 0
  9. 2026Physics-Informed Super-Resolution of Atmospheric Datacited by 0
  10. 2026M2Weather: A Benchmark for Joint Multi-Station and Multi-Variable Weather Forecastingcited by 0
  11. 2026Varda-single-1.0: deterministic data-driven weather forecasting at 1 km resolution over Switzerland's complex topographycited by 0