mlsanityData to 7 Oct 2026

Deep Learning and Foundation Models for Weather Prediction: A Survey

arXiv 2501.06907 ↗First posted 12 Jan 2025cs.LGcited by 15

Not on the map. Why?

Abstract (arXiv)

Physics-based numerical models have been the bedrock of atmospheric sciences for decades, offering robust solutions but often at the cost of significant computational resources. Deep learning (DL) models have emerged as powerful tools in meteorology, capable of analyzing complex weather and climate data by learning intricate dependencies and providing rapid predictions once trained. While these models demonstrate promising performance in weather prediction, often surpassing traditional physics-based methods, they still face critical challenges. This paper presents a comprehensive survey of recent deep learning and foundation models for weather prediction. We propose a taxonomy to classify existing models based on their training paradigms: deterministic predictive learning, probabilistic generative learning, and pre-training and fine-tuning. For each paradigm, we delve into the underlying model architectures, address major challenges, offer key insights, and propose targeted directions for future research. Furthermore, we explore real-world applications of these methods and provide a curated summary of open-source code repositories and widely used datasets, aiming to bridge research advancements with practical implementations while fostering open and trustworthy scientific practices in adopting cutting-edge artificial intelligence for weather prediction. The related sources are available at https://github.com/JimengShi/ DL-Foundation-Models-Weather.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 157 of its 341 references that are in the map. First posted on arXiv 12 Jan 2025.

Builds on

157 of 341 references.

References · 157

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  5. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  6. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  7. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  8. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  9. 2020Denoising Diffusion Implicit Modelscited by 9,655
  10. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  11. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  12. 2017Mask R-CNNcited by 7,259
38 more
  1. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  2. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  3. 2013Intriguing properties of neural networkscited by 5,114
  4. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  5. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  6. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  7. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
  8. 2023A Survey of Large Language Modelscited by 2,537
  9. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  10. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
  11. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
  12. 2014Conditional Generative Adversarial Netscited by 2,152
  13. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  14. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
  15. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
  16. 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
  17. 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,215
  18. 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
  19. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
  20. 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,051
  21. 2022Diffusion Models in Vision: A Surveycited by 1,008
  22. 2018A Survey Of Methods For Explaining Black Box Modelscited by 970
  23. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
  24. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 748
  25. 2024Chronos: Learning the Language of Time Seriescited by 712
  26. 2017AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networkscited by 664
  27. 2023A decoder-only foundation model for time-series forecastingcited by 650
  28. 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 600
  29. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 588
  30. 2022Transformers in Time Series: A Surveycited by 489
  31. 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 453
  32. 2020A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospectscited by 396
  33. 2021Autoregressive Denoising Diffusion Models for Multivariate Probabilistic Time Series Forecastingcited by 332
  34. 2024Benchmarking Retrieval-Augmented Generation for Medicinecited by 326
  35. 2023ClimaX: A foundation model for weather and climatecited by 325
  36. 2021Skillful Precipitation Nowcasting using Deep Generative Models of Radarcited by 308
  37. 2023Effective Data Augmentation With Diffusion Modelscited by 282
  38. 2020WeatherBench: A benchmark dataset for data-driven weather forecastingcited by 272

50 most cited of 157 All 157 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 9; 2026: 6.

15 papers.

Sort:

By area:

  1. 2025Utilizing Strategic Pre-training to Reduce Overfitting: Baguan -- A Pre-trained Weather Forecasting Modelcited by 6
  2. 2025SciVid: Cross-Domain Evaluation of Video Models in Scientific Applicationscited by 5
  3. 2025Task-Adaptive Parameter-Efficient Fine-Tuning for Weather Foundation Modelscited by 3
  4. 2025Retrieval-Augmented Foundation Models for Water Level Prediction in the Evergladescited by 2
  5. 2025Hierarchical AI-Meteorologist: LLM-Agent System for Multi-Scale and Explainable Weather Forecast Reportingcited by 2
  6. 2025Breaking the Statistical Similarity Trap in Extreme Convection Detectioncited by 0
  7. 2025DPSformer: A long-tail-aware model for improving heavy rainfall predictioncited by 0
  8. 2025A Diversity-optimized Deep Ensemble Approach for Accurate Plant Leaf Disease Detectioncited by 0
  9. 2025Real-Time Long Horizon Air Quality Forecasting via Group-Relative Policy Optimizationcited by 0
  10. 2026Target Concept Tuning Improves Extreme Weather Forecastingcited by 0
  11. 2026Optimizing Multi-Agent Weather Captioning via Text Gradient Descent: A Training-Free Approach with Consensus-Aware Gradient Fusioncited by 0
  12. 2026Apeliotes: A Diffusion-Based Modeling Framework for km-scale Multi-Level Atmospheric Fieldscited by 0
3 more
  1. 2026Geospatial Diffusion-based Evolution Synthesis (GeoDES) for Storm-Centered Weather Augmentationcited by 0
  2. 2026A Station-Based Evaluation of Machine Learning-based Weather Forecasting Models in Northern Norwaycited by 0
  3. 2026Physics-Guided Flow-Map Matching for Precipitation Nowcastingcited by 0