Deep Learning and Foundation Models for Weather Prediction: A Survey
Not on the map. Why?
Abstract (arXiv)
Physics-based numerical models have been the bedrock of atmospheric sciences for decades, offering robust solutions but often at the cost of significant computational resources. Deep learning (DL) models have emerged as powerful tools in meteorology, capable of analyzing complex weather and climate data by learning intricate dependencies and providing rapid predictions once trained. While these models demonstrate promising performance in weather prediction, often surpassing traditional physics-based methods, they still face critical challenges. This paper presents a comprehensive survey of recent deep learning and foundation models for weather prediction. We propose a taxonomy to classify existing models based on their training paradigms: deterministic predictive learning, probabilistic generative learning, and pre-training and fine-tuning. For each paradigm, we delve into the underlying model architectures, address major challenges, offer key insights, and propose targeted directions for future research. Furthermore, we explore real-world applications of these methods and provide a curated summary of open-source code repositories and widely used datasets, aiming to bridge research advancements with practical implementations while fostering open and trustworthy scientific practices in adopting cutting-edge artificial intelligence for weather prediction. The related sources are available at https://github.com/JimengShi/ DL-Foundation-Models-Weather.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 157 of its 341 references that are in the map. First posted on arXiv 12 Jan 2025.
Builds on
157 of 341 references.
References · 157
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2017Mask R-CNNcited by 7,259
38 more
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2013Intriguing properties of neural networkscited by 5,114
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
- 2023A Survey of Large Language Modelscited by 2,537
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
- 2014Conditional Generative Adversarial Netscited by 2,152
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
- 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,215
- 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
- 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,051
- 2022Diffusion Models in Vision: A Surveycited by 1,008
- 2018A Survey Of Methods For Explaining Black Box Modelscited by 970
- 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
- 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 748
- 2024Chronos: Learning the Language of Time Seriescited by 712
- 2017AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networkscited by 664
- 2023A decoder-only foundation model for time-series forecastingcited by 650
- 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 600
- 2024Unified Training of Universal Time Series Forecasting Transformerscited by 588
- 2022Transformers in Time Series: A Surveycited by 489
- 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 453
- 2020A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospectscited by 396
- 2021Autoregressive Denoising Diffusion Models for Multivariate Probabilistic Time Series Forecastingcited by 332
- 2024Benchmarking Retrieval-Augmented Generation for Medicinecited by 326
- 2023ClimaX: A foundation model for weather and climatecited by 325
- 2021Skillful Precipitation Nowcasting using Deep Generative Models of Radarcited by 308
- 2023Effective Data Augmentation With Diffusion Modelscited by 282
- 2020WeatherBench: A benchmark dataset for data-driven weather forecastingcited by 272
50 most cited of 157 All 157 (JSON)
Built on by
Citing papers per year: 2025: 9; 2026: 6.
15 papers.
Sort:
By area:
- 2025Utilizing Strategic Pre-training to Reduce Overfitting: Baguan -- A Pre-trained Weather Forecasting Modelcited by 6
- 2025SciVid: Cross-Domain Evaluation of Video Models in Scientific Applicationscited by 5
- 2025Task-Adaptive Parameter-Efficient Fine-Tuning for Weather Foundation Modelscited by 3
- 2025Retrieval-Augmented Foundation Models for Water Level Prediction in the Evergladescited by 2
- 2025Hierarchical AI-Meteorologist: LLM-Agent System for Multi-Scale and Explainable Weather Forecast Reportingcited by 2
- 2025Breaking the Statistical Similarity Trap in Extreme Convection Detectioncited by 0
- 2025DPSformer: A long-tail-aware model for improving heavy rainfall predictioncited by 0
- 2025A Diversity-optimized Deep Ensemble Approach for Accurate Plant Leaf Disease Detectioncited by 0
- 2025Real-Time Long Horizon Air Quality Forecasting via Group-Relative Policy Optimizationcited by 0
- 2026Target Concept Tuning Improves Extreme Weather Forecastingcited by 0
- 2026Optimizing Multi-Agent Weather Captioning via Text Gradient Descent: A Training-Free Approach with Consensus-Aware Gradient Fusioncited by 0
- 2026Apeliotes: A Diffusion-Based Modeling Framework for km-scale Multi-Level Atmospheric Fieldscited by 0
3 more
- 2026Physics-Guided Flow-Map Matching for Precipitation Nowcasting27 Sep 2026
- 2026A Station-Based Evaluation of Machine Learning-based Weather Forecasting Models in Northern Norway25 Aug 2026
- 2026Geospatial Diffusion-based Evolution Synthesis (GeoDES) for Storm-Centered Weather Augmentation21 Jul 2026
- 2026Apeliotes: A Diffusion-Based Modeling Framework for km-scale Multi-Level Atmospheric Fields19 Jul 2026
- 2026Optimizing Multi-Agent Weather Captioning via Text Gradient Descent: A Training-Free Approach with Consensus-Aware Gradient Fusion23 Mar 2026
- 2026Target Concept Tuning Improves Extreme Weather Forecasting17 Mar 2026
- 2025Hierarchical AI-Meteorologist: LLM-Agent System for Multi-Scale and Explainable Weather Forecast Reporting28 Nov 2025
- 2025Real-Time Long Horizon Air Quality Forecasting via Group-Relative Policy Optimization27 Nov 2025
- 2025A Diversity-optimized Deep Ensemble Approach for Accurate Plant Leaf Disease Detection21 Nov 2025
- 2025Task-Adaptive Parameter-Efficient Fine-Tuning for Weather Foundation Models26 Sep 2025
- 2025DPSformer: A long-tail-aware model for improving heavy rainfall prediction20 Sep 2025
- 2025Breaking the Statistical Similarity Trap in Extreme Convection Detection11 Sep 2025
3 more
- 2025Retrieval-Augmented Foundation Models for Water Level Prediction in the Everglades6 Aug 2025
- 2025SciVid: Cross-Domain Evaluation of Video Models in Scientific Applications4 Jul 2025
- 2025Utilizing Strategic Pre-training to Reduce Overfitting: Baguan -- A Pre-trained Weather Forecasting Model20 May 2025
- 2025Utilizing Strategic Pre-training to Reduce Overfitting: Baguan -- A Pre-trained Weather Forecasting Modelcited by 6
- 2025SciVid: Cross-Domain Evaluation of Video Models in Scientific Applicationscited by 5
- 2025Task-Adaptive Parameter-Efficient Fine-Tuning for Weather Foundation Modelscited by 3
- 2025Breaking the Statistical Similarity Trap in Extreme Convection Detectioncited by 0
- 2025DPSformer: A long-tail-aware model for improving heavy rainfall predictioncited by 0
- 2025A Diversity-optimized Deep Ensemble Approach for Accurate Plant Leaf Disease Detectioncited by 0
- 2025Real-Time Long Horizon Air Quality Forecasting via Group-Relative Policy Optimizationcited by 0
- 2026Target Concept Tuning Improves Extreme Weather Forecastingcited by 0
- 2026Optimizing Multi-Agent Weather Captioning via Text Gradient Descent: A Training-Free Approach with Consensus-Aware Gradient Fusioncited by 0
- 2026Apeliotes: A Diffusion-Based Modeling Framework for km-scale Multi-Level Atmospheric Fieldscited by 0
- 2026Geospatial Diffusion-based Evolution Synthesis (GeoDES) for Storm-Centered Weather Augmentationcited by 0
- 2026A Station-Based Evaluation of Machine Learning-based Weather Forecasting Models in Northern Norwaycited by 0
12 most cited of 13 All 13 (JSON)
- 2026Physics-Guided Flow-Map Matching for Precipitation Nowcasting27 Sep 2026
- 2026A Station-Based Evaluation of Machine Learning-based Weather Forecasting Models in Northern Norway25 Aug 2026
- 2026Geospatial Diffusion-based Evolution Synthesis (GeoDES) for Storm-Centered Weather Augmentation21 Jul 2026
- 2026Apeliotes: A Diffusion-Based Modeling Framework for km-scale Multi-Level Atmospheric Fields19 Jul 2026
- 2026Optimizing Multi-Agent Weather Captioning via Text Gradient Descent: A Training-Free Approach with Consensus-Aware Gradient Fusion23 Mar 2026
- 2026Target Concept Tuning Improves Extreme Weather Forecasting17 Mar 2026
- 2025Real-Time Long Horizon Air Quality Forecasting via Group-Relative Policy Optimization27 Nov 2025
- 2025A Diversity-optimized Deep Ensemble Approach for Accurate Plant Leaf Disease Detection21 Nov 2025
- 2025Task-Adaptive Parameter-Efficient Fine-Tuning for Weather Foundation Models26 Sep 2025
- 2025DPSformer: A long-tail-aware model for improving heavy rainfall prediction20 Sep 2025
- 2025Breaking the Statistical Similarity Trap in Extreme Convection Detection11 Sep 2025
- 2025SciVid: Cross-Domain Evaluation of Video Models in Scientific Applications4 Jul 2025
12 newest of 13 All 13 (JSON)