FourCastNet 3: A geometric approach to probabilistic machine-learning weather forecasting at scale
Not on the map. Why?
Abstract (arXiv)
FourCastNet 3 advances global weather modeling by implementing a scalable, geometric machine learning (ML) approach to probabilistic ensemble forecasting. The approach is designed to respect spherical geometry and to accurately model the spatially correlated probabilistic nature of the problem, resulting in stable spectra and realistic dynamics across multiple scales. FourCastNet 3 delivers forecasting accuracy that surpasses leading conventional ensemble models and rivals the best diffusion-based methods, while producing forecasts 8 to 60 times faster than these approaches. In contrast to other ML approaches, FourCastNet 3 demonstrates excellent probabilistic calibration and retains realistic spectra, even at extended lead times of up to 60 days. All of these advances are realized using a purely convolutional neural network architecture tailored for spherical geometry. Scalable and efficient large-scale training on 1024 GPUs and more is enabled by a novel training paradigm for combined model- and data-parallelism, inspired by domain decomposition methods in classical numerical models. Additionally, FourCastNet 3 enables rapid inference on a single GPU, producing a 60-day global forecast at 0.25deg, 6-hourly resolution in under 4 minutes. Its computational efficiency, medium-range probabilistic skill, spectral fidelity, and rollout stability at subseasonal timescales make it a strong candidate for improving meteorological forecasting and early warning systems through large ensemble predictions.
Key facts. Cited by 56 papers in the map (data through 7 Oct 2026). Builds on 30 of its 64 references that are in the map. First posted on arXiv 16 Jul 2025.
Builds on
30 of 64 references.
References · 30
- 2017Attention Is All You Needcited by 59,932
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
- 2016Gaussian Error Linear Units (GELUs)cited by 3,431
- 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,278
- 2021Alias-Free Generative Adversarial Networkscited by 1,181
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
- 2021Going deeper with Image Transformerscited by 759
- 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 748
- 2023PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallelcited by 641
- 2023FuXi: A cascade machine learning forecasting system for 15-day global weather forecastcited by 237
- 2023WeatherBench 2: A benchmark for the next generation of data-driven global weather modelscited by 227
18 more
- 2023Spherical Fourier Neural Operators: Learning Stable Dynamics on the Spherecited by 225
- 2022FourCastNet: Accelerating Global High-Resolution Weather Forecasting using Adaptive Fourier Neural Operatorscited by 188
- 2022Pangu-Weather: A 3D High-Resolution Model for Fast and Accurate Global Weather Forecastcited by 164
- 2018Neural networks for post-processing ensemble weather forecastscited by 95
- 2021Sub-seasonal forecasting with a large ensemble of deep-learning weather prediction modelscited by 76
- 2024Neural Operators with Localized Integral and Differential Kernelscited by 59
- 2023ACE: A fast, skillful learned global atmospheric model for climate predictioncited by 53
- 2023AtmoRep: A stochastic model of atmosphere dynamics using large scale representation learningcited by 35
- 2020Automatic Cross-Replica Sharding of Weight Update in Data-Parallel Trainingcited by 30
- 2024LUCIE: A Lightweight Uncoupled ClImate Emulator with long-term stability and physical consistency for O(1000)-member ensemblescited by 30
- 2020Efficient Generalized Spherical CNNscited by 29
- 2024Continuous Ensemble Weather Forecasting with Diffusion modelscited by 27
- 2025Fixing the Double Penalty in Data-Driven Weather Forecasting Through a Modified Spherical Harmonic Loss Functioncited by 27
- 2024A Practical Probabilistic Benchmark for AI Weather Modelscited by 25
- 2022Scalable and Equivariant Spherical CNNs by Discrete-Continuous (DISCO) Convolutionscited by 23
- 2024Huge Ensembles Part II: Properties of a Huge Ensemble of Hindcasts Generated with Spherical Fourier Neural Operatorscited by 12
- 2024Exploring the design space of deep-learning-based weather forecasting systemscited by 8
- 2025Dynamical errors in machine learning forecastscited by 5
Built on by
Citing papers per year: 2025: 12; 2026: 44.
56 papers.
Sort:
By area:
- 2026Demystifying Data-Driven Probabilistic Medium-Range Weather Forecastingcited by 12
- 2026U-Cast: A Surprisingly Simple and Efficient Frontier Probabilistic AI Weather Forecastercited by 10
- 2025High-Resolution Probabilistic Data-Driven Weather Modeling with a Stretched-Gridcited by 7
- 2026Earth System Foundation Model (ESFM): A unified framework for heterogeneous data integration and forecastingcited by 6
- 2026Probabilistic Retrofitting of Learned Simulatorscited by 5
- 2025FastNet: Improving the physical consistency of machine-learning weather prediction models through loss function designcited by 4
- 2026(Sparse) Attention to the Details: Preserving Spectral Fidelity in ML-based Weather Forecasting Modelscited by 4
- 2026From Observation to Insight: Mechanistic World Models and the Quest for Autonomous Discoverycited by 4
- 2025Forecast Skill Is Not Decision Skill: Evidence from Weather-Dependent Decision Taskscited by 3
- 2025Controllable Probabilistic Forecasting with Stochastic Decomposition Layerscited by 3
- 2025MoWE : A Mixture of Weather Expertscited by 2
- 2025Forecasting the Future with Yesterday's Climate: Temperature Bias in AI Weather and Climate Modelscited by 2
38 more
- 2025Generative Urban Flow Modeling: From Geometry to Airflow with Graph Diffusioncited by 2
- 2025Long-Range Distillation: Distilling 10,000 Years of Simulated Climate into Long Timestep AI Weather Modelscited by 2
- 2026Parallelised Differentiable Straightest Geodesics for 3D Meshescited by 2
- 2026Sonny: Breaking the Compute Wall in Medium-Range Weather Forecastingcited by 2
- 2026One Operator for Many Densities: Amortized Approximation of Conditioning by Neural Operatorscited by 2
- 2025Crowdsourcing the Frontier: Advancing Hybrid Physics-ML Climate Simulation via a 50,000 Kaggle Competitioncited by 1
- 2025Field-Space Attention for Structure-Preserving Earth System Transformerscited by 1
- 2026Probabilistic Transformers for Joint Modeling of Global Weather Dynamics and Decision-Centric Variablescited by 1
- 2026Multi-Scale Wavelet Transformers for Operator Learning of Dynamical Systemscited by 1
- 2026SnareNet: Flexible Repair Layers for Neural Networks with Hard Constraintscited by 1
- 2026Examining Fast Radiatively Driven Responses Using Machine-Learning Weather Emulatorscited by 1
- 2026Super-Resolving Coarse-Resolution Weather Forecasts With Flow Matchingcited by 1
- 2026ShardTensor: Domain Parallelism for Scientific Machine Learningcited by 1
- 2026The physics of AI weather modelscited by 1
- 2026Samudra 2: Scaling Ocean Emulators across Resolutionscited by 1
- 2026Otter Weather: Skillful and Computationally Efficient Medium-Range Weather Forecastingcited by 1
- 2026Bridging short- and medium-range weather forecasting with machine learningcited by 1
- 2025Fast and Flexible Probabilistic Forecasting of Dynamical Systems using Flow Matching and Physical Perturbationcited by 0
- 2025Leveraging Teleconnections with Physics-Informed Graph Attention Networks for Long-Range Extreme Rainfall Forecasting in Thailandcited by 0
- 2026FlowDA: Accurate, Low-Latency Weather Data Assimilation via Flow Matchingcited by 0
- 2026From Complex Dynamics to DynFormer: Rethinking Transformers for PDEscited by 0
- 2026The Rise of AI in Weather and Climate Information and its Impact on Global Inequalitycited by 0
- 2026Data-Driven Integration Kernels for Interpretable Nonlocal Operator Learningcited by 0
- 2026Towards Scaling Law Analysis For Spatiotemporal Weather Datacited by 0
- 2026The Perception-Physics Paradox: Probing Scientific Alignment with TC-Benchcited by 0
- 2026Physics-Guided Dual Decoding and Spectral Supervision for Global 3D Hydrometeor Predictioncited by 0
- 2026Fourier Neural Operators with rank-1 lattice points and hyperbolic crosscited by 0
- 2026Reliability of Probabilistic Emulation of Physical Systemscited by 0
- 2026Scaling Storm-Resolving Atmospheric AI Simulation to the Entire Planetcited by 0
- 2026Decision-Aware Training for Sample-Based Generative Modelscited by 0
- 2026Timestep-Conditioned Transformers for Global Weather Forecastingcited by 0
- 2026An adaptive and evolvable deep reinforcement learning framework for weather predictioncited by 0
- 2026Rescene: band-limited stochastic forcing turns a frozen neural weather operator into a climate emulatorcited by 0
- 2026Dandelion: A Spherical Flower for Neural Simulation of Planetary Dynamicscited by 0
- 2026Diffusion Distillation for Efficient Weather Ensemblescited by 0
- 2026Improving global precipitation forecasts with an AI weather model trained on satellite observationscited by 0
- 20264D Parallelism Unlocks Exascale Bayesian Neural Networks for High-Fidelity Atmospheric Modelingcited by 0
- 2026Butterfly Effect and the Kinetic Energy Cascade in Probabilistic Machine Learning Weather Prediction Modelscited by 0
50 most cited of 56 All 56 (JSON)
- 2026Artificial intelligence pathways from weather to climate7 Oct 2026
- 2026Varda-single-1.0: deterministic data-driven weather forecasting at 1 km resolution over Switzerland's complex topography1 Oct 2026
- 2026A library for differentiable signal processing and machine learning on the sphere30 Sep 2026
- 2026Beyond Simulation: Retain-and-Repair Neural Operators for Real-World Adaptation30 Sep 2026
- 2026Proper Scoring Rule-based Diffusion for Probabilistic Weather Forecasting29 Sep 2026
- 2026Staying on the Attractor: Supervising Neural Surrogates of 3D Turbulence Where They Leave It26 Sep 2026
- 2026Butterfly Effect and the Kinetic Energy Cascade in Probabilistic Machine Learning Weather Prediction Models16 Sep 2026
- 20264D Parallelism Unlocks Exascale Bayesian Neural Networks for High-Fidelity Atmospheric Modeling11 Sep 2026
- 2026Improving global precipitation forecasts with an AI weather model trained on satellite observations2 Sep 2026
- 2026Diffusion Distillation for Efficient Weather Ensembles27 Aug 2026
- 2026Dandelion: A Spherical Flower for Neural Simulation of Planetary Dynamics27 Aug 2026
- 2026Bridging short- and medium-range weather forecasting with machine learning27 Aug 2026
38 more
- 2026Timestep-Conditioned Transformers for Global Weather Forecasting6 Aug 2026
- 2026Rescene: band-limited stochastic forcing turns a frozen neural weather operator into a climate emulator30 Jul 2026
- 2026From Observation to Insight: Mechanistic World Models and the Quest for Autonomous Discovery14 Jul 2026
- 2026An adaptive and evolvable deep reinforcement learning framework for weather prediction7 Jul 2026
- 2026Decision-Aware Training for Sample-Based Generative Models1 Jul 2026
- 2026Scaling Storm-Resolving Atmospheric AI Simulation to the Entire Planet30 Jun 2026
- 2026Otter Weather: Skillful and Computationally Efficient Medium-Range Weather Forecasting24 Jun 2026
- 2026Reliability of Probabilistic Emulation of Physical Systems11 Jun 2026
- 2026Fourier Neural Operators with rank-1 lattice points and hyperbolic cross7 Jun 2026
- 2026Physics-Guided Dual Decoding and Spectral Supervision for Global 3D Hydrometeor Prediction7 Jun 2026
- 2026Samudra 2: Scaling Ocean Emulators across Resolutions24 May 2026
- 2026The Perception-Physics Paradox: Probing Scientific Alignment with TC-Bench23 May 2026
- 2026The physics of AI weather models22 May 2026
- 2026ShardTensor: Domain Parallelism for Scientific Machine Learning11 May 2026
- 2026One Operator for Many Densities: Amortized Approximation of Conditioning by Neural Operators7 May 2026
- 2026Earth System Foundation Model (ESFM): A unified framework for heterogeneous data integration and forecasting20 Apr 2026
- 2026U-Cast: A Surprisingly Simple and Efficient Frontier Probabilistic AI Weather Forecaster10 Apr 2026
- 2026(Sparse) Attention to the Details: Preserving Spectral Fidelity in ML-based Weather Forecasting Models6 Apr 2026
- 2026Towards Scaling Law Analysis For Spatiotemporal Weather Data6 Apr 2026
- 2026Super-Resolving Coarse-Resolution Weather Forecasts With Flow Matching1 Apr 2026
- 2026Sonny: Breaking the Compute Wall in Medium-Range Weather Forecasting22 Mar 2026
- 2026Parallelised Differentiable Straightest Geodesics for 3D Meshes16 Mar 2026
- 2026Data-Driven Integration Kernels for Interpretable Nonlocal Operator Learning11 Mar 2026
- 2026The Rise of AI in Weather and Climate Information and its Impact on Global Inequality5 Mar 2026
- 2026From Complex Dynamics to DynFormer: Rethinking Transformers for PDEs3 Mar 2026
- 2026Probabilistic Retrofitting of Learned Simulators2 Mar 2026
- 2026Examining Fast Radiatively Driven Responses Using Machine-Learning Weather Emulators17 Feb 2026
- 2026SnareNet: Flexible Repair Layers for Neural Networks with Hard Constraints10 Feb 2026
- 2026FlowDA: Accurate, Low-Latency Weather Data Assimilation via Flow Matching6 Feb 2026
- 2026Multi-Scale Wavelet Transformers for Operator Learning of Dynamical Systems1 Feb 2026
- 2026Demystifying Data-Driven Probabilistic Medium-Range Weather Forecasting26 Jan 2026
- 2026Probabilistic Transformers for Joint Modeling of Global Weather Dynamics and Decision-Centric Variables7 Jan 2026
- 2025Long-Range Distillation: Distilling 10,000 Years of Simulated Climate into Long Timestep AI Weather Models28 Dec 2025
- 2025Field-Space Attention for Structure-Preserving Earth System Transformers23 Dec 2025
- 2025Controllable Probabilistic Forecasting with Stochastic Decomposition Layers21 Dec 2025
- 2025Forecast Skill Is Not Decision Skill: Evidence from Weather-Dependent Decision Tasks16 Dec 2025
- 2025Generative Urban Flow Modeling: From Geometry to Airflow with Graph Diffusion9 Dec 2025
- 2025High-Resolution Probabilistic Data-Driven Weather Modeling with a Stretched-Grid28 Nov 2025
50 newest of 56 All 56 (JSON)
- 2026Super-Resolving Coarse-Resolution Weather Forecasts With Flow Matchingcited by 1
- 2025Fast and Flexible Probabilistic Forecasting of Dynamical Systems using Flow Matching and Physical Perturbationcited by 0
- 2026FlowDA: Accurate, Low-Latency Weather Data Assimilation via Flow Matchingcited by 0
- 2026Reliability of Probabilistic Emulation of Physical Systemscited by 0
- 2026Diffusion Distillation for Efficient Weather Ensemblescited by 0
- 2026Diffusion Distillation for Efficient Weather Ensembles27 Aug 2026
- 2026Reliability of Probabilistic Emulation of Physical Systems11 Jun 2026
- 2026Super-Resolving Coarse-Resolution Weather Forecasts With Flow Matching1 Apr 2026
- 2026FlowDA: Accurate, Low-Latency Weather Data Assimilation via Flow Matching6 Feb 2026
- 2025Fast and Flexible Probabilistic Forecasting of Dynamical Systems using Flow Matching and Physical Perturbation1 Aug 2025
- 2026Demystifying Data-Driven Probabilistic Medium-Range Weather Forecastingcited by 12
- 2026U-Cast: A Surprisingly Simple and Efficient Frontier Probabilistic AI Weather Forecastercited by 10
- 2025High-Resolution Probabilistic Data-Driven Weather Modeling with a Stretched-Gridcited by 7
- 2026Earth System Foundation Model (ESFM): A unified framework for heterogeneous data integration and forecastingcited by 6
- 2026Probabilistic Retrofitting of Learned Simulatorscited by 5
- 2025FastNet: Improving the physical consistency of machine-learning weather prediction models through loss function designcited by 4
- 2026(Sparse) Attention to the Details: Preserving Spectral Fidelity in ML-based Weather Forecasting Modelscited by 4
- 2025Forecast Skill Is Not Decision Skill: Evidence from Weather-Dependent Decision Taskscited by 3
- 2025Controllable Probabilistic Forecasting with Stochastic Decomposition Layerscited by 3
- 2025MoWE : A Mixture of Weather Expertscited by 2
- 2025Forecasting the Future with Yesterday's Climate: Temperature Bias in AI Weather and Climate Modelscited by 2
- 2025Generative Urban Flow Modeling: From Geometry to Airflow with Graph Diffusioncited by 2
12 most cited of 50 All 50 (JSON)
- 2026Artificial intelligence pathways from weather to climate7 Oct 2026
- 2026Varda-single-1.0: deterministic data-driven weather forecasting at 1 km resolution over Switzerland's complex topography1 Oct 2026
- 2026A library for differentiable signal processing and machine learning on the sphere30 Sep 2026
- 2026Beyond Simulation: Retain-and-Repair Neural Operators for Real-World Adaptation30 Sep 2026
- 2026Proper Scoring Rule-based Diffusion for Probabilistic Weather Forecasting29 Sep 2026
- 2026Staying on the Attractor: Supervising Neural Surrogates of 3D Turbulence Where They Leave It26 Sep 2026
- 2026Butterfly Effect and the Kinetic Energy Cascade in Probabilistic Machine Learning Weather Prediction Models16 Sep 2026
- 20264D Parallelism Unlocks Exascale Bayesian Neural Networks for High-Fidelity Atmospheric Modeling11 Sep 2026
- 2026Improving global precipitation forecasts with an AI weather model trained on satellite observations2 Sep 2026
- 2026Dandelion: A Spherical Flower for Neural Simulation of Planetary Dynamics27 Aug 2026
- 2026Bridging short- and medium-range weather forecasting with machine learning27 Aug 2026
- 2026Timestep-Conditioned Transformers for Global Weather Forecasting6 Aug 2026
12 newest of 50 All 50 (JSON)