mlsanityData to 7 Oct 2026

FourCastNet 3: A geometric approach to probabilistic machine-learning weather forecasting at scale

arXiv 2507.12144 ↗First posted 16 Jul 2025cs.LG physics.ao-phcited by 56

Not on the map. Why?

Abstract (arXiv)

FourCastNet 3 advances global weather modeling by implementing a scalable, geometric machine learning (ML) approach to probabilistic ensemble forecasting. The approach is designed to respect spherical geometry and to accurately model the spatially correlated probabilistic nature of the problem, resulting in stable spectra and realistic dynamics across multiple scales. FourCastNet 3 delivers forecasting accuracy that surpasses leading conventional ensemble models and rivals the best diffusion-based methods, while producing forecasts 8 to 60 times faster than these approaches. In contrast to other ML approaches, FourCastNet 3 demonstrates excellent probabilistic calibration and retains realistic spectra, even at extended lead times of up to 60 days. All of these advances are realized using a purely convolutional neural network architecture tailored for spherical geometry. Scalable and efficient large-scale training on 1024 GPUs and more is enabled by a novel training paradigm for combined model- and data-parallelism, inspired by domain decomposition methods in classical numerical models. Additionally, FourCastNet 3 enables rapid inference on a single GPU, producing a 60-day global forecast at 0.25deg, 6-hourly resolution in under 4 minutes. Its computational efficiency, medium-range probabilistic skill, spectral fidelity, and rollout stability at subseasonal timescales make it a strong candidate for improving meteorological forecasting and early warning systems through large ensemble predictions.

Key facts. Cited by 56 papers in the map (data through 7 Oct 2026). Builds on 30 of its 64 references that are in the map. First posted on arXiv 16 Jul 2025.

Builds on

30 of 64 references.

References · 30

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Scaling Laws for Neural Language Modelscited by 6,411
  3. 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
  4. 2016Gaussian Error Linear Units (GELUs)cited by 3,431
  5. 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,278
  6. 2021Alias-Free Generative Adversarial Networkscited by 1,181
  7. 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
  8. 2021Going deeper with Image Transformerscited by 759
  9. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 748
  10. 2023PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallelcited by 641
  11. 2023FuXi: A cascade machine learning forecasting system for 15-day global weather forecastcited by 237
  12. 2023WeatherBench 2: A benchmark for the next generation of data-driven global weather modelscited by 227
18 more
  1. 2023Spherical Fourier Neural Operators: Learning Stable Dynamics on the Spherecited by 225
  2. 2022FourCastNet: Accelerating Global High-Resolution Weather Forecasting using Adaptive Fourier Neural Operatorscited by 188
  3. 2022Pangu-Weather: A 3D High-Resolution Model for Fast and Accurate Global Weather Forecastcited by 164
  4. 2018Neural networks for post-processing ensemble weather forecastscited by 95
  5. 2021Sub-seasonal forecasting with a large ensemble of deep-learning weather prediction modelscited by 76
  6. 2024Neural Operators with Localized Integral and Differential Kernelscited by 59
  7. 2023ACE: A fast, skillful learned global atmospheric model for climate predictioncited by 53
  8. 2023AtmoRep: A stochastic model of atmosphere dynamics using large scale representation learningcited by 35
  9. 2020Automatic Cross-Replica Sharding of Weight Update in Data-Parallel Trainingcited by 30
  10. 2024LUCIE: A Lightweight Uncoupled ClImate Emulator with long-term stability and physical consistency for O(1000)-member ensemblescited by 30
  11. 2020Efficient Generalized Spherical CNNscited by 29
  12. 2024Continuous Ensemble Weather Forecasting with Diffusion modelscited by 27
  13. 2025Fixing the Double Penalty in Data-Driven Weather Forecasting Through a Modified Spherical Harmonic Loss Functioncited by 27
  14. 2024A Practical Probabilistic Benchmark for AI Weather Modelscited by 25
  15. 2022Scalable and Equivariant Spherical CNNs by Discrete-Continuous (DISCO) Convolutionscited by 23
  16. 2024Huge Ensembles Part II: Properties of a Huge Ensemble of Hindcasts Generated with Spherical Fourier Neural Operatorscited by 12
  17. 2024Exploring the design space of deep-learning-based weather forecasting systemscited by 8
  18. 2025Dynamical errors in machine learning forecastscited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 12; 2026: 44.

56 papers.

Sort:

By area:

  1. 2026Demystifying Data-Driven Probabilistic Medium-Range Weather Forecastingcited by 12
  2. 2026U-Cast: A Surprisingly Simple and Efficient Frontier Probabilistic AI Weather Forecastercited by 10
  3. 2025High-Resolution Probabilistic Data-Driven Weather Modeling with a Stretched-Gridcited by 7
  4. 2026Earth System Foundation Model (ESFM): A unified framework for heterogeneous data integration and forecastingcited by 6
  5. 2026Probabilistic Retrofitting of Learned Simulatorscited by 5
  6. 2025FastNet: Improving the physical consistency of machine-learning weather prediction models through loss function designcited by 4
  7. 2026(Sparse) Attention to the Details: Preserving Spectral Fidelity in ML-based Weather Forecasting Modelscited by 4
  8. 2026From Observation to Insight: Mechanistic World Models and the Quest for Autonomous Discoverycited by 4
  9. 2025Forecast Skill Is Not Decision Skill: Evidence from Weather-Dependent Decision Taskscited by 3
  10. 2025Controllable Probabilistic Forecasting with Stochastic Decomposition Layerscited by 3
  11. 2025MoWE : A Mixture of Weather Expertscited by 2
  12. 2025Forecasting the Future with Yesterday's Climate: Temperature Bias in AI Weather and Climate Modelscited by 2
38 more
  1. 2025Generative Urban Flow Modeling: From Geometry to Airflow with Graph Diffusioncited by 2
  2. 2025Long-Range Distillation: Distilling 10,000 Years of Simulated Climate into Long Timestep AI Weather Modelscited by 2
  3. 2026Parallelised Differentiable Straightest Geodesics for 3D Meshescited by 2
  4. 2026Sonny: Breaking the Compute Wall in Medium-Range Weather Forecastingcited by 2
  5. 2026One Operator for Many Densities: Amortized Approximation of Conditioning by Neural Operatorscited by 2
  6. 2025Crowdsourcing the Frontier: Advancing Hybrid Physics-ML Climate Simulation via a 50,000 Kaggle Competitioncited by 1
  7. 2025Field-Space Attention for Structure-Preserving Earth System Transformerscited by 1
  8. 2026Probabilistic Transformers for Joint Modeling of Global Weather Dynamics and Decision-Centric Variablescited by 1
  9. 2026Multi-Scale Wavelet Transformers for Operator Learning of Dynamical Systemscited by 1
  10. 2026SnareNet: Flexible Repair Layers for Neural Networks with Hard Constraintscited by 1
  11. 2026Examining Fast Radiatively Driven Responses Using Machine-Learning Weather Emulatorscited by 1
  12. 2026Super-Resolving Coarse-Resolution Weather Forecasts With Flow Matchingcited by 1
  13. 2026ShardTensor: Domain Parallelism for Scientific Machine Learningcited by 1
  14. 2026The physics of AI weather modelscited by 1
  15. 2026Samudra 2: Scaling Ocean Emulators across Resolutionscited by 1
  16. 2026Otter Weather: Skillful and Computationally Efficient Medium-Range Weather Forecastingcited by 1
  17. 2026Bridging short- and medium-range weather forecasting with machine learningcited by 1
  18. 2025Fast and Flexible Probabilistic Forecasting of Dynamical Systems using Flow Matching and Physical Perturbationcited by 0
  19. 2025Leveraging Teleconnections with Physics-Informed Graph Attention Networks for Long-Range Extreme Rainfall Forecasting in Thailandcited by 0
  20. 2026FlowDA: Accurate, Low-Latency Weather Data Assimilation via Flow Matchingcited by 0
  21. 2026From Complex Dynamics to DynFormer: Rethinking Transformers for PDEscited by 0
  22. 2026The Rise of AI in Weather and Climate Information and its Impact on Global Inequalitycited by 0
  23. 2026Data-Driven Integration Kernels for Interpretable Nonlocal Operator Learningcited by 0
  24. 2026Towards Scaling Law Analysis For Spatiotemporal Weather Datacited by 0
  25. 2026The Perception-Physics Paradox: Probing Scientific Alignment with TC-Benchcited by 0
  26. 2026Physics-Guided Dual Decoding and Spectral Supervision for Global 3D Hydrometeor Predictioncited by 0
  27. 2026Fourier Neural Operators with rank-1 lattice points and hyperbolic crosscited by 0
  28. 2026Reliability of Probabilistic Emulation of Physical Systemscited by 0
  29. 2026Scaling Storm-Resolving Atmospheric AI Simulation to the Entire Planetcited by 0
  30. 2026Decision-Aware Training for Sample-Based Generative Modelscited by 0
  31. 2026Timestep-Conditioned Transformers for Global Weather Forecastingcited by 0
  32. 2026An adaptive and evolvable deep reinforcement learning framework for weather predictioncited by 0
  33. 2026Rescene: band-limited stochastic forcing turns a frozen neural weather operator into a climate emulatorcited by 0
  34. 2026Dandelion: A Spherical Flower for Neural Simulation of Planetary Dynamicscited by 0
  35. 2026Diffusion Distillation for Efficient Weather Ensemblescited by 0
  36. 2026Improving global precipitation forecasts with an AI weather model trained on satellite observationscited by 0
  37. 20264D Parallelism Unlocks Exascale Bayesian Neural Networks for High-Fidelity Atmospheric Modelingcited by 0
  38. 2026Butterfly Effect and the Kinetic Energy Cascade in Probabilistic Machine Learning Weather Prediction Modelscited by 0

50 most cited of 56 All 56 (JSON)