mlsanityData to 14 Oct 2026

Online Reinforcement Learning in the Met Office Unified Model through Distributed Model-Agent Coupling

arXiv 2609.02566 ↗First posted 2 Sep 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Machine-learnt corrections can complement numerical weather prediction provided that they operate stably within an evolving numerical model. In this study, we couple the Met Office (UKMO) Unified Model (UM) with distributed reinforcement-learning agents through rank-local tensors. A column-aware deep deterministic policy gradient (DDPG) actor uses local vertical structure together with full-column context to apply bounded corrections to potential temperature and horizontal wind. During training, we perform ten nudged 6-hr 12-min forecasts, with nudging towards the UKMO operational analysis providing an immediate counterfactual target from which the policy learns. The resulting actor is then frozen and applied to a non-nudged forecast without access to analysis inputs or further weight updates. Relative to a matched non-nudged native forecast at +6 h, the corrected forecast reduces global latitude-weighted MAE by 2.85% for Z500, 2.16% for MSLP, 5.16% for T500 and 2.27% for T_1.5textrmm, with an observed 3.57% wall-time overhead compared to native execution. Even though training and inference share the same initialisation, this single-case experiment demonstrates significant promise and feasibility, laying the groundwork for RL-based bias correction and parametrisations within operational systems.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 17 references that are in the map. First posted on arXiv 2 Sep 2026.

Builds on

7 of 17 references.

References · 7

  1. 2015Continuous control with deep reinforcement learningcited by 3,407
  2. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
  3. 2023Neural General Circulation Models for Weather and Climatecited by 239
  4. 2018Deep learning to represent sub-grid processes in climate modelscited by 156
  5. 2026Earth System Foundation Model (ESFM): A unified framework for heterogeneous data integration and forecastingcited by 8
  6. 2021Using Machine Learning at Scale in HPC Simulations with SmartSim: An Application to Ocean Climate Modelingcited by 7
  7. 2026Replacing Tunable Parameters in Weather and Climate Models with State-Dependent Functions using Reinforcement Learningcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026An adaptive and evolvable deep reinforcement learning framework for weather prediction
  2. 2025FedRAIN-Lite: Federated Reinforcement Algorithms for Improving Idealised Numerical Weather and Climate Models
  3. 2024RAIN: Reinforcement Algorithms for Improving Numerical Weather and Climate Models
  4. 2025Climate Surrogates for Scalable Multi-Agent Reinforcement Learning: A Case Study with CICERO-SCM
  5. 2026Information-Guided Safe Reinforcement Learning for Autonomous Gas Source Localization using sUAS
  6. 2024Data Assimilation in Chaotic Systems Using Deep Reinforcement Learning
  7. 2026Inference Time Policy Optimization for Offline RL with Differentiable World Models
  8. 2025Forecasting in Offline Reinforcement Learning for Non-stationary Environments