mlsanityData to 14 Oct 2026

Learning to Advect: A Neural Semi-Lagrangian Architecture for Weather Forecasting

arXiv 2601.21151 ↗First posted 29 Jan 2026cs.LG physics.ao-phcited by 4

Not on the map. Why?

Abstract (arXiv)

Machine-learning approaches to weather forecasting often employ a monolithic architecture in which distinct physical mechanisms, such as advection, diffusive mixing, thermodynamic processes, and forcing, are represented implicitly within a single large neural network. This is particularly problematic for advection, where long-range transport typically requires expensive global interaction mechanisms or deep stacks of local convolutional layers. To address this limitation, we introduce a physics-inspired neural architecture that decomposes latent-state evolution into dedicated advection, diffusion, and reaction operators. Its central component is a Neural Semi-Lagrangian operator that performs trajectory-based transport via differentiable interpolation on the sphere, allowing the network to learn both a compressed set of latent modes to be transported and their characteristic trajectories. The atmospheric state is projected into latent space and spatially coarsened to a processor grid, where advection, diffusion, and reaction operators jointly evolve the representation. Diffusive mixing and unresolved dissipation are represented by depthwise-separable spatial mixing, while local source terms and vertical interactions are handled through pointwise channel interactions. We evaluate a reference implementation of the proposed architecture on global weather forecasting. Evaluated on ERA5 benchmarks, the reference model achieves competitive deterministic forecast skill, with particularly strong performance at short to medium lead times, while preserving improved spectral fidelity and forecast activity relative to several leading data-driven baselines.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 19 of its 47 references that are in the map. First posted on arXiv 29 Jan 2026.

Builds on

19 of 47 references.

References · 19

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  2. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
  3. 2016Gaussian Error Linear Units (GELUs)cited by 3,502
  4. 2024MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategiescited by 723
  5. 2023FuXi: A cascade machine learning forecasting system for 15-day global weather forecastcited by 241
  6. 2023Neural General Circulation Models for Weather and Climatecited by 239
  7. 2023WeatherBench 2: A benchmark for the next generation of data-driven global weather modelscited by 236
  8. 2023Spherical Fourier Neural Operators: Learning Stable Dynamics on the Spherecited by 233
  9. 2022Forecasting Global Weather with Graph Neural Networkscited by 168
  10. 2024ClimODE: Climate and Weather Forecasting with Physics-informed Neural ODEscited by 82
  11. 2025Dion: Distributed Orthonormalized Updatescited by 68
  12. 2024Prithvi WxC: Foundation Model for Weather and Climatecited by 31
7 more
  1. 2023SEEDS: Emulation of Weather Forecast Ensembles with Diffusion Modelscited by 28
  2. 2025Fixing the Double Penalty in Data-Driven Weather Forecasting Through a Modified Spherical Harmonic Loss Functioncited by 28
  3. 2024ExtremeCast: Boosting Extreme Value Prediction for Global Weather Forecastcited by 19
  4. 2025Numerical models outperform AI weather forecasts of record-breaking extremescited by 14
  5. 2024KARINA: An Efficient Deep Learning Model for Global Weather Forecastcited by 9
  6. 2025Utilizing Strategic Pre-training to Reduce Overfitting: Baguan -- A Pre-trained Weather Forecasting Modelcited by 7
  7. 2024Advection Augmented Convolutional Neural Networkscited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.