mlsanityData to 14 Oct 2026

MetMamba: Regional Weather Forecasting with Spatial-Temporal Mamba Model

arXiv 2408.06400 ↗First posted 12 Aug 2024physics.ao-ph cs.LGcited by 5

On the map: State-space sequence models (S4, Mamba) → Time series forecasting with SSMs

Abstract (arXiv)

Deep Learning based Weather Prediction (DLWP) models have been improving rapidly over the last few years, surpassing state of the art numerical weather forecasts by significant margins. While much of the optimization effort is focused on training curriculum to extend forecast range in the global context, two aspects remains less explored: limited area modeling and better backbones for weather forecasting. We show in this paper that MetMamba, a DLWP model built on a state-of-the-art state-space model, Mamba, offers notable performance gains and unique advantages over other popular backbones using traditional attention mechanisms and neural operators. We also demonstrate the feasibility of deep learning based limited area modeling via coupled training with a global host model.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Time series forecasting with SSMs, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 22 of its 34 references that are in the map. First posted on arXiv 12 Aug 2024.

Builds on

22 of 34 references.

References · 22

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  4. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  5. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  6. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  7. 2020Linformer: Self-Attention with Linear Complexitycited by 1,474
  8. 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,336
  9. 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,228
  10. 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,056
  11. 2021CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classificationcited by 806
  12. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
10 more
  1. 2023ClimaX: A foundation model for weather and climatecited by 337
  2. 2022GraphCast: Learning skillful medium-range global weather forecastingcited by 267
  3. 2021Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformerscited by 248
  4. 2023FuXi: A cascade machine learning forecasting system for 15-day global weather forecastcited by 241
  5. 2023Spherical Fourier Neural Operators: Learning Stable Dynamics on the Spherecited by 233
  6. 2023FengWu: Pushing the Skillful Global Medium-range Weather Forecast beyond 10 Days Leadcited by 175
  7. 2022Pangu-Weather: A 3D High-Resolution Model for Fast and Accurate Global Weather Forecastcited by 166
  8. 2023Scaling transformer neural networks for skillful and reliable medium-range weather forecastingcited by 110
  9. 2023Koopman neural operator as a mesh-free solver of non-linear partial differential equationscited by 29
  10. 2023Graph-based Neural Weather Prediction for Limited Area Modelingcited by 22

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 2.

5 papers.

  1. 2025Deep Learning and Foundation Models for Weather Prediction: A Surveycited by 16
  2. 2025IndiaWeatherBench: A Dataset and Benchmark for Data-Driven Regional Weather Forecasting over Indiacited by 1
  3. 2025CNCast: Leveraging 3D Swin Transformer and DiT for Enhanced Regional Weather Forecastingcited by 0
  4. 2026Skillful Kilometer-Scale Regional Weather Forecasting via Global and Regional Couplingcited by 0
  5. 2026Accurate, Efficient, and Explainable Deep Learning Approaches for Environmental Science Problemscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025WSSM: Geographic-enhanced hierarchical state-space model for global station weather forecast
  2. 2024Integration of Mamba and Transformer -- MAT for Long-Short Range Time Series Forecasting with Application to Weather Dynamics
  3. 2025RiverMamba: A State Space Model for Global River Discharge and Flood Forecasting
  4. 2024MambaDS: Near-Surface Meteorological Field Downscaling with Topography Constrained Selective State Space Modeling
  5. 2025CRPS-LAM: Probabilistic Regional Weather Forecasting with Continuous Ranked Probability Score
  6. 2026MambaRain: Multi-Scale Mamba-Attention Framework for 0-3 Hour Precipitation Nowcasting
  7. 2024Bi-Mamba+: Bidirectional Mamba for Time Series Forecasting
  8. 2024Weather Prediction with Diffusion Guided by Realistic Forecast Processes