mlsanityData to 7 Oct 2026

PA-Net: Precipitation-Adaptive Mixture-of-Experts for Long-Tail Rainfall Nowcasting

arXiv 2603.13818 ↗First posted 14 Mar 2026cs.AI cs.CV cs.LGcited by 0

On the map: Mixture-of-experts → MoE for time series and graphs

Abstract (arXiv)

Precipitation nowcasting is vital for flood warning, agricultural management, and emergency response, yet two bottlenecks persist: the prohibitive cost of modeling million-scale spatiotemporal tokens from multi-variate atmospheric fields, and the extreme long-tailed rainfall distribution where heavy-to-torrential events -- those of greatest societal impact -- constitute fewer than 0.1% of all samples. We propose the Precipitation-Adaptive Network (PA-Net), a Transformer framework whose computational budget is explicitly governed by rainfall intensity. Its core component, Precipitation-Adaptive MoE (PA-MoE), dynamically scales the number of activated experts per token according to local precipitation magnitude, channeling richer representational capacity toward the rare yet critical heavy-rainfall tail. A Dual-Axis Compressed Latent Attention mechanism factorizes spatiotemporal attention with convolutional reduction to manage massive context lengths, while an intensity-aware training protocol progressively amplifies learning signals from extreme-rainfall samples. Experiment on ERA5 demonstrate consistent improvements over state-of-the-art baselines, with particularly significant gains in heavy-rain and rainstorm regimes.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in MoE for time series and graphs, one of 12 directions in Mixture-of-experts. Builds on 14 of its 22 references that are in the map. First posted on arXiv 14 Mar 2026.

Builds on

14 of 22 references.

References · 14

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  4. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  5. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
  6. 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
  7. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
  8. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
  9. 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,215
  10. 2021Deep Long-Tailed Learning: A Surveycited by 416
  11. 2021Skillful Precipitation Nowcasting using Deep Generative Models of Radarcited by 308
  12. 2017Deep Learning for Precipitation Nowcasting: A Benchmark and A New Modelcited by 180
2 more
  1. 2022Earthformer: Exploring Space-Time Transformers for Earth System Forecastingcited by 146
  2. 2021MotionRNN: A Flexible Model for Video Prediction with Spacetime-Varying Motionscited by 54

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025RainDiff: End-to-end Precipitation Nowcasting Via Token-wise Attention Diffusion
  2. 2024DuoCast: Duo-Probabilistic Diffusion for Precipitation Nowcasting
  3. 2025FlowCast: Advancing Precipitation Nowcasting with Conditional Flow Matching
  4. 2026NowcastDiT: Diffusion Transformers are Effective Precipitation Nowcasters
  5. 2024Precipitation Nowcasting Using Diffusion Transformer with Causal Attention
  6. 2024PostCast: Generalizable Postprocessing for Precipitation Nowcasting via Unsupervised Blurriness Modeling
  7. 2025SynCast: Synergizing Contradictions in Precipitation Nowcasting via Diffusion Sequential Preference Optimization
  8. 2025Nowcast3D: Reliable precipitation nowcasting via gray-box learning