PA-Net: Precipitation-Adaptive Mixture-of-Experts for Long-Tail Rainfall Nowcasting
On the map: Mixture-of-experts → MoE for time series and graphs
Abstract (arXiv)
Precipitation nowcasting is vital for flood warning, agricultural management, and emergency response, yet two bottlenecks persist: the prohibitive cost of modeling million-scale spatiotemporal tokens from multi-variate atmospheric fields, and the extreme long-tailed rainfall distribution where heavy-to-torrential events -- those of greatest societal impact -- constitute fewer than 0.1% of all samples. We propose the Precipitation-Adaptive Network (PA-Net), a Transformer framework whose computational budget is explicitly governed by rainfall intensity. Its core component, Precipitation-Adaptive MoE (PA-MoE), dynamically scales the number of activated experts per token according to local precipitation magnitude, channeling richer representational capacity toward the rare yet critical heavy-rainfall tail. A Dual-Axis Compressed Latent Attention mechanism factorizes spatiotemporal attention with convolutional reduction to manage massive context lengths, while an intensity-aware training protocol progressively amplifies learning signals from extreme-rainfall samples. Experiment on ERA5 demonstrate consistent improvements over state-of-the-art baselines, with particularly significant gains in heavy-rain and rainstorm regimes.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in MoE for time series and graphs, one of 12 directions in Mixture-of-experts. Builds on 14 of its 22 references that are in the map. First posted on arXiv 14 Mar 2026.
Builds on
14 of 22 references.
References · 14
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
- 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
- 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,215
- 2021Deep Long-Tailed Learning: A Surveycited by 416
- 2021Skillful Precipitation Nowcasting using Deep Generative Models of Radarcited by 308
- 2017Deep Learning for Precipitation Nowcasting: A Benchmark and A New Modelcited by 180
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025RainDiff: End-to-end Precipitation Nowcasting Via Token-wise Attention Diffusion
- 2024DuoCast: Duo-Probabilistic Diffusion for Precipitation Nowcasting
- 2025FlowCast: Advancing Precipitation Nowcasting with Conditional Flow Matching
- 2026NowcastDiT: Diffusion Transformers are Effective Precipitation Nowcasters
- 2024Precipitation Nowcasting Using Diffusion Transformer with Causal Attention
- 2024PostCast: Generalizable Postprocessing for Precipitation Nowcasting via Unsupervised Blurriness Modeling
- 2025SynCast: Synergizing Contradictions in Precipitation Nowcasting via Diffusion Sequential Preference Optimization
- 2025Nowcast3D: Reliable precipitation nowcasting via gray-box learning