mlsanityData to 14 Oct 2026

Extreme Precipitation Nowcasting using Transformer-based Generative Models

arXiv 2403.03929 ↗First posted 6 Mar 2024cs.LG cs.AIcited by 6

Not on the map. Why?

Abstract (arXiv)

This paper presents an innovative approach to extreme precipitation nowcasting by employing Transformer-based generative models, namely NowcastingGPT with Extreme Value Loss (EVL) regularization. Leveraging a comprehensive dataset from the Royal Netherlands Meteorological Institute (KNMI), our study focuses on predicting short-term precipitation with high accuracy. We introduce a novel method for computing EVL without assuming fixed extreme representations, addressing the limitations of current models in capturing extreme weather events. We present both qualitative and quantitative analyses, demonstrating the superior performance of the proposed NowcastingGPT-EVL in generating accurate precipitation forecasts, especially when dealing with extreme precipitation events. The code is available at urlhttps://github.com/Cmeo97/NowcastingGPT.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 13 of its 32 references that are in the map. First posted on arXiv 6 Mar 2024.

Builds on

13 of 32 references.

References · 13

  1. 2017Attention Is All You Needcited by 60,361
  2. 2017Neural Discrete Representation Learningcited by 4,712
  3. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  4. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,436
  5. 2022MaskGIT: Masked Generative Image Transformercited by 1,099
  6. 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 658
  7. 2021Skillful Precipitation Nowcasting using Deep Generative Models of Radarcited by 311
  8. 2021N"UWA: Visual Synthesis Pre-training for Neural visUal World creAtioncited by 253
  9. 2020SmaAt-UNet: Precipitation Nowcasting using a Small Attention-UNet Architecturecited by 71
  10. 2022Temporally Consistent Transformers for Video Generationcited by 44
  11. 2022AA-TransUNet: Attention Augmented TransUNet For Nowcasting Taskscited by 22
  12. 2020A review of radar-based nowcasting of precipitation and applicable machine learning techniquescited by 19
1 more
  1. 2021MS-nowcasting: Operational Precipitation Nowcasting with Convolutional LSTMs at Microsoft Weathercited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 2; 2025: 3; 2026: 1.

6 papers.

  1. 2025Deep Learning and Foundation Models for Weather Prediction: A Surveycited by 16
  2. 2024Precipitation Nowcasting Using Physics Informed Discriminator Generative Modelscited by 7
  3. 2024Masked Generative Priors Improve World Models Sequence Modelling Capabilitiescited by 7
  4. 2025BlockGPT: Spatio-Temporal Modelling of Rainfall via Frame-Level Autoregressioncited by 1
  5. 2026PixelFlowCast: Latent-Free Precipitation Nowcasting via Pixel Mean Flowscited by 1
  6. 2025Machine learning in an expectation-maximisation framework for nowcastingcited by 0