mlsanityData to 14 Oct 2026

Self-Supervised Pre-Training for Precipitation Post-Processor

arXiv 2310.20187 ↗First posted 31 Oct 2023cs.LG cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Obtaining a sufficient forecast lead time for local precipitation is essential in preventing hazardous weather events. Global warming-induced climate change increases the challenge of accurately predicting severe precipitation events, such as heavy rainfall. In this paper, we propose a deep learning-based precipitation post-processor for numerical weather prediction (NWP) models. The precipitation post-processor consists of (i) employing self-supervised pre-training, where the parameters of the encoder are pre-trained on the reconstruction of the masked variables of the atmospheric physics domain; and (ii) conducting transfer learning on precipitation segmentation tasks (the target domain) from the pre-trained encoder. In addition, we introduced a heuristic labeling approach to effectively train class-imbalanced datasets. Our experiments on precipitation correction for regional NWP show that the proposed method outperforms other approaches.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 18 of its 26 references that are in the map. First posted on arXiv 31 Oct 2023.

Builds on

18 of 26 references.

References · 18

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  3. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  4. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
  5. 2015Learning Deep Features for Discriminative Localizationcited by 2,436
  6. 2017Accurate, Large Minibatch SGD: Training ImageNet in 1 Hourcited by 1,492
  7. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,436
  8. 2018Unified Perceptual Parsing for Scene Understandingcited by 1,271
  9. 2021Multiscale Vision Transformerscited by 897
  10. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
  11. 2022InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutionscited by 482
  12. 2022Masked Autoencoders As Spatiotemporal Learnerscited by 429
6 more
  1. 2017Deep Learning for Precipitation Nowcasting: A Benchmark and A New Modelcited by 182
  2. 2022Forecasting Global Weather with Graph Neural Networkscited by 168
  3. 2019Classification Accuracy Score for Conditional Generative Modelscited by 136
  4. 2020MetNet: A Neural Weather Model for Precipitation Forecastingcited by 131
  5. 2023W-MAE: Pre-trained weather model with masked autoencoder for multi-variable weather forecastingcited by 29
  6. 2022Benchmark Dataset for Precipitation Forecasting by Post-Processing the Numerical Weather Predictioncited by 5

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.