Self-Supervised Learning with Probabilistic Density Labeling for Rainfall Probability Estimation
Not on the map. Why?
Abstract (arXiv)
Numerical weather prediction (NWP) models are fundamental in meteorology for simulating and forecasting the behavior of various atmospheric variables. The accuracy of precipitation forecasts and the acquisition of sufficient lead time are crucial for preventing hazardous weather events. However, the performance of NWP models is limited by the nonlinear and unpredictable patterns of extreme weather phenomena driven by temporal dynamics. In this regard, we propose a Self-Supervised Learning with Probabilistic Density Labeling (SSLPDL) for estimating rainfall probability by post-processing NWP forecasts. Our post-processing method uses self-supervised learning (SSL) with masked modeling for reconstructing atmospheric physics variables, enabling the model to learn the dependency between variables. The pre-trained encoder is then utilized in transfer learning to a precipitation segmentation task. Furthermore, we introduce a straightforward labeling approach based on probability density to address the class imbalance in extreme weather phenomena like heavy rain events. Experimental results show that SSLPDL surpasses other precipitation forecasting models in regional precipitation post-processing and demonstrates competitive performance in extending forecast lead times. Our code is available at https://github.com/joonha425/SSLPDL
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 50 references that are in the map. First posted on arXiv 8 Dec 2024.
Builds on
25 of 50 references.
References · 25
- 2017Attention Is All You Needcited by 60,361
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,436
- 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,322
- 2018Unified Perceptual Parsing for Scene Understandingcited by 1,271
- 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,222
- 2019When Does Label Smoothing Help?cited by 988
- 2021Multiscale Vision Transformerscited by 897
- 2019Decoupling Representation and Classifier for Long-Tailed Recognitioncited by 809
- 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
13 more
- 2018Exploring the Limits of Weakly Supervised Pretrainingcited by 605
- 2022InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutionscited by 482
- 2022Masked Autoencoders As Spatiotemporal Learnerscited by 429
- 2020Long-tailed Recognition by Routing Diverse Distribution-Aware Expertscited by 271
- 2022Forecasting Global Weather with Graph Neural Networkscited by 168
- 2020MetNet: A Neural Weather Model for Precipitation Forecastingcited by 131
- 2021Self-supervised representation learning from 12-lead ECG datacited by 80
- 2023W-MAE: Pre-trained weather model with masked autoencoder for multi-variable weather forecastingcited by 29
- 2023Simplifying Neural Network Training Under Class Imbalancecited by 18
- 2023Leave No Stone Unturned: Mine Extra Knowledge for Imbalanced Facial Expression Recognitioncited by 17
- 2023PostRainBench: A comprehensive benchmark and a new model for precipitation forecastingcited by 8
- 2022PCCT: Progressive Class-Center Triplet Loss for Imbalanced Medical Image Classificationcited by 6
- 2022Benchmark Dataset for Precipitation Forecasting by Post-Processing the Numerical Weather Predictioncited by 5
Built on by
Not cited yet.