RainAI -- Precipitation Nowcasting from Satellite Data
Not on the map. Why?
Abstract (arXiv)
This paper presents a solution to the Weather4Cast 2023 competition, where the goal is to forecast high-resolution precipitation with an 8-hour lead time using lower-resolution satellite radiance images. We propose a simple, yet effective method for spatiotemporal feature learning using a 2D U-Net model, that outperforms the official 3D U-Net baseline in both performance and efficiency. We place emphasis on refining the dataset, through importance sampling and dataset preparation, and show that such techniques have a significant impact on performance. We further study an alternative cross-entropy loss function that improves performance over the standard mean squared error loss, while also enabling models to produce probabilistic outputs. Additional techniques are explored regarding the generation of predictions at different lead times, specifically through Conditioning Lead Time. Lastly, to generate high-resolution forecasts, we evaluate standard and learned upsampling methods. The code and trained parameters are available at https://github.com/rafapablos/w4c23-rainai.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 23 of its 36 references that are in the map. First posted on arXiv 30 Nov 2023.
Builds on
23 of 36 references.
References · 23
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,552
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,436
- 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,435
- 2021Video Swin Transformercited by 1,091
- 2022MaxViT: Multi-Axis Vision Transformercited by 476
- 2021Skillful Precipitation Nowcasting using Deep Generative Models of Radarcited by 311
- 2020Disentangling Physical Dynamics from Unknown Factors for Unsupervised Video Predictioncited by 195
- 2017Deep Learning for Precipitation Nowcasting: A Benchmark and A New Modelcited by 182
11 more
- 2018Recurrent Residual Convolutional Neural Network based on U-Net (R2U-Net) for Medical Image Segmentationcited by 180
- 2022Pangu-Weather: A 3D High-Resolution Model for Fast and Accurate Global Weather Forecastcited by 166
- 2022Earthformer: Exploring Space-Time Transformers for Earth System Forecastingcited by 152
- 2020MetNet: A Neural Weather Model for Precipitation Forecastingcited by 131
- 2023Deep Learning for Day Forecasts from Sparse Observationscited by 72
- 2020SmaAt-UNet: Precipitation Nowcasting using a Small Attention-UNet Architecturecited by 71
- 2018Fully Dense UNet for 2D Sparse Photoacoustic Tomography Artifact Removalcited by 57
- 2019Machine Learning for Precipitation Nowcasting from Radar Imagescited by 56
- 2021Broad-UNet: Multi-scale feature learning for nowcasting taskscited by 25
- 2021Skillful Twelve Hour Precipitation Forecasts using Large Context Neural Networkscited by 20
- 2022WeatherFusionNet: Predicting Precipitation from Satellite Datacited by 6
Built on by
Citing papers per year: 2025: 1.
1 paper.