# CloudCast -- Total Cloud Cover Nowcasting with Machine Learning

arXiv: https://arxiv.org/abs/2410.21329 · HTML: https://mlsanity.com/paper/2410.21329/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- Builds on 12 of its 40 references that are in the map.
- First posted on arXiv 27 Oct 2024.

## Builds on (most cited first, 12 of 12)

- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting](https://mlsanity.com/paper/1506.04214/) (2015)
- [PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learning](https://mlsanity.com/paper/2103.09504/) (2021)
- [U-Net and its variants for medical image segmentation: theory and applications](https://mlsanity.com/paper/2011.01118/) (2020)
- [MetNet: A Neural Weather Model for Precipitation Forecasting](https://mlsanity.com/paper/2003.12140/) (2020)
- [Training Vision Transformers with Only 2040 Images](https://mlsanity.com/paper/2201.10728/) (2022)
- [Statistical Properties of the log-cosh Loss Function Used in Machine Learning](https://mlsanity.com/paper/2208.04564/) (2022)
- [CloudCast: A Satellite-Based Dataset and Baseline for Forecasting Clouds](https://mlsanity.com/paper/2007.07978/) (2020)
- [Seamless lightning nowcasting with recurrent-convolutional deep learning](https://mlsanity.com/paper/2203.10114/) (2022)
- [Cloud Cover Nowcasting with Deep Learning](https://mlsanity.com/paper/2009.11577/) (2020)
- [Physically Explainable Deep Learning for Convective Initiation Nowcasting Using GOES-16 Satellite Observations](https://mlsanity.com/paper/2310.16015/) (2023)

## Built on by (most cited first, 3 of 3)

- [Distributed solar generation forecasting using attention-based deep neural networks for cloud movement prediction](https://mlsanity.com/paper/2411.10921/) (2024)
- [Segregation and Context Aggregation Network for Real-time Cloud Segmentation](https://mlsanity.com/paper/2504.14178/) (2025)
- [From Nowcasting to Forecasting: Adapting a Reanalysis-Trained](https://mlsanity.com/paper/2609.03763/) (2026)

## Abstract (arXiv)

Cloud cover plays a critical role in weather prediction and impacts several sectors, including agriculture, solar power generation, and aviation. Despite advancements in numerical weather prediction (NWP) models, forecasting total cloud cover remains challenging due to the small-scale nature of cloud formation processes. In this study, we introduce CloudCast, a convolutional neural network (CNN) based on the U-Net architecture, designed to predict total cloud cover (TCC) up to five hours ahead. Trained on five years of satellite data, CloudCast significantly outperforms traditional NWP models and optical flow methods. Compared to a reference NWP model, CloudCast achieves a 24% lower mean absolute error and reduces multi-category prediction errors by 46%. The model demonstrates strong performance, particularly in capturing the large-scale structure of cloud cover in the first few forecast hours, though later predictions are subject to blurring and underestimation of cloud formation. An ablation study identified the optimal input features and loss functions, with MAE-based models performing the best. CloudCast has been integrated into the Finnish Meteorological Institute's operational nowcasting system, where it improves cloud cover forecasts used by public and private sector clients. While CloudCast is limited by a relatively short skillful lead time of about three hours, future work aims to extend this through more complex network architectures and higher-resolution data. CloudCast code is available at https://github.com/fmidev/cloudcast.
