A deep learning approach to solar-irradiance forecasting in sky-videos
Not on the map. Why?
Abstract (arXiv)
Ahead-of-time forecasting of incident solar-irradiance on a panel is indicative of expected energy yield and is essential for efficient grid distribution and planning. Traditionally, these forecasts are based on meteorological physics models whose parameters are tuned by coarse-grained radiometric tiles sensed from geo-satellites. This research presents a novel application of deep neural network approach to observe and estimate short-term weather effects from videos. Specifically, we use time-lapsed videos (sky-videos) obtained from upward facing wide-lensed cameras (sky-cameras) to directly estimate and forecast solar irradiance. We introduce and present results on two large publicly available datasets obtained from weather stations in two regions of North America using relatively inexpensive optical hardware. These datasets contain over a million images that span for 1 and 12 years respectively, the largest such collection to our knowledge. Compared to satellite based approaches, the proposed deep learning approach significantly reduces the normalized mean-absolute-percentage error for both nowcasting, i.e. prediction of the solar irradiance at the instance the frame is captured, as well as forecasting, ahead-of-time irradiance prediction for a duration for upto 4 hours.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Jan 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 2; 2023: 1; 2024: 1; 2025: 2; 2026: 1.
10 papers.
- 2021Benchmarking of Deep Learning Irradiance Forecasting Models from Sky Images -- an in-depth Analysiscited by 21
- 2021ECLIPSE : Envisioning CLoud Induced Perturbations in Solar Energycited by 14
- 2021A Moment in the Sun: Solar Nowcasting from Multispectral Satellite Data using Self-Supervised Learningcited by 3
- 2023Sky Imager-Based Forecast of Solar Irradiance Using Machine Learningcited by 3
- 2025Solar Multimodal Transformer: Intraday Solar Irradiance Predictor using Public Cameras and Time Seriescited by 2
- 2022Omnivision forecasting: combining satellite observations with sky images for improved intra-hour solar energy predictionscited by 1
- 2024Precise Forecasting of Sky Images Using Spatial Warpingcited by 1
- 2025SPIRIT: Short-term Prediction of solar IRradIance for zero-shot Transfer learning using Foundation Modelscited by 1
- 2022Tools for Extracting Spatio-Temporal Patterns in Meteorological Image Sequences: From Feature Engineering to Attention-Based Neural Networkscited by 0
- 2026Bidirectional Multimodal Fusion of Sky Images and Time-Series for Solar Forecasting with Large Language Modelscited by 0
- 2026Bidirectional Multimodal Fusion of Sky Images and Time-Series for Solar Forecasting with Large Language Models10 Sep 2026
- 2025Solar Multimodal Transformer: Intraday Solar Irradiance Predictor using Public Cameras and Time Series28 Feb 2025
- 2025SPIRIT: Short-term Prediction of solar IRradIance for zero-shot Transfer learning using Foundation Models14 Feb 2025
- 2024Precise Forecasting of Sky Images Using Spatial Warping18 Sep 2024
- 2023Sky Imager-Based Forecast of Solar Irradiance Using Machine Learning26 Oct 2023
- 2022Tools for Extracting Spatio-Temporal Patterns in Meteorological Image Sequences: From Feature Engineering to Attention-Based Neural Networks22 Oct 2022
- 2022Omnivision forecasting: combining satellite observations with sky images for improved intra-hour solar energy predictions7 Jun 2022
- 2021A Moment in the Sun: Solar Nowcasting from Multispectral Satellite Data using Self-Supervised Learning28 Dec 2021
- 2021ECLIPSE : Envisioning CLoud Induced Perturbations in Solar Energy26 Apr 2021
- 2021Benchmarking of Deep Learning Irradiance Forecasting Models from Sky Images -- an in-depth Analysis1 Feb 2021