Ensemble learning for uncertainty estimation with application to the correction of satellite precipitation products
Not on the map. Why?
Abstract (arXiv)
Predictions in the form of probability distributions are crucial for effective decision-making. Quantile regression enables such predictions within spatial prediction settings that aim to create improved precipitation datasets by merging remote sensing and gauge data. However, ensemble learning of quantile regression algorithms remains unexplored in this context and, at the same time, it has not been substantially developed so far in the broader machine learning research landscape. Here, we introduce nine quantile-based ensemble learners and address the aforementioned gap in precipitation dataset creation by presenting the first application of these learners to large precipitation datasets. We employed a novel feature engineering strategy, which reduces the number of predictors by using distance-weighted satellite precipitation at relevant locations, combined with location elevation. Our ensemble learners include six that are based on stacking ideas and three simple methods (mean, median, best combiner). Each of them combines the following six individual algorithms: quantile regression (QR), quantile regression forests (QRF), generalized random forests (GRF), gradient boosting machines (GBM), light gradient boosting machines (LightGBM), and quantile regression neural networks (QRNN). These algorithms serve as both base learners and combiners within different ensemble learning methods. We evaluated performance against a reference method (i.e., QR) using quantile scoring functions and a large dataset. The latter comprises 15 years of monthly gauge-measured and satellite precipitation in the contiguous United States (CONUS). Ensemble learning with QR and QRNN yielded the best results across the various investigated quantile levels, which range from 0.025 to 0.975, outperforming the reference method by 3.91% to 8.95%...
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 15 of its 67 references that are in the map. First posted on arXiv 14 Mar 2024.
Builds on
15 of 67 references.
References · 15
- 2016Generalized Random Forestscited by 309
- 2017Using stacking to average Bayesian predictive distributionscited by 39
- 2022Forecast combinations: an over 50-year reviewcited by 34
- 2021Regression Diagnostics meets Forecast Evaluation: Conditional Calibration, Reliability Diagrams, and Coefficient of Determinationcited by 31
- 2022A review of predictive uncertainty estimation with machine learningcited by 29
- 2014The Evolution of Boosting Algorithms - From Machine Learning to Statistical Modellingcited by 18
- 2022A review of machine learning concepts and methods for addressing challenges in probabilistic hydrological post-processing and forecastingcited by 12
- 2022Model Comparison and Calibration Assessment: User Guide for Consistent Scoring Functions in Machine Learning and Actuarial Practicecited by 11
- 2019Forecast Evaluation of Quantiles, Prediction Intervals, and other Set-Valued Functionalscited by 7
- 2022Comparison of machine learning algorithms for merging gridded satellite and earth-observed precipitation datacited by 6
- 2022Hydrological post-processing for predicting extreme quantilescited by 5
- 2023Merging satellite and gauge-measured precipitation using LightGBM with an emphasis on extreme quantilescited by 5
3 more
- 2022Comparison of tree-based ensemble algorithms for merging satellite and earth-observed precipitation data at the daily time scalecited by 4
- 2023Ensemble learning for blending gridded satellite and gauge-measured precipitation datacited by 3
- 2023Uncertainty estimation of machine learning spatial precipitation predictions from satellite datacited by 2
Built on by
Citing papers per year: 2024: 3.
3 papers.
- 2024A Hybrid Framework for Spatial Interpolation: Merging Data-driven with Domain Knowledgecited by 1
- 2024Quantile deep learning models for multi-step ahead time series predictioncited by 1
- 2024Combinations of distributional regression algorithms with application in uncertainty estimation of corrected satellite precipitation productscited by 0
- 2024Quantile deep learning models for multi-step ahead time series prediction24 Nov 2024
- 2024A Hybrid Framework for Spatial Interpolation: Merging Data-driven with Domain Knowledge28 Aug 2024
- 2024Combinations of distributional regression algorithms with application in uncertainty estimation of corrected satellite precipitation products29 Jun 2024