mlsanityData to 7 Oct 2026

AdaWeather: Adaptively Mixing Probabilistic Weather Forecasts with Logarithmic Regret

arXiv 2606.02663 ↗First posted 1 Jun 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent advances in machine learning have produced probabilistic weather forecasting models comparable to state-of-the-art numerical weather predictors. But no model consistently dominates spatio-temporally, and relative performance is highly context-dependent. This motivates adaptive methods for combining multiple forecasts to obtain improvements and robustness. While combined forecasts have been proposed in the literature, these are achieved either through supervised learning or through prediction with expert advice methods. We introduce AdaWeather, an adaptive framework that combines many probabilistic forecasts using both machine learning as well as mixture of experts to arrive at a unified improved probabilistic forecast. While traditional expert methods develop the regret bounds with respect to the best single expert in hindsight, we extend the algorithm and analysis to show our method has logarithmic regret compared to the best static mixture of experts in hindsight. Empirically, we focus on forecasting temperature, and observe improvements over existing methods.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 61 references that are in the map. First posted on arXiv 1 Jun 2026.

Builds on

30 of 61 references.

References · 30

  1. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  2. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
  3. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
  4. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  5. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  6. 2017Gradient Episodic Memory for Continual Learningcited by 1,871
  7. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  8. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
  9. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
  10. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
  11. 2019Introduction to Online Convex Optimizationcited by 793
  12. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 748
18 more
  1. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 744
  2. 2023ClimaX: A foundation model for weather and climatecited by 325
  3. 2023Neural General Circulation Models for Weather and Climatecited by 232
  4. 2023WeatherBench 2: A benchmark for the next generation of data-driven global weather modelscited by 227
  5. 2023GenCast: Diffusion-based ensemble forecasting for medium-range weathercited by 169
  6. 2023Scaling transformer neural networks for skillful and reliable medium-range weather forecastingcited by 106
  7. 2015Online Optimization : Competing with Dynamic Comparatorscited by 99
  8. 2023OneNet: Enhancing Time Series Forecasting Models under Concept Drift by Online Ensemblingcited by 71
  9. 2022Learning Fast and Slow for Online Time Series Forecastingcited by 43
  10. 2019Dynamic Local Regret for Non-convex Online Forecastingcited by 17
  11. 2022Spatial Mixture-of-Expertscited by 14
  12. 2025Breaking Silos: Adaptive Model Fusion Unlocks Better Time Series Forecastingcited by 12
  13. 2024VA-MoE: Variables-Adaptive Mixture of Experts for Incremental Weather Forecastingcited by 5
  14. 2021Online Aggregation of Probability Forecasts with Confidencecited by 3
  15. 2025MoWE : A Mixture of Weather Expertscited by 2
  16. 2025Online Mixture of Experts: No-Regret Learning for Optimal Collective Decision-Makingcited by 2
  17. 2019A mixture of experts model for predicting persistent weather patternscited by 1
  18. 2025Contribution of expert aggregation to temperature prediction part icited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Proper Scoring Rule-based Diffusion for Probabilistic Weather Forecasting
  2. 2026Demystifying Data-Driven Probabilistic Medium-Range Weather Forecasting
  3. 2024CoDiCast: Conditional Diffusion Model for Global Weather Prediction with Uncertainty Quantification
  4. 2026Universal Diffusion-Based Probabilistic Downscaling
  5. 2023Deterministic Guidance Diffusion Model for Probabilistic Weather Forecasting
  6. 2023SEEDS: Emulation of Weather Forecast Ensembles with Diffusion Models
  7. 2025Data-Efficient Ensemble Weather Forecasting with Diffusion Models
  8. 2025Collaborative Deterministic-Probabilistic Forecasting for Diverse Spatiotemporal Systems