mlsanityData to 14 Oct 2026

External Data-Enhanced Meta-Representation for Adaptive Probabilistic Load Forecasting

arXiv 2506.23201 ↗First posted 29 Jun 2025cs.LG cs.SY eess.SYcited by 3

On the map: Mixture-of-experts → MoE for time series and graphs

Abstract (arXiv)

Accurate residential load forecasting is critical for power system reliability with rising renewable integration and demand-side flexibility. However, most statistical and machine learning models treat external factors, such as weather, calendar effects, and pricing, as extra input, ignoring their heterogeneity, and thus limiting the extraction of useful external information. We propose a paradigm shift: external data should serve as meta-knowledge to dynamically adapt the forecasting model itself. Based on this idea, we design a meta-representation framework using hypernetworks that modulate selected parameters of a base Deep Learning (DL) model in response to external conditions. This provides both expressivity and adaptability. We further integrate a Mixture-of-Experts (MoE) mechanism to enhance efficiency through selective expert activation, while improving robustness by filtering redundant external inputs. The resulting model, dubbed as a Meta Mixture of Experts for External data (M2oE2), achieves substantial improvements in accuracy and robustness with limited additional overhead, outperforming existing state-of-the-art methods in diverse load datasets. The dataset and source code are publicly available at https://github.com/haorandd/M2oE2loadforecast.git.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in MoE for time series and graphs, one of 12 directions in Mixture-of-experts. Builds on 14 of its 49 references that are in the map. First posted on arXiv 29 Jun 2025.

Builds on

14 of 49 references.

References · 14

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
  3. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  4. 2016HyperNetworkscited by 1,027
  5. 2020On Layer Normalization in the Transformer Architecturecited by 922
  6. 2022Mixture-of-Experts with Expert Choice Routingcited by 623
  7. 2016Recurrent Neural Networks for Multivariate Time Series with Missing Valuescited by 554
  8. 2018Review of Smart Meter Data Analytics: Applications, Methodologies, and Challengescited by 47
  9. 2020LfEdNet: A Task-based Day-ahead Load Forecasting Model for Stochastic Economic Dispatchcited by 11
  10. 2025ExARNN: An Environment-Driven Adaptive RNN for Learning Non-Stationary Power Dynamicscited by 8
  11. 2019Input Modeling and Uncertainty Quantification for Improving Volatile Residential Load Forecastingcited by 2
  12. 2025MetaEformer: Unveiling and Leveraging Meta-patterns for Complex and Dynamic Systems Load Forecastingcited by 2
2 more
  1. 2021Uncovering Dominant Features in Short-term Power Load Forecasting Based on Multi-source Featurecited by 1
  2. 2024Few-Shot Load Forecasting Under Data Scarcity in Smart Grids: A Meta-Learning Approachcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025TriForecaster: A Mixture of Experts Framework for Multi-Region Electric Load Forecasting with Tri-dimensional Specialization
  2. 2026LoaDiff: Conditional Generation of Electricity Consumption Time Series for Energy Analytics
  3. 2025Time-series surrogates from energy consumers generated by machine learning approaches for long-term forecasting scenarios
  4. 2026One-Shot Price Forecasting with Covariate-Guided Experts under Privacy Constraints
  5. 2024Generative Modeling and Data Augmentation for Power System Production Simulation
  6. 2026Benchmarking State Space Models, Transformers, and Recurrent Networks for US Grid Forecasting
  7. 2022TgDLF2.0: Theory-guided deep-learning for electrical load forecasting via Transformer and transfer learning
  8. 2025Large Language Model-Empowered Interactive Load Forecasting