mlsanityData to 14 Oct 2026

Behaviour-Conditioned Neural Processes for Adaptive Residential Short-Term Load Forecasting

arXiv 2607.16168 ↗First posted 17 Jul 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Residential short-term load forecasting (STLF) is challenging because household demand is heterogeneous, temporally variable, and shaped by diverse behavioural routines. This work investigates whether inferred behavioural structure can be embedded within the forecasting mechanism of a Neural Process-based probabilistic model, rather than used only as an external grouping signal, for context-conditioned residential STLF. We propose a behaviour-conditioned Attentive Neural Process framework that treats each load profile as a forecasting task. Behavioural structure is represented by a discrete latent variable inferred from the available context and used for behaviour-conditioned decoder conditioning, while a continuous latent variable captures shared functional uncertainty across heterogeneous profiles. To enable conditioning without ground-truth behavioural labels, clustering-derived information provides weak supervision during training, whereas test-time conditioning relies only on context-inferred class distributions. Experiments on the Smart Grid, Smart City (SGSC) dataset use user-disjoint train/validation/test splits, variable context lengths, and multi-step forecast horizons, with comparisons against a label-agnostic ANP baseline and fixed-window deterministic STLF baselines. The proposed variants improve MAE and CRPS over ANP across horizons and context settings, with the largest gains under limited context. The best-performing variant achieves average reductions of 7.9% in MAE and 6.9% in CRPS relative to ANP. Compared with fixed-window baselines, this variant achieves lower RMSE across all evaluated horizons while maintaining competitive MAE, suggesting fewer large prediction deviations under heterogeneous consumption patterns. These results support single-model, uncertainty-aware forecasting across heterogeneous households, contexts, and horizons.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 50 references that are in the map. First posted on arXiv 17 Jul 2026.

Builds on

14 of 50 references.

References · 14

  1. 2022Scalable Diffusion Models with Transformerscited by 6,054
  2. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  3. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,739
  4. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  5. 2017Deep Setscited by 1,421
  6. 2016The Concrete Distribution: A Continuous Relaxation of Discrete Random Variablescited by 1,148
  7. 2014Semi-Supervised Learning with Deep Generative Modelscited by 496
  8. 2018Conditional Neural Processescited by 426
  9. 2019Attentive Neural Processescited by 283
  10. 2017Advances in Variational Inferencecited by 236
  11. 2020Principles and Algorithms for Forecasting Groups of Time Series: Locality and Globalitycited by 70
  12. 2019Temporal FiLM: Capturing Long-Range Sequence Dependencies with Feature-Wise Modulationscited by 36
2 more
  1. 2024Heterogeneity-Informed Meta-Parameter Learning for Spatiotemporal Time Series Forecastingcited by 18
  2. 2023Time series clustering based on prediction accuracy of global forecasting modelscited by 3

Built on by

Not cited yet.