mlsanityData to 7 Oct 2026

One-Shot Price Forecasting with Covariate-Guided Experts under Privacy Constraints

arXiv 2601.11977 ↗First posted 17 Jan 2026cs.LG cs.AIcited by 0

On the map: Mixture-of-experts → MoE for time series and graphs

Abstract (arXiv)

Forecasting in power systems often involves multivariate time series with complex dependencies and strict privacy constraints across regions. Traditional forecasting methods require significant expert knowledge and struggle to generalize across diverse deployment scenarios. Recent advancements in pre-trained time series models offer new opportunities, but their zero-shot performance on domain-specific tasks remains limited. To address these challenges, we propose a novel MoE Encoder module that augments pretrained forecasting models by injecting a sparse mixture-of-experts layer between tokenization and encoding. This design enables two key capabilities: (1) trans forming multivariate forecasting into an expert-guided univariate task, allowing the model to effectively capture inter-variable relations, and (2) supporting localized training and lightweight parameter sharing in federated settings where raw data cannot be exchanged. Extensive experiments on public multivariate datasets demonstrate that MoE-Encoder significantly improves forecasting accuracy compared to strong baselines. We further simulate federated environments and show that transferring only MoE-Encoder parameters allows efficient adaptation to new regions, with minimal performance degradation. Our findings suggest that MoE-Encoder provides a scalable and privacy-aware extension to foundation time series models.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in MoE for time series and graphs, one of 12 directions in Mixture-of-experts. Builds on 11 of its 23 references that are in the map. First posted on arXiv 17 Jan 2026.

Builds on

11 of 23 references.

References · 11

  1. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  2. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  3. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  4. 2020GShard: Scaling Giant Models with Conditional Computation and Automatic Shardingcited by 1,601
  5. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
  6. 2024Chronos: Learning the Language of Time Seriescited by 712
  7. 2021Knowledge Neurons in Pretrained Transformerscited by 590
  8. 2020Privacy Preserving Vertical Federated Learning for Tree-based Modelscited by 89
  9. 2025Zero-Shot Time Series Forecasting with Covariates via In-Context Learningcited by 12
  10. 2025CITRAS: Covariate-Informed Transformer for Time Series Forecastingcited by 5
  11. 2022Differentially Private Multivariate Time Series Forecasting of Aggregated Human Mobility With Deep Learning: Input or Gradient Perturbation?cited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025GateTS: Versatile and Efficient Forecasting via Attention-Inspired routed Mixture-of-Experts
  2. 2026Seg-MoE: Multi-Resolution Segment-wise Mixture-of-Experts for Time Series Forecasting Transformers
  3. 2026Fast Training of Mixture-of-Experts for Time Series Forecasting via Expert Loss Integration
  4. 2025Super-Linear: A Lightweight Pretrained Mixture of Linear Experts for Time Series Forecasting
  5. 2024Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Experts
  6. 2025External Data-Enhanced Meta-Representation for Adaptive Probabilistic Load Forecasting
  7. 2026MoHETS: Long-term Time Series Forecasting with Mixture-of-Heterogeneous-Experts
  8. 2026Switch-Hurdle: A MoE Encoder with AR Hurdle Decoder for Intermittent Demand Forecasting