Let Experts Feel Uncertainty: A Multi-Expert Label Distribution Approach to Probabilistic Time Series Forecasting
On the map: Mixture-of-experts → MoE for time series and graphs
Abstract (arXiv)
Time series forecasting in real-world applications requires both high predictive accuracy and interpretable uncertainty quantification. Traditional point prediction methods often fail to capture the inherent uncertainty in time series data, while existing probabilistic approaches struggle to balance computational efficiency with interpretability. We propose a novel Multi-Expert Learning Distributional Labels (LDL) framework that addresses these challenges through mixture-of-experts architectures with distributional learning capabilities. Our approach introduces two complementary methods: (1) Multi-Expert LDL, which employs multiple experts with different learned parameters to capture diverse temporal patterns, and (2) Pattern-Aware LDL-MoE, which explicitly decomposes time series into interpretable components (trend, seasonality, changepoints, volatility) through specialized sub-experts. Both frameworks extend traditional point prediction to distributional learning, enabling rich uncertainty quantification through Maximum Mean Discrepancy (MMD). We evaluate our methods on aggregated sales data derived from the M5 dataset, demonstrating superior performance compared to baseline approaches. The continuous Multi-Expert LDL achieves the best overall performance, while the Pattern-Aware LDL-MoE provides enhanced interpretability through component-wise analysis. Our frameworks successfully balance predictive accuracy with interpretability, making them suitable for real-world forecasting applications where both performance and actionable insights are crucial.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in MoE for time series and graphs, one of 12 directions in Mixture-of-experts. Builds on 22 of its 29 references that are in the map. First posted on arXiv 4 Feb 2026.
Builds on
22 of 29 references.
References · 22
- 2017Attention Is All You Needcited by 59,932
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
- 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
- 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
- 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 869
- 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 744
- 2020Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networkscited by 563
- 2015LSTM: A Search Space Odysseycited by 315
10 more
- 2017Gate-Variants of Gated Recurrent Unit (GRU) Neural Networkscited by 239
- 2017A Multi-Horizon Quantile Recurrent Forecastercited by 211
- 2022Less Is More: Fast Multivariate Time Series Forecasting with Light Sampling-oriented MLP Structurescited by 158
- 2019High-Dimensional Multivariate Forecasting with Low-Rank Gaussian Copula Processescited by 147
- 2014Label Distribution Learningcited by 122
- 2015Optimal Rates for Random Fourier Featurescited by 38
- 2025Mixture of Experts (MoE): A Big Data Perspectivecited by 17
- 2023Label-efficient Time Series Representation Learning: A Reviewcited by 16
- 2024Exposing the Achilles' Heel: Evaluating LLMs Ability to Handle Mistakes in Mathematical Reasoningcited by 13
- 2021Dynamic Combination of Heterogeneous Models for Hierarchical Time Seriescited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026AME-TS: Anchored Mixture-of-Experts for Time Series Forecasting
- 2025MoGU: Mixture-of-Gaussians with Uncertainty-based Gating for Time Series Forecasting
- 2026FAME: Forecastability-Aware Mixture of Experts for Heterogeneous Time Series Forecasting
- 2025Time Tracker: Mixture-of-Experts-Enhanced Foundation Time Series Forecasting Model with Decoupled Training Pipelines
- 2026DeRegiME: Deep Regime Mixtures for Probabilistic Forecasting under Distribution Shift
- 2026WaveMoE: A Wavelet-Enhanced Mixture-of-Experts Foundation Model for Time Series Forecasting
- 2026Dynamic TMoE: A Drift-Aware Dynamic Mixture of Experts Framework for Non-Stationary Time Series Forecasting
- 2025RDIT: Residual-based Diffusion Implicit Models for Probabilistic Time Series Forecasting