mlsanityData to 7 Oct 2026

MoGU: Mixture-of-Gaussians with Uncertainty-based Gating for Time Series Forecasting

arXiv 2510.07459 ↗First posted 8 Oct 2025cs.LG cs.AIcited by 2

On the map: Mixture-of-experts → MoE for time series and graphs

Abstract (arXiv)

We introduce Mixture-of-Gaussians with Uncertainty-based Gating (MoGU), a novel Mixture-of-Experts (MoE) framework designed for regression tasks. MoGU replaces standard learned gating with an intrinsic routing paradigm where expert-specific uncertainty serves as the native gating signal. By modeling each prediction as a Gaussian distribution, the system utilizes predicted variance to dynamically weight expert contributions. We validate MoGU on multivariate time-series forecasting, a domain defined by high volatility and varying noise patterns. Empirical results across multiple benchmarks, horizon lengths, and backbones demonstrate that MoGU consistently improves forecasting accuracy compared to traditional MoE. Further evaluation via conformal prediction indicates that our approach yields more efficient prediction intervals than existing baselines. These findings highlight MoGU's capacity for providing both competitive performance and reliable, high-fidelity uncertainty quantification. Our code is available at: https://github.com/yolish/moe_unc_tsf

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in MoE for time series and graphs, one of 12 directions in Mixture-of-experts. Builds on 26 of its 32 references that are in the map. First posted on arXiv 8 Oct 2025.

Builds on

26 of 32 references.

References · 26

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  2. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
  3. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
  4. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  5. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
  6. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  7. 2024Mixtral of Expertscited by 1,785
  8. 2020Reformer: The Efficient Transformercited by 1,658
  9. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  10. 2020GShard: Scaling Giant Models with Conditional Computation and Automatic Shardingcited by 1,601
  11. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
  12. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
14 more
  1. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
  2. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 869
  3. 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 834
  4. 2019Conformalized Quantile Regressioncited by 620
  5. 2020Time Series Forecasting With Deep Learning: A Surveycited by 457
  6. 2018Accurate Uncertainties for Deep Learning Using Calibrated Regressioncited by 417
  7. 2021Adaptive Conformal Inference Under Distribution Shiftcited by 360
  8. 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 333
  9. 2024Deep Time Series Models: A Comprehensive Survey and Benchmarkcited by 191
  10. 2024Deep Learning for Multivariate Time Series Imputation: A Surveycited by 57
  11. 2025Error-quantified Conformal Inference for Time Seriescited by 11
  12. 2025Relational Conformal Prediction for Correlated Time Seriescited by 11
  13. 2025Extracting Uncertainty Estimates from Mixtures of Experts for Semantic Segmentationcited by 6
  14. 2023Efficient Deweather Mixture-of-Experts with Uncertainty-aware Feature-wise Linear Modulationcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Ada-MoGE: Adaptive Mixture of Gaussian Expert Model for Time Series Forecasting
  2. 2025MoWE : A Mixture of Weather Experts
  3. 2023Mixture-of-Linear-Experts for Long-term Time Series Forecasting
  4. 2025MoFE-Time: Mixture of Frequency Domain Experts for Time-Series Forecasting Models
  5. 2026MoHETS: Long-term Time Series Forecasting with Mixture-of-Heterogeneous-Experts
  6. 2026Fast Training of Mixture-of-Experts for Time Series Forecasting via Expert Loss Integration
  7. 2026FAME: Forecastability-Aware Mixture of Experts for Heterogeneous Time Series Forecasting
  8. 2026AME-TS: Anchored Mixture-of-Experts for Time Series Forecasting