mlsanityData to 7 Oct 2026

Pyramidal Hidden Markov Model For Multivariate Time Series Forecasting

arXiv 2310.14341 ↗First posted 22 Oct 2023cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

The Hidden Markov Model (HMM) can predict the future value of a time series based on its current and previous values, making it a powerful algorithm for handling various types of time series. Numerous studies have explored the improvement of HMM using advanced techniques, leading to the development of several variations of HMM. Despite these studies indicating the increased competitiveness of HMM compared to other advanced algorithms, few have recognized the significance and impact of incorporating multistep stochastic states into its performance. In this work, we propose a Pyramidal Hidden Markov Model (PHMM) that can capture multiple multistep stochastic states. Initially, a multistep HMM is designed for extracting short multistep stochastic states. Next, a novel time series forecasting structure is proposed based on PHMM, which utilizes pyramid-like stacking to adaptively identify long multistep stochastic states. By employing these two schemes, our model can effectively handle non-stationary and noisy data, while also establishing long-term dependencies for more accurate and comprehensive forecasting. The experimental results on diverse multivariate time series datasets convincingly demonstrate the superior performance of our proposed PHMM compared to its competitive peers in time series forecasting.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 42 references that are in the map. First posted on arXiv 22 Oct 2023.

Builds on

20 of 42 references.

References · 20

  1. 2017Attention Is All You Needcited by 59,932
  2. 2013Auto-Encoding Variational Bayescited by 3,980
  3. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
  4. 2021Generalized Out-of-Distribution Detection: A Surveycited by 796
  5. 2021TS2Vec: Towards Universal Representation of Time Seriescited by 463
  6. 2018The UCR Time Series Archivecited by 421
  7. 2021Anomaly Transformer: Time Series Anomaly Detection with Association Discrepancycited by 387
  8. 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 385
  9. 2019ROCKET: Exceptionally fast and accurate time series classification using random convolutional kernelscited by 336
  10. 2018The UEA multivariate time series classification archive, 2018cited by 330
  11. 2020MINIROCKET: A Very Fast (Almost) Deterministic Transform for Time Series Classificationcited by 186
  12. 2019Recurrent Neural Networks for Time Series Forecasting: Current Status and Future Directionscited by 172
8 more
  1. 2022CoST: Contrastive Learning of Disentangled Seasonal-Trend Representations for Time Series Forecastingcited by 143
  2. 2018Multivariate LSTM-FCNs for Time Series Classificationcited by 120
  3. 2021Domain Adaptation for Time Series Forecasting via Attention Sharingcited by 68
  4. 2017Multivariate Time Series Classification with WEASEL+MUSEcited by 53
  5. 2021Causal Hidden Markov Model for Time Series Disease Forecastingcited by 19
  6. 2021Neural HMMs are all you need (for high-quality attention-free TTS)cited by 8
  7. 2021Early Performance Prediction using Interpretable Patterns in Programming Process Datacited by 7
  8. 2021MrSQM: Fast Time Series Classification with Symbolic Representationscited by 7

Built on by

Not cited yet.