mlsanityData to 7 Oct 2026

StoxLSTM: A Stochastic Extended Long Short-Term Memory Network for Time Series Forecasting

arXiv 2509.01187 ↗First posted 1 Sep 2025cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

The Extended Long Short-Term Memory (xLSTM) network has demonstrated strong capability in modeling complex long-term dependencies in time series data. Despite its success, the deterministic architecture of xLSTM limits its representational capacity and forecasting performance, especially on challenging real-world time series datasets characterized by inherent uncertainty, stochasticity, and complex hierarchical latent dynamics. In this work, we propose StoxLSTM, a stochastic xLSTM within a designed state space modeling framework, which integrates latent stochastic variables directly into the recurrent units to effectively model deep latent temporal dynamics and uncertainty. The designed state space model follows an efficient non-autoregressive generative approach, achieving strong predictive performance without complex modifications to the original xLSTM architecture. Extensive experiments on publicly available benchmark datasets demonstrate that StoxLSTM consistently outperforms state-of-the-art baselines, achieving superior performance and generalization.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 50 references that are in the map. First posted on arXiv 1 Sep 2025.

Builds on

28 of 50 references.

References · 28

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2022Generative Adversarial Networkscited by 5,603
  4. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  5. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
  6. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  7. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  8. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  9. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
  10. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
  11. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,004
  12. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
16 more
  1. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 869
  2. 2019On the Variance of the Adaptive Learning Rate and Beyondcited by 763
  3. 2023A decoder-only foundation model for time-series forecastingcited by 650
  4. 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 333
  5. 2021Autoregressive Denoising Diffusion Models for Multivariate Probabilistic Time Series Forecastingcited by 332
  6. 2024xLSTM: Extended Long Short-Term Memorycited by 320
  7. 2020Dynamical Variational Autoencoders: A Comprehensive Reviewcited by 127
  8. 2016Sequential Neural Models with Stochastic Layerscited by 115
  9. 2024TimeMixer++: A General Time Series Pattern Machine for Universal Predictive Analysiscited by 113
  10. 2017Dilated Recurrent Neural Networkscited by 83
  11. 2019Probabilistic Forecasting with Temporal Convolutional Neural Networkcited by 63
  12. 2014Learning Stochastic Recurrent Networkscited by 60
  13. 2024Unlocking the Power of LSTM for Long Term Time Series Forecastingcited by 29
  14. 2024xLSTM-Mixer: Multivariate Time Series Forecasting by Mixing via Scalar Memoriescited by 18
  15. 2024xLSTMTime : Long-term Time Series Forecasting With xLSTMcited by 13
  16. 2024MMFNet: Multi-Scale Frequency Masking Neural Network for Multivariate Time Series Forecastingcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2021Stochastic Recurrent Neural Network for Multistep Time Series Forecasting
  2. 2026Enhancing few-shot time series forecasting with LLM-guided diffusion
  3. 2024SDE: A Simplified and Disentangled Dependency Encoding Framework for State Space Models in Time Series Forecasting
  4. 2022Deep Latent State Space Models for Time-Series Generation
  5. 2023Effectively Modeling Time Series with Simple Discrete State Spaces
  6. 2025LLM-Integrated Bayesian State Space Models for Multimodal Time-Series Forecasting
  7. 2026Memory in Deep Time-Series Models
  8. 2021Deep Probabilistic Time Series Forecasting using Augmented Recurrent Input for Dynamic Systems