mlsanityData to 14 Oct 2026

ChronoVAE-HOPE: Beyond Attention -- A Next-Generation VAE Foundation Model for Specialized Time Series Classification

arXiv 2605.22684 ↗First posted 21 May 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Time Series Foundation Models (TSFMs) have become a new component of the state-of-the-art in general time series forecasting. However, adapting them to specialized classification tasks remains constrained by two interconnected challenges: the quadratic cost of standard attention mechanisms and the inability to disentangle the structural components underlying time series variability. This technical report introduces ChronoVAE-HOPE, a next-generation TSFM that reconciles massive generalization with structured latent representation for time series classification. The core of the proposal is a Variational Autoencoder (VAE) framework built upon the HOPE Block, which replaces quadratic attention with a dual-memory system: Titans modules for dynamic short-term retention and a Continuum Memory System (CMS) for the abstraction of long-term historical context. A key architectural novelty is the disentangled latent space, which factorizes representations into independent trend and seasonal components via dedicated encoder heads and separate decoder pathways. ChronoVAE-HOPE undergoes self-supervised pre-training on the Monash archive, combining a Masked Time Series Modeling (MTSM) auxiliary objective with a disentangled VAE reconstruction loss. The pre-trained encoder is subsequently frozen and used to generate fixed-length embeddings for downstream classification on the UCR benchmark datasets. Empirical results demonstrate strong performance across diverse temporal domains, particularly in settings characterized by strict causal structure. ChronoVAE-HOPE establishes a robust and interpretable framework for the adaptation of foundation models to time series classification through structured generative representations.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 18 references that are in the map. First posted on arXiv 21 May 2026.

Builds on

10 of 18 references.

References · 10

  1. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  2. 2023A decoder-only foundation model for time-series forecastingcited by 692
  3. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
  4. 2018The UCR Time Series Archivecited by 431
  5. 2019InceptionTime: Finding AlexNet for Time Series Classificationcited by 387
  6. 2016Time Series Classification from Scratch with Deep Neural Networks: A Strong Baselinecited by 360
  7. 2021Monash Time Series Forecasting Archivecited by 267
  8. 2020Benchmarking Multivariate Time Series Classification Algorithmscited by 145
  9. 2025Nested Learning: The Illusion of Deep Learning Architecturescited by 72
  10. 2024A Survey of Explainable Artificial Intelligence (XAI) in Financial Time Series Forecastingcited by 14

Built on by

Not cited yet.