mlsanityData to 7 Oct 2026

HALO: Enhancing Time Series Generation via Hyperspherical Latents and Masked AutoregRessive Modeling

arXiv 2609.34511 ↗First posted 28 Sep 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Most existing time series generators rely on a two-stage modeling paradigm: the first stage learns discrete latent representations of time series; the second stage performs autoregressive modeling on these discrete latents through next token prediction. However, this paradigm suffers from two stage-specific limitations: the first stage can lead to information loss when discretizing continuous time series, while the second stage is prone to error accumulation during autoregressive generation. To address these limitations, our core idea is to perform generative modeling in a continuous latent space with a more efficient autoregressive framework. We propose HALO, which enhances time series generation via Hyperspherical Latents and Masked Autoregressive modeling to achieve this goal by tackling two key bottlenecks: (1) variance and scale heterogeneity of continuous latent representations; (2) the difficulty of balancing generation efficiency with temporal correlation modeling. HALO first introduces a hyperspherical VAE that constrains continuous latents to a fixed-radius hyperspherical shell, effectively stabilizing the numerical fluctuations of continuous latent representations. Secondly, we develop a masked autoregressive model that balances parallel decoding and temporal correlation learning, substantially reducing the number of inference steps required for generation and improving generation stability. Our extensive experiments demonstrate that HALO achieves state-of-the-art generation performance while offering significantly improved inference efficiency over existing advanced baselines.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 35 of its 48 references that are in the map. First posted on arXiv 28 Sep 2026.

Builds on

35 of 48 references.

References · 35

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  3. 2022Scalable Diffusion Models with Transformerscited by 5,931
  4. 2017Neural Discrete Representation Learningcited by 4,650
  5. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  6. 2022MaskGIT: Masked Generative Image Transformercited by 1,082
  7. 2022Diffusion Models in Vision: A Surveycited by 1,008
  8. 2015Sequence Level Training with Recurrent Neural Networkscited by 568
  9. 2021Monash Time Series Forecasting Archivecited by 256
  10. 2024TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting Methodscited by 242
  11. 2022MAGE: MAsked Generative Encoder to Unify Representation Learning and Image Synthesiscited by 222
  12. 2024Diffusion-TS: Interpretable Diffusion for General Time Series Generationcited by 179
23 more
  1. 2021TimeVAE: A Variational Auto-Encoder for Multivariate Time Series Generationcited by 139
  2. 2022A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Modelscited by 128
  3. 2024DUET: Dual Clustering Enhanced Multivariate Time Series Forecastingcited by 104
  4. 2024VisionTS: Visual Masked Autoencoders Are Free-Lunch Zero-Shot Time Series Forecasterscited by 87
  5. 2023Deep Learning for Time Series Classification and Extrinsic Regression: A Current Surveycited by 68
  6. 2025TAB: Unified Benchmarking of Time Series Anomaly Detection Methodscited by 58
  7. 2023On the Constrained Time-Series Generation Problemcited by 52
  8. 2023Vector Quantized Time Series Generation with a Bidirectional Prior Modelcited by 49
  9. 2024Multimodal Latent Language Modeling with Next-Token Diffusioncited by 47
  10. 2025DBLoss: Decomposition-based Loss Function for Time Series Forecastingcited by 44
  11. 2022GT-GAN: General Purpose Time Series Synthesis with Generative Adversarial Networkscited by 43
  12. 2025DAG: A Dual Correlation Network for Time Series Forecasting with Exogenous Variablescited by 30
  13. 2025Kronos: A Foundation Model for the Language of Financial Marketscited by 25
  14. 2025TimeDP: Learning to Generate Multi-Domain Time Series with Domain Promptscited by 21
  15. 2025HMAR: Efficient Hierarchical Masked Auto-Regressive Image Generationcited by 19
  16. 2023Market-GAN: Adding Control to Financial Market Data Generation with Semantic Contextcited by 13
  17. 2025TimeMosaic: Temporal Heterogeneity Guided Time Series Forecasting via Adaptive Granularity Patch and Segment-wise Decodingcited by 12
  18. 2025TarDiff: Target-Oriented Diffusion Guidance for Synthetic Electronic Health Record Time Series Generationcited by 8
  19. 2025HDT: Hierarchical Discrete Transformer for Multivariate Time Series Forecastingcited by 7
  20. 2026SDFlow: Similarity-Driven Flow Matching for Time Series Generationcited by 3
  21. 2026TimeMar: Multi-Scale Autoregressive Modeling for Unconditional Time Series Generationcited by 2
  22. 2025FaultDiffusion: Few-Shot Fault Time Series Generation with Diffusion Modelcited by 1
  23. 2026Multivariate Time Series Forecasting needs Cross Variable Losscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2022Deep Latent State Space Models for Time-Series Generation
  2. 2025Time Series Generation Under Data Scarcity: A Unified Generative Modeling Approach
  3. 2025TIMED: Adversarial and Autoregressive Refinement of Diffusion-Based Time Series Generation
  4. 2026Unconditional flow-based time series generation with equivariance-regularised latent spaces
  5. 2025WaveStitch: Flexible and Fast Conditional Time Series Generation with Diffusion Models
  6. 2024TimeLDM: Latent Diffusion Model for Unconditional Time Series Generation
  7. 2026CoGenCast: A Coupled Autoregressive-Flow Generative Framework for Time Series Forecasting
  8. 2024AutoTimes: Autoregressive Time Series Forecasters via Large Language Models