mlsanityData to 14 Oct 2026

FlexTSF: A Flexible Forecasting Model for Time Series with Variable Regularities

arXiv 2410.23160 ↗First posted 30 Oct 2024cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Forecasting time series with irregular temporal structures remains challenging for universal pre-trained models. Existing approaches often assume regular sampling or depend heavily on imputation, limiting their applicability in real-world scenarios where irregularities are prevalent due to diverse sensing devices and recording practices. We introduce FlexTSF, a flexible forecasting model specifically designed for time series data with variable temporal regularities. At its foundation lies the IVP Patcher, a continuous-time patching module leveraging Initial Value Problems (IVPs) to inherently support uneven time intervals, variable sequence lengths, and missing values. FlexTSF employs a decoder-only architecture that integrates normalized timestamp inputs and domain-specific statistics through a specialized causal self-attention mechanism, enabling adaptability across domains. Extensive experiments on 16 datasets demonstrate FlexTSF's effectiveness, significantly outperforming existing models in classic forecasting scenarios, zero-shot generalization, and low-resource fine-tuning conditions. Ablation studies confirm the contributions of each design component and the advantage of not relying on predefined fixed patch lengths.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 49 references that are in the map. First posted on arXiv 30 Oct 2024.

Builds on

26 of 49 references.

References · 26

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  3. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  4. 2018Neural Ordinary Differential Equationscited by 3,779
  5. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  6. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  7. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  8. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
  9. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,013
  10. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 879
  11. 2024Chronos: Learning the Language of Time Seriescited by 759
  12. 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 632
14 more
  1. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
  2. 2019Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecastingcited by 607
  3. 2016Recurrent Neural Networks for Multivariate Time Series with Missing Valuescited by 554
  4. 2020Time Series Forecasting With Deep Learning: A Surveycited by 459
  5. 2018The UEA multivariate time series classification archive, 2018cited by 338
  6. 2021Monash Time Series Forecasting Archivecited by 267
  7. 2024TimeXer: Empowering Transformers for Time Series Forecasting with Exogenous Variablescited by 248
  8. 2021Multi-Time Attention Networks for Irregularly Sampled Time Seriescited by 238
  9. 2023TEST: Text Prototype Aligned Embedding to Activate LLM's Ability for Time Seriescited by 169
  10. 2023ForecastPFN: Synthetically-Trained Zero-Shot Forecastingcited by 104
  11. 2021Modeling Irregular Time Series with Continuous Recurrent Unitscited by 103
  12. 2021Neural Flows: Efficient Alternative to Neural ODEscited by 101
  13. 2024Empowering Time Series Analysis with Foundation Models: A Comprehensive Surveycited by 23
  14. 2023IVP-VAE: Modeling EHR Time Series with Initial Value Problem Solverscited by 5

Built on by

Not cited yet.