mlsanityData to 14 Oct 2026

Energy-Aware Pattern Disentanglement: A Generalizable Pattern Assisted Architecture for Multi-task Time Series Analysis

arXiv 2504.14209 ↗First posted 19 Apr 2025cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Time series analysis has found widespread applications in areas such as weather forecasting, anomaly detection, and healthcare. While deep learning approaches have achieved significant success in this field, existing methods often adopt a "one-model one-task" architecture, limiting their generalization across different tasks. To address these limitations, we perform local energy analysis in the time-frequency domain to more precisely capture and disentangle transient and non-stationary oscillatory components. Furthermore, our representational analysis reveals that generative tasks tend to capture long-period patterns from low-frequency components, whereas discriminative tasks focus on high-frequency abrupt signals, which constitutes our core contribution. Concretely, we propose Pets, a novel "one-model many-tasks" architecture based on the General fluctuation Pattern Assisted (GPA) framework that is adaptable to versatile model structures for time series analysis. Pets integrates a Fluctuation Pattern Assisted (FPA) module and a Context-Guided Mixture of Predictors (MoP). The FPA module facilitates information fusion among diverse fluctuation patterns by capturing their dependencies and progressively modeling these patterns as latent representations at each layer. Meanwhile, the MoP module leverages these generalizable pattern representations to guide and regulate the reconstruction of distinct fluctuations hierarchically by energy proportion. Pets demonstrates strong versatility and achieves state-of-the-art performance across 60 benchmarks on various tasks, including forecasting, imputation, anomaly detection, and classification, while demonstrating strong generalization and robustness.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 60 of its 89 references that are in the map. First posted on arXiv 19 Apr 2025.

Builds on

60 of 89 references.

References · 60

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  4. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
  5. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
  6. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  7. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  8. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  9. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,436
  10. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
  11. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
  12. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
38 more
  1. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 879
  2. 2024Chronos: Learning the Language of Time Seriescited by 759
  3. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 753
  4. 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 700
  5. 2023A decoder-only foundation model for time-series forecastingcited by 692
  6. 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 632
  7. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
  8. 2021CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputationcited by 582
  9. 2018Deep learning for time series classification: a reviewcited by 576
  10. 2022Vision Transformer Adapter for Dense Predictionscited by 565
  11. 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 500
  12. 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 482
  13. 2021Anomaly Transformer: Time Series Anomaly Detection with Association Discrepancycited by 394
  14. 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 346
  15. 2019ROCKET: Exceptionally fast and accurate time series classification using random convolutional kernelscited by 339
  16. 2018The UEA multivariate time series classification archive, 2018cited by 338
  17. 2021SCINet: Time Series Modeling and Forecasting with Sample Convolution and Interactioncited by 338
  18. 2023Long-term Forecasting with TiDE: Time-series Dense Encodercited by 332
  19. 2017Multitask learning and benchmarking with clinical time series datacited by 290
  20. 2019Financial Time Series Forecasting with Deep Learning : A Systematic Literature Review: 2005-2019cited by 273
  21. 2019Unsupervised Scalable Representation Learning for Multivariate Time Seriescited by 269
  22. 2024TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting Methodscited by 249
  23. 2022Diffusion-based Time Series Imputation and Forecasting with Structured State Space Modelscited by 198
  24. 2023FITS: Modeling Time Series with 10k Parameterscited by 195
  25. 2019GP-VAE: Deep Probabilistic Time Series Imputationcited by 172
  26. 2023Frequency-domain MLPs are More Effective Learners in Time Series Forecastingcited by 172
  27. 2020Multivariate Time-series Anomaly Detection via Graph Attention Networkcited by 167
  28. 2022ETSformer: Exponential Smoothing Transformers for Time-series Forecastingcited by 148
  29. 2022FiLM: Frequency improved Legendre Memory Model for Long-term Time Series Forecastingcited by 147
  30. 2022N-HiTS: Neural Hierarchical Interpolation for Time Series Forecastingcited by 146
  31. 2024TimeMixer++: A General Time Series Pattern Machine for Universal Predictive Analysiscited by 116
  32. 2023SimMTM: A Simple Pre-Training Framework for Masked Time-Series Modelingcited by 115
  33. 2024DUET: Dual Clustering Enhanced Multivariate Time Series Forecastingcited by 107
  34. 2024CycleNet: Enhancing Time Series Forecasting through Modeling Periodic Patternscited by 106
  35. 2023Dish-TS: A General Paradigm for Alleviating Distribution Shift in Time Series Forecastingcited by 93
  36. 2022Flowformer: Linearizing Transformers with Conservation Flowscited by 69
  37. 2021Cross-Domain Gradient Discrepancy Minimization for Unsupervised Domain Adaptationcited by 67
  38. 2024ViT-CoMer: Vision Transformer with Convolutional Multi-scale Feature Interaction for Dense Predictionscited by 66

50 most cited of 60 All 60 (JSON)

Built on by

Not cited yet.