Energy-Aware Pattern Disentanglement: A Generalizable Pattern Assisted Architecture for Multi-task Time Series Analysis
Not on the map. Why?
Abstract (arXiv)
Time series analysis has found widespread applications in areas such as weather forecasting, anomaly detection, and healthcare. While deep learning approaches have achieved significant success in this field, existing methods often adopt a "one-model one-task" architecture, limiting their generalization across different tasks. To address these limitations, we perform local energy analysis in the time-frequency domain to more precisely capture and disentangle transient and non-stationary oscillatory components. Furthermore, our representational analysis reveals that generative tasks tend to capture long-period patterns from low-frequency components, whereas discriminative tasks focus on high-frequency abrupt signals, which constitutes our core contribution. Concretely, we propose Pets, a novel "one-model many-tasks" architecture based on the General fluctuation Pattern Assisted (GPA) framework that is adaptable to versatile model structures for time series analysis. Pets integrates a Fluctuation Pattern Assisted (FPA) module and a Context-Guided Mixture of Predictors (MoP). The FPA module facilitates information fusion among diverse fluctuation patterns by capturing their dependencies and progressively modeling these patterns as latent representations at each layer. Meanwhile, the MoP module leverages these generalizable pattern representations to guide and regulate the reconstruction of distinct fluctuations hierarchically by energy proportion. Pets demonstrates strong versatility and achieves state-of-the-art performance across 60 benchmarks on various tasks, including forecasting, imputation, anomaly detection, and classification, while demonstrating strong generalization and robustness.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 60 of its 89 references that are in the map. First posted on arXiv 19 Apr 2025.
Builds on
60 of 89 references.
References · 60
- 2017Attention Is All You Needcited by 60,361
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,436
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
- 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
38 more
- 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 879
- 2024Chronos: Learning the Language of Time Seriescited by 759
- 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 753
- 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 700
- 2023A decoder-only foundation model for time-series forecastingcited by 692
- 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 632
- 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
- 2021CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputationcited by 582
- 2018Deep learning for time series classification: a reviewcited by 576
- 2022Vision Transformer Adapter for Dense Predictionscited by 565
- 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 500
- 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 482
- 2021Anomaly Transformer: Time Series Anomaly Detection with Association Discrepancycited by 394
- 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 346
- 2019ROCKET: Exceptionally fast and accurate time series classification using random convolutional kernelscited by 339
- 2018The UEA multivariate time series classification archive, 2018cited by 338
- 2021SCINet: Time Series Modeling and Forecasting with Sample Convolution and Interactioncited by 338
- 2023Long-term Forecasting with TiDE: Time-series Dense Encodercited by 332
- 2017Multitask learning and benchmarking with clinical time series datacited by 290
- 2019Financial Time Series Forecasting with Deep Learning : A Systematic Literature Review: 2005-2019cited by 273
- 2019Unsupervised Scalable Representation Learning for Multivariate Time Seriescited by 269
- 2024TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting Methodscited by 249
- 2022Diffusion-based Time Series Imputation and Forecasting with Structured State Space Modelscited by 198
- 2023FITS: Modeling Time Series with 10k Parameterscited by 195
- 2019GP-VAE: Deep Probabilistic Time Series Imputationcited by 172
- 2023Frequency-domain MLPs are More Effective Learners in Time Series Forecastingcited by 172
- 2020Multivariate Time-series Anomaly Detection via Graph Attention Networkcited by 167
- 2022ETSformer: Exponential Smoothing Transformers for Time-series Forecastingcited by 148
- 2022FiLM: Frequency improved Legendre Memory Model for Long-term Time Series Forecastingcited by 147
- 2022N-HiTS: Neural Hierarchical Interpolation for Time Series Forecastingcited by 146
- 2024TimeMixer++: A General Time Series Pattern Machine for Universal Predictive Analysiscited by 116
- 2023SimMTM: A Simple Pre-Training Framework for Masked Time-Series Modelingcited by 115
- 2024DUET: Dual Clustering Enhanced Multivariate Time Series Forecastingcited by 107
- 2024CycleNet: Enhancing Time Series Forecasting through Modeling Periodic Patternscited by 106
- 2023Dish-TS: A General Paradigm for Alleviating Distribution Shift in Time Series Forecastingcited by 93
- 2022Flowformer: Linearizing Transformers with Conservation Flowscited by 69
- 2021Cross-Domain Gradient Discrepancy Minimization for Unsupervised Domain Adaptationcited by 67
- 2024ViT-CoMer: Vision Transformer with Convolutional Multi-scale Feature Interaction for Dense Predictionscited by 66
50 most cited of 60 All 60 (JSON)
Built on by
Not cited yet.