Temporal Spatial Decomposition and Fusion Network for Time Series Forecasting
Not on the map. Why?
Abstract (arXiv)
Feature engineering is required to obtain better results for time series forecasting, and decomposition is a crucial one. One decomposition approach often cannot be used for numerous forecasting tasks since the standard time series decomposition lacks flexibility and robustness. Traditional feature selection relies heavily on preexisting domain knowledge, has no generic methodology, and requires a lot of labor. However, most time series prediction models based on deep learning typically suffer from interpretability issue, so the "black box" results lead to a lack of confidence. To deal with the above issues forms the motivation of the thesis. In the paper we propose TSDFNet as a neural network with self-decomposition mechanism and an attentive feature fusion mechanism, It abandons feature engineering as a preprocessing convention and creatively integrates it as an internal module with the deep model. The self-decomposition mechanism empowers TSDFNet with extensible and adaptive decomposition capabilities for any time series, users can choose their own basis functions to decompose the sequence into temporal and generalized spatial dimensions. Attentive feature fusion mechanism has the ability to capture the importance of external variables and the causality with target variables. It can automatically suppress the unimportant features while enhancing the effective ones, so that users do not have to struggle with feature selection. Moreover, TSDFNet is easy to look into the "black box" of the deep neural network by feature visualization and analyze the prediction results. We demonstrate performance improvements over existing widely accepted models on more than a dozen datasets, and three experiments showcase the interpretability of TSDFNet.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 16 of its 43 references that are in the map. First posted on arXiv 6 Oct 2022.
Builds on
16 of 43 references.
References · 16
- 2017Attention Is All You Needcited by 60,361
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2016Layer Normalizationcited by 5,669
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
- 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,476
- 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,013
- 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 879
4 more
- 2016Language Modeling with Gated Convolutional Networkscited by 702
- 2019Sparse Sequence-to-Sequence Modelscited by 170
- 2015A Theoretically Grounded Application of Dropout in Recurrent Neural Networkscited by 161
- 2017Residual LSTM: Design of a Deep Recurrent Architecture for Distant Speech Recognitioncited by 19
Built on by
Citing papers per year: 2024: 1.
1 paper.