mlsanityData to 14 Oct 2026

Temporal Spatial Decomposition and Fusion Network for Time Series Forecasting

arXiv 2210.03122 ↗First posted 6 Oct 2022cs.LG cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Feature engineering is required to obtain better results for time series forecasting, and decomposition is a crucial one. One decomposition approach often cannot be used for numerous forecasting tasks since the standard time series decomposition lacks flexibility and robustness. Traditional feature selection relies heavily on preexisting domain knowledge, has no generic methodology, and requires a lot of labor. However, most time series prediction models based on deep learning typically suffer from interpretability issue, so the "black box" results lead to a lack of confidence. To deal with the above issues forms the motivation of the thesis. In the paper we propose TSDFNet as a neural network with self-decomposition mechanism and an attentive feature fusion mechanism, It abandons feature engineering as a preprocessing convention and creatively integrates it as an internal module with the deep model. The self-decomposition mechanism empowers TSDFNet with extensible and adaptive decomposition capabilities for any time series, users can choose their own basis functions to decompose the sequence into temporal and generalized spatial dimensions. Attentive feature fusion mechanism has the ability to capture the importance of external variables and the causality with target variables. It can automatically suppress the unimportant features while enhancing the effective ones, so that users do not have to struggle with feature selection. Moreover, TSDFNet is easy to look into the "black box" of the deep neural network by feature visualization and analyze the prediction results. We demonstrate performance improvements over existing widely accepted models on more than a dozen datasets, and three experiments showcase the interpretability of TSDFNet.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 16 of its 43 references that are in the map. First posted on arXiv 6 Oct 2022.

Builds on

16 of 43 references.

References · 16

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2016Layer Normalizationcited by 5,669
  4. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
  5. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
  6. 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
  7. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
  8. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  9. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  10. 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,476
  11. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,013
  12. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 879
4 more
  1. 2016Language Modeling with Gated Convolutional Networkscited by 702
  2. 2019Sparse Sequence-to-Sequence Modelscited by 170
  3. 2015A Theoretically Grounded Application of Dropout in Recurrent Neural Networkscited by 161
  4. 2017Residual LSTM: Design of a Deep Recurrent Architecture for Distant Speech Recognitioncited by 19

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.