KEDformer:Knowledge Extraction Seasonal Trend Decomposition for Long-term Sequence Prediction
Not on the map. Why?
Abstract (arXiv)
Time series forecasting is a critical task in domains such as energy, finance, and meteorology, where accurate long-term predictions are essential. While Transformer-based models have shown promise in capturing temporal dependencies, their application to extended sequences is limited by computational inefficiencies and limited generalization. In this study, we propose KEDformer, a knowledge extraction-driven framework that integrates seasonal-trend decomposition to address these challenges. KEDformer leverages knowledge extraction methods that focus on the most informative weights within the self-attention mechanism to reduce computational overhead. Additionally, the proposed KEDformer framework decouples time series into seasonal and trend components. This decomposition enhances the model's ability to capture both short-term fluctuations and long-term patterns. Extensive experiments on five public datasets from energy, transportation, and weather domains demonstrate the effectiveness and competitiveness of KEDformer, providing an efficient solution for long-term time series forecasting.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 31 of its 58 references that are in the map. First posted on arXiv 6 Dec 2024.
Builds on
31 of 58 references.
References · 31
- 2017Attention Is All You Needcited by 60,361
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Longformer: The Long-Document Transformercited by 3,413
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
- 2020Reformer: The Efficient Transformercited by 1,668
- 2020Linformer: Self-Attention with Linear Complexitycited by 1,474
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
- 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,013
- 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 761
- 2021FNet: Mixing Tokens with Fourier Transformscited by 347
19 more
- 2020Synthesizer: Rethinking Self-Attention in Transformer Modelscited by 205
- 2022ETSformer: Exponential Smoothing Transformers for Time-series Forecastingcited by 148
- 2020Deep Transformer Models for Time Series Forecasting: The Influenza Prevalence Casecited by 129
- 2021Sparse is Enough in Scaling Transformerscited by 86
- 2020RobustTAD: Robust Time Series Anomaly Detection via Decomposition and Convolutional Neural Networkscited by 55
- 2018Deep Learning with Long Short-Term Memory for Time Series Predictioncited by 39
- 2023A Survey on Efficient Training of Transformerscited by 39
- 2017Long-Term Mobile Traffic Forecasting Using Deep Spatio-Temporal Neural Networkscited by 28
- 2021Cross-modal Knowledge Distillation for Vision-to-Sensor Action Recognitioncited by 25
- 2021SSDNet: State Space Decomposition Neural Network for Time Series Forecastingcited by 15
- 2023A Multi-Scale Decomposition MLP-Mixer for Time Series Analysiscited by 10
- 2022TILDE-Q: A Transformation Invariant Loss Function for Time-Series Forecastingcited by 8
- 2022Progressive Cross-modal Knowledge Distillation for Human Action Recognitioncited by 6
- 2021Short-term Renewable Energy Forecasting in Greece using Prophet Decomposition and Tree-based Ensemblescited by 4
- 2023Masked Multi-Step Probabilistic Forecasting for Short-to-Mid-Term Electricity Demandcited by 4
- 2023TLNets: Transformation Learning Networks for long-range time-series predictioncited by 2
- 2022Temporal Spatial Decomposition and Fusion Network for Time Series Forecastingcited by 1
- 2023A Novel Method Combines Moving Fronts, Data Decomposition and Deep Learning to Forecast Intricate Time Seriescited by 1
- 2024A Combination Model Based on Sequential General Variational Mode Decomposition Method for Time Series Predictioncited by 1
Built on by
Citing papers per year: 2025: 1.
1 paper.