mlsanityData to 14 Oct 2026

KEDformer:Knowledge Extraction Seasonal Trend Decomposition for Long-term Sequence Prediction

arXiv 2412.05421 ↗First posted 6 Dec 2024cs.LG cs.AI stat.MLcited by 1

Not on the map. Why?

Abstract (arXiv)

Time series forecasting is a critical task in domains such as energy, finance, and meteorology, where accurate long-term predictions are essential. While Transformer-based models have shown promise in capturing temporal dependencies, their application to extended sequences is limited by computational inefficiencies and limited generalization. In this study, we propose KEDformer, a knowledge extraction-driven framework that integrates seasonal-trend decomposition to address these challenges. KEDformer leverages knowledge extraction methods that focus on the most informative weights within the self-attention mechanism to reduce computational overhead. Additionally, the proposed KEDformer framework decouples time series into seasonal and trend components. This decomposition enhances the model's ability to capture both short-term fluctuations and long-term patterns. Extensive experiments on five public datasets from energy, transportation, and weather domains demonstrate the effectiveness and competitiveness of KEDformer, providing an efficient solution for long-term time series forecasting.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 31 of its 58 references that are in the map. First posted on arXiv 6 Dec 2024.

Builds on

31 of 58 references.

References · 31

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2020Longformer: The Long-Document Transformercited by 3,413
  5. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  6. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  7. 2020Reformer: The Efficient Transformercited by 1,668
  8. 2020Linformer: Self-Attention with Linear Complexitycited by 1,474
  9. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
  10. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,013
  11. 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 761
  12. 2021FNet: Mixing Tokens with Fourier Transformscited by 347
19 more
  1. 2020Synthesizer: Rethinking Self-Attention in Transformer Modelscited by 205
  2. 2022ETSformer: Exponential Smoothing Transformers for Time-series Forecastingcited by 148
  3. 2020Deep Transformer Models for Time Series Forecasting: The Influenza Prevalence Casecited by 129
  4. 2021Sparse is Enough in Scaling Transformerscited by 86
  5. 2020RobustTAD: Robust Time Series Anomaly Detection via Decomposition and Convolutional Neural Networkscited by 55
  6. 2018Deep Learning with Long Short-Term Memory for Time Series Predictioncited by 39
  7. 2023A Survey on Efficient Training of Transformerscited by 39
  8. 2017Long-Term Mobile Traffic Forecasting Using Deep Spatio-Temporal Neural Networkscited by 28
  9. 2021Cross-modal Knowledge Distillation for Vision-to-Sensor Action Recognitioncited by 25
  10. 2021SSDNet: State Space Decomposition Neural Network for Time Series Forecastingcited by 15
  11. 2023A Multi-Scale Decomposition MLP-Mixer for Time Series Analysiscited by 10
  12. 2022TILDE-Q: A Transformation Invariant Loss Function for Time-Series Forecastingcited by 8
  13. 2022Progressive Cross-modal Knowledge Distillation for Human Action Recognitioncited by 6
  14. 2021Short-term Renewable Energy Forecasting in Greece using Prophet Decomposition and Tree-based Ensemblescited by 4
  15. 2023Masked Multi-Step Probabilistic Forecasting for Short-to-Mid-Term Electricity Demandcited by 4
  16. 2023TLNets: Transformation Learning Networks for long-range time-series predictioncited by 2
  17. 2022Temporal Spatial Decomposition and Fusion Network for Time Series Forecastingcited by 1
  18. 2023A Novel Method Combines Moving Fronts, Data Decomposition and Deep Learning to Forecast Intricate Time Seriescited by 1
  19. 2024A Combination Model Based on Sequential General Variational Mode Decomposition Method for Time Series Predictioncited by 1

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.