TimeSieve: Extracting Temporal Dynamics through Information Bottlenecks
Not on the map. Why?
Abstract (arXiv)
Time series forecasting has become an increasingly popular research area due to its critical applications in various real-world domains such as traffic management, weather prediction, and financial analysis. Despite significant advancements, existing models face notable challenges, including the necessity of manual hyperparameter tuning for different datasets, and difficulty in effectively distinguishing signal from redundant features in data characterized by strong seasonality. These issues hinder the generalization and practical application of time series forecasting models. To solve this issues, we propose an innovative time series forecasting model TimeSieve designed to address these challenges. Our approach employs wavelet transforms to preprocess time series data, effectively capturing multi-scale features without the need for additional parameters or manual hyperparameter tuning. Additionally, we introduce the information bottleneck theory that filters out redundant features from both detail and approximation coefficients, retaining only the most predictive information. This combination reduces significantly improves the model's accuracy. Extensive experiments demonstrate that our model outperforms existing state-of-the-art methods on 70% of the datasets, achieving higher predictive accuracy and better generalization across diverse datasets. Our results validate the effectiveness of our approach in addressing the key challenges in time series forecasting, paving the way for more reliable and efficient predictive models in practical applications. The code for our model is available at https://github.com/xll0328/TimeSieve.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 12 of its 24 references that are in the map. First posted on arXiv 7 Jun 2024.
Builds on
12 of 24 references.
References · 12
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
- 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 869
- 2015Deep Learning and the Information Bottleneck Principlecited by 793
- 2017Opening the Black Box of Deep Neural Networks via Informationcited by 494
- 2015LSTM: A Search Space Odysseycited by 315
- 2019Financial Time Series Forecasting with Deep Learning : A Systematic Literature Review: 2005-2019cited by 270
- 2017Gate-Variants of Gated Recurrent Unit (GRU) Neural Networkscited by 239
- 2023Koopa: Learning Non-stationary Time Series Dynamics with Koopman Predictorscited by 110
- 2022Multimodal Information Bottleneck: Learning Minimal Sufficient Unimodal and Multimodal Representationscited by 48
- 2023A Unified Framework of Graph Information Bottleneck for Robustness and Membership Privacycited by 14
Built on by
Citing papers per year: 2025: 2.
2 papers.