mlsanityData to 7 Oct 2026

BEAT: Balanced Frequency Adaptive Tuning for Long-Term Time-Series Forecasting

arXiv 2501.19065 ↗First posted 31 Jan 2025cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Long-term time-series forecasting supports a wide range of applications, including weather prediction and electricity demand planning. Frequency-domain methods address this task by decomposing observations into components that describe temporal variations at different scales. However, separate representations do not by themselves provide an explicit mechanism for adjusting the training emphasis across components. Under a shared forecasting objective, the frequency-specific networks can retain different levels of coefficient prediction error, motivating an error-dependent adjustment to their gradients. To this end, we propose BEAT (Balanced frEquency Adaptive Tuning), a framework that combines frequency-specific error monitoring with adaptive gradient modulation. We design a Frequency-Specific Monitor that compares predicted and target wavelet coefficients in a common normalized space and expresses each discrepancy relative to a reference error computed from the detail components. We further introduce a Dynamical Gradient Balancer that converts these ratios into positive, bounded coefficients. Components with higher relative errors receive larger gradient weights, whereas those with lower relative errors receive smaller weights. A shared modulation-strength parameter controls the departure from unmodulated training, and the monitoring and balancing operations are used only during training. Experiments on seven real-world datasets show that BEAT achieves competitive performance against state-of-the-art forecasting methods.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 35 of its 53 references that are in the map. First posted on arXiv 31 Jan 2025.

Builds on

35 of 53 references.

References · 35

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  4. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
  5. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  6. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
  7. 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,447
  8. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
  9. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
  10. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
  11. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 869
  12. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 744
23 more
  1. 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 680
  2. 2019Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecastingcited by 606
  3. 2015Recent Advances in Convolutional Neural Networkscited by 360
  4. 2021SCINet: Time Series Modeling and Forecasting with Sample Convolution and Interactioncited by 335
  5. 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 333
  6. 2023Long-term Forecasting with TiDE: Time-series Dense Encodercited by 327
  7. 2022Balanced Multimodal Learning via On-the-fly Gradient Modulationcited by 259
  8. 2023TSMixer: An All-MLP Architecture for Time Series Forecastingcited by 232
  9. 2024Deep Time Series Models: A Comprehensive Survey and Benchmarkcited by 191
  10. 2023FITS: Modeling Time Series with 10k Parameterscited by 185
  11. 2023Frequency-domain MLPs are More Effective Learners in Time Series Forecastingcited by 170
  12. 2022FiLM: Frequency improved Legendre Memory Model for Long-term Time Series Forecastingcited by 147
  13. 2024FreDF: Learning to Forecast in the Frequency Domaincited by 77
  14. 2024TSLANet: Rethinking Transformers for Time Series Representation Learningcited by 71
  15. 2018Multilevel Wavelet Decomposition Network for Interpretable Time Series Analysiscited by 61
  16. 2024Fredformer: Frequency Debiased Transformer for Time Series Forecastingcited by 43
  17. 2019Deep Learning for Time Series Forecasting: The Electric Load Casecited by 31
  18. 2024Enhancing Foundation Models for Time Series Forecasting via Wavelet-based Tokenizationcited by 26
  19. 2024WPMixer: Efficient Multi-Resolution Mixing for Long-Term Time Series Forecastingcited by 25
  20. 2024Revisiting VAE for Unsupervised Time Series Anomaly Detection: A Frequency Perspectivecited by 22
  21. 2024MonoMAE: Enhancing Monocular 3D Detection through Depth-Aware Masked Autoencoderscited by 15
  22. 2024Weakly Supervised Monocular 3D Detection with a Single-View Imagecited by 10
  23. 2022Edge-Varying Fourier Graph Networks for Multivariate Time Series Forecastingcited by 3

Built on by

Not cited yet.