FRWKV:Frequency-Domain Linear Attention for Long-Term Time Series Forecasting
Not on the map. Why?
Abstract (arXiv)
Traditional Transformers face a major bottleneck in long-sequence time series forecasting due to their quadratic complexity (O(T2)) and their limited ability to effectively exploit frequency-domain information. Inspired by RWKV's O(T) linear attention and frequency-domain modeling, we propose FRWKV, a frequency-domain linear-attention framework that overcomes these limitations. Our model integrates linear attention mechanisms with frequency-domain analysis, achieving O(T) computational complexity in the attention path while exploiting spectral information to enhance temporal feature representations for scalable long-sequence modeling. Across eight real-world datasets, FRWKV achieves a first-place average rank. Our ablation studies confirm the critical roles of both the linear attention and frequency-encoder components. This work demonstrates the powerful synergy between linear attention and frequency analysis, establishing a new paradigm for scalable time series modeling. Code is available at this repository: https://github.com/yangqingyuan-byte/FRWKV.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 17 of its 23 references that are in the map. First posted on arXiv 8 Dec 2025.
Builds on
17 of 23 references.
References · 17
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
- 2020Rethinking Attention with Performerscited by 1,601
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
- 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
- 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,013
- 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
- 2023RWKV: Reinventing RNNs for the Transformer Eracited by 827
- 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 753
- 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 346
- 2017A Dual-Stage Attention-Based Recurrent Neural Network for Time Series Predictioncited by 245
- 2023Frequency-domain MLPs are More Effective Learners in Time Series Forecastingcited by 172
- 2025RWKV-7 "Goose" with Expressive Dynamic State Evolutioncited by 141
5 more
- 2017Conditional Time Series Forecasting with Convolutional Neural Networkscited by 123
- 2024RWKV-TS: Beyond Traditional Recurrent Neural Network for Time Series Taskscited by 22
- 2025FreEformer: Frequency Enhanced Transformer for Multivariate Time Series Forecastingcited by 18
- 2023Dynamic Frequency Domain Graph Convolutional Network for Traffic Forecastingcited by 10
- 2020Gaussian process imputation of multiple financial seriescited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.