mlsanityData to 14 Oct 2026

FRWKV:Frequency-Domain Linear Attention for Long-Term Time Series Forecasting

arXiv 2512.07539 ↗First posted 8 Dec 2025cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Traditional Transformers face a major bottleneck in long-sequence time series forecasting due to their quadratic complexity (O(T2)) and their limited ability to effectively exploit frequency-domain information. Inspired by RWKV's O(T) linear attention and frequency-domain modeling, we propose FRWKV, a frequency-domain linear-attention framework that overcomes these limitations. Our model integrates linear attention mechanisms with frequency-domain analysis, achieving O(T) computational complexity in the attention path while exploiting spectral information to enhance temporal feature representations for scalable long-sequence modeling. Across eight real-world datasets, FRWKV achieves a first-place average rank. Our ablation studies confirm the critical roles of both the linear attention and frequency-encoder components. This work demonstrates the powerful synergy between linear attention and frequency analysis, establishing a new paradigm for scalable time series modeling. Code is available at this repository: https://github.com/yangqingyuan-byte/FRWKV.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 17 of its 23 references that are in the map. First posted on arXiv 8 Dec 2025.

Builds on

17 of 23 references.

References · 17

  1. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  2. 2020Rethinking Attention with Performerscited by 1,601
  3. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
  4. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
  5. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,013
  6. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
  7. 2023RWKV: Reinventing RNNs for the Transformer Eracited by 827
  8. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 753
  9. 2024TimeMixer: Decomposable Multiscale Mixing for Time Series Forecastingcited by 346
  10. 2017A Dual-Stage Attention-Based Recurrent Neural Network for Time Series Predictioncited by 245
  11. 2023Frequency-domain MLPs are More Effective Learners in Time Series Forecastingcited by 172
  12. 2025RWKV-7 "Goose" with Expressive Dynamic State Evolutioncited by 141
5 more
  1. 2017Conditional Time Series Forecasting with Convolutional Neural Networkscited by 123
  2. 2024RWKV-TS: Beyond Traditional Recurrent Neural Network for Time Series Taskscited by 22
  3. 2025FreEformer: Frequency Enhanced Transformer for Multivariate Time Series Forecastingcited by 18
  4. 2023Dynamic Frequency Domain Graph Convolutional Network for Traffic Forecastingcited by 10
  5. 2020Gaussian process imputation of multiple financial seriescited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.