mlsanityData to 7 Oct 2026

FTT-GRU: A Hybrid Fast Temporal Transformer with GRU for Remaining Useful Life Prediction

arXiv 2511.00564 ↗First posted 1 Nov 2025cs.LG cs.AI cs.SYcited by 1

Not on the map. Why?

Abstract (arXiv)

Accurate prediction of the remaining useful life (RUL) of industrial machinery is essential for reducing downtime and optimizing maintenance schedules. Existing approaches, such as long short-term memory (LSTM) networks and convolutional neural networks (CNNs), often struggle to model both global temporal dependencies and fine-grained degradation trends in multivariate sensor data. We propose a hybrid model, FTT-GRU, which combines a Fast Temporal Transformer (FTT) -- a lightweight Transformer variant using linearized attention via fast Fourier transform (FFT) -- with a gated recurrent unit (GRU) layer for sequential modeling. To the best of our knowledge, this is the first application of an FTT with a GRU for RUL prediction on NASA CMAPSS, enabling simultaneous capture of global and local degradation patterns in a compact architecture. On CMAPSS FD001, FTT-GRU attains RMSE 30.76, MAE 18.97, and R2=0.45, with 1.12 ms CPU latency at batch=1. Relative to the best published deep baseline (TCN--Attention), it improves RMSE by 1.16% and MAE by 4.00%. Training curves averaged over k=3 runs show smooth convergence with narrow 95% confidence bands, and ablations (GRU-only, FTT-only) support the contribution of both components. These results demonstrate that a compact Transformer-RNN hybrid delivers accurate and efficient RUL predictions on CMAPSS, making it suitable for real-time industrial prognostics.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 6 of its 22 references that are in the map. First posted on arXiv 1 Nov 2025.

Builds on

6 of 22 references.

References · 6

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  3. 2020Rethinking Attention with Performerscited by 1,584
  4. 2019Remaining Useful Lifetime Prediction via Deep Domain Adaptationcited by 30
  5. 2022Remaining Useful Life Prediction Using Temporal Deep Degradation Network for Complex Machinery with Attention-based Feature Extractioncited by 2
  6. 2023Ensemble Neural Networks for Remaining Useful Life (RUL) Predictioncited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.