mlsanityData to 14 Oct 2026

Time-Series Foundation Model Embeddings for Remaining Useful Life Estimation

arXiv 2606.11990 ↗First posted 10 Jun 2026cs.LG cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Remaining Useful Life (RUL) prediction is essential for industrial predictive maintenance, yet many learning-based approaches rely on extensive feature engineering or large labeled datasets to train task-specific sequence models. In this work, we introduce a lightweight learning approach, in which we leverage a frozen pretrained time-series foundation model (TSFM) and combine it with a small regression head for RUL estimation from multivariate sensor streams. More specifically, we use Chronos-2 as a frozen backbone to extract context window features and train a lightweight regression neural network for RUL prediction. Experiments on real-world industrial sensor data from two device types show that Chronos-2 features consistently improve over recurrent, convolutional, Transformer-based, and gradient-boosting baselines under the same preprocessing and evaluation protocol. We further analyze the impact of context length and find that performance improves significantly with longer histories, indicating that TSFM representation offer a practical and data-efficient alternative for RUL estimation in industrial settings.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 15 of its 27 references that are in the map. First posted on arXiv 10 Jun 2026.

Builds on

15 of 27 references.

References · 15

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  4. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
  5. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  6. 2024Chronos: Learning the Language of Time Seriescited by 759
  7. 2023A decoder-only foundation model for time-series forecastingcited by 692
  8. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
  9. 2016Temporal Convolutional Networks: A Unified Approach to Action Segmentationcited by 199
  10. 2025Chronos-2: From Univariate to Universal Forecastingcited by 194
  11. 2025VisionTS++: Cross-Modal Time Series Foundation Model with Continual Pre-trained Vision Backbonescited by 12
  12. 2022A Benchmark for Unsupervised Anomaly Detection in Multi-Agent Trajectoriescited by 4
3 more
  1. 2024Supervised Contrastive Learning based Dual-Mixer Model for Remaining Useful Life Predictioncited by 3
  2. 2018Adversarial Signal Denoising with Encoder-Decoder Networkscited by 2
  3. 2024Spatio-temporal Attention-based Hidden Physics-informed Neural Network for Remaining Useful Life Predictioncited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.