mlsanityData to 14 Oct 2026

Transformer Vibration Forecasting for Advancing Rail Safety and Maintenance 4.0

arXiv 2501.11730 ↗First posted 20 Jan 2025cs.LG cs.AI stat.MLcited by 1

Not on the map. Why?

Abstract (arXiv)

Maintaining railway axles is critical to preventing severe accidents and financial losses. The railway industry is increasingly interested in advanced condition monitoring techniques to enhance safety and efficiency, moving beyond traditional periodic inspections toward Maintenance 4.0. This study introduces a robust Deep Autoregressive solution that integrates seamlessly with existing systems to avert mechanical failures. Our approach simulates and predicts vibration signals under various conditions and fault scenarios, improving dataset robustness for more effective detection systems. These systems can alert maintenance needs, preventing accidents preemptively. We use experimental vibration signals from accelerometers on train axles. Our primary contributions include a transformer model, ShaftFormer, designed for processing time series data, and an alternative model incorporating spectral methods and enhanced observation models. Simulating vibration signals under diverse conditions mitigates the high cost of obtaining experimental signals for all scenarios. Given the non-stationary nature of railway vibration signals, influenced by speed and load changes, our models address these complexities, offering a powerful tool for predictive maintenance in the rail industry.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 7 of its 26 references that are in the map. First posted on arXiv 20 Jan 2025.

Builds on

7 of 26 references.

References · 7

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  3. 2022Transformer Language Models without Positional Encodings Still Learn Positional Informationcited by 150
  4. 2015Deep Convolutional Inverse Graphics Networkcited by 121
  5. 2022Fast Vision Transformers with HiLo Attentioncited by 78
  6. 2021Deep Autoregressive Models with Spectral Attentioncited by 9
  7. 2022Detecting train driveshaft damages using accelerometer signals and Differential Convolutional Neural Networkscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.