mlsanityData to 14 Oct 2026

FreqCondNorm: Towards Cross-domain Predictive Maintenance through a Frequency-Conditioned Transformer Foundation Model

arXiv 2609.20535 ↗First posted 17 Sep 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Deep learning predictive maintenance models suffer from poor transferability across machines and operating conditions, especially when labelled data are scarce and signals span five orders of magnitude in sampling frequency (1 Hz to ~100 kHz). We propose FreqCondNorm, a Transformer-based architecture that introduces a FiLM-style frequency-conditioned normalization layer to unify heterogeneous time-series within a single model. The architecture is pretrained on five public predictive maintenance datasets (CWRU, MFPT, UOC18, PRONOSTIA, CMAPSS) using masked auto-encoding and contrastive learning with balanced domain sampling. On fault diagnosis, the model achieves 99.2% accuracy on CWRU (+6.4 pp over CNN) and 82.1% zero-shot accuracy on MFPT, demonstrating strong transfer across sampling frequencies. However, the approach does not improve remaining useful life prediction, suggesting a mismatch between pretraining and RUL objectives that warrants future investigation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 18 references that are in the map. First posted on arXiv 17 Sep 2026.

Builds on

12 of 18 references.

References · 12

  1. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  2. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  3. 2015Domain-Adversarial Training of Neural Networkscited by 3,044
  4. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  5. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  6. 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 482
  7. 2021TS2Vec: Towards Universal Representation of Time Seriescited by 471
  8. 2023SimMTM: A Simple Pre-Training Framework for Masked Time-Series Modelingcited by 115
  9. 2023NuTime: Numerically Multi-Scaled Embedding for Large-Scale Time-Series Pretrainingcited by 20
  10. 2024LLM-based Framework for Bearing Fault Diagnosiscited by 5
  11. 2025Towards a more realistic evaluation of machine learning models for bearing fault diagnosiscited by 4
  12. 2025UniFault: A Fault Diagnosis Foundation Model from Bearing Datacited by 3

Built on by

Not cited yet.