mlsanityData to 7 Oct 2026

Spectral Aliasing Pretext: A novel task for Self-Supervised fault diagnosis in rotating machinery

arXiv 2608.05705 ↗First posted 6 Aug 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Deep learning is a new way for machinery fault diagnosis but requires extensive labeled data, a scarce resource in industrial settings. We propose Spectral Aliasing Pretext (SAP), a self-supervised learning method that pretrains models on unlabeled vibration data by exploiting spectral aliasing. We deliberately undersample signals to create folded spectrum, then train a Transformer to reconstruct the original unfolded spectrum. This pretext task forces the model to learn frequency-domain invariants characteristic of mechanical faults, without potentially destructive augmentations. Experiments on the CWRU dataset show that SAP learns stable and highly discriminative representations. In a linear probing setting, SAP quickly achieves very high classification performance with only a small fraction of labeled data and low variance. In contrast, full fine-tuning, including fully supervised training, does not lead to more stable or better results. Overall, these findings suggest that SAP combined with linear probing can be more effective and reliable than fully supervised training for fault diagnosis with limited labeled data.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 16 references that are in the map. First posted on arXiv 6 Aug 2026.

Builds on

10 of 16 references.

References · 10

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  3. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  4. 2022Transformers in Time Series: A Surveycited by 489
  5. 2021TS2Vec: Towards Universal Representation of Time Seriescited by 463
  6. 2021Time-Series Representation Learning via Temporal and Contextual Contrastingcited by 342
  7. 2023A Cookbook of Self-Supervised Learningcited by 248
  8. 2024Masked Image Modeling: A Surveycited by 28
  9. 2023FaultFormer: Pretraining Transformers for Adaptable Bearing Fault Classificationcited by 3
  10. 2025UniFault: A Fault Diagnosis Foundation Model from Bearing Datacited by 3

Built on by

Not cited yet.