mlsanityData to 7 Oct 2026

SensorSCAN: Self-Supervised Learning and Deep Clustering for Fault Diagnosis in Chemical Processes

arXiv 2208.08879 ↗First posted 17 Aug 2022cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Modern industrial facilities generate large volumes of raw sensor data during the production process. This data is used to monitor and control the processes and can be analyzed to detect and predict process abnormalities. Typically, the data has to be annotated by experts in order to be used in predictive modeling. However, manual annotation of large amounts of data can be difficult in industrial settings. In this paper, we propose SensorSCAN, a novel method for unsupervised fault detection and diagnosis, designed for industrial chemical process monitoring. We demonstrate our model's performance on two publicly available datasets of the Tennessee Eastman Process with various faults. The results show that our method significantly outperforms existing approaches (+0.2-0.3 TPR for a fixed FPR) and effectively detects most of the process faults without expert annotation. Moreover, we show that the model fine-tuned on a small fraction of labeled data nearly reaches the performance of a SOTA model trained on the full dataset. We also demonstrate that our method is suitable for real-world applications where the number of faults is not known in advance. The code is available at https://github.com/AIRI-Institute/sensorscan.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 104 references that are in the map. First posted on arXiv 17 Aug 2022.

Builds on

28 of 104 references.

References · 28

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2020Language Models are Few-Shot Learnerscited by 32,199
  5. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  6. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  7. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  8. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  9. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  10. 2019When Does Label Smoothing Help?cited by 985
  11. 2015Unsupervised Deep Embedding for Clustering Analysiscited by 763
  12. 2021CoAtNet: Marrying Convolution and Attention for All Data Sizescited by 566
16 more
  1. 2018Invariant Information Clustering for Unsupervised Image Classification and Segmentationcited by 454
  2. 2020A Transformer-based Framework for Multivariate Time Series Representation Learningcited by 449
  3. 2020SCAN: Learning to Classify Images without Labelscited by 351
  4. 2021Time-Series Representation Learning via Temporal and Contextual Contrastingcited by 342
  5. 2020Contrastive Clusteringcited by 264
  6. 2016Towards K-means-friendly Spaces: Simultaneous Deep Learning and Clusteringcited by 237
  7. 2019MAD-GAN: Multivariate Anomaly Detection for Time Series Data with Generative Adversarial Networkscited by 176
  8. 2017Learning Discrete Representations via Information Maximizing Self-Augmented Trainingcited by 149
  9. 2017Data Augmentation of Wearable Sensor Data for Parkinson's Disease Monitoring using Convolutional Neural Networkscited by 130
  10. 2015Unsupervised and Semi-supervised Learning with Categorical Generative Adversarial Networkscited by 94
  11. 2018SOM-VAE: Interpretable Discrete Representation Learning on Time Seriescited by 59
  12. 2020Time Series Change Point Detection with Self-Supervised Contrastive Predictive Codingcited by 58
  13. 2020Improving Unsupervised Image Clustering With Robust Learningcited by 51
  14. 2017Discriminatively Boosted Image Clustering with Fully Convolutional Auto-Encoderscited by 32
  15. 2020GATCluster: Self-Supervised Gaussian-Attention Network for Image Clusteringcited by 32
  16. 2021Deep Semi-Supervised Learning for Time Series Classificationcited by 2

Built on by

Not cited yet.