mlsanityData to 14 Oct 2026

Finding One's Bearings in the Hyperparameter Landscape of a Wide-Kernel Convolutional Fault Detector

arXiv 2411.15191 ↗First posted 19 Nov 2024cs.LG cs.AI eess.SPcited by 0

Not on the map. Why?

Abstract (arXiv)

State-of-the-art algorithms are reported to be almost perfect at distinguishing the vibrations arising from healthy and damaged machine bearings, according to benchmark datasets at least. However, what about their application to new data? In this paper, we confirm that neural networks for bearing fault detection can be crippled by incorrect hyperparameterisation, and also that the correct hyperparameter settings can change when transitioning to new data. The paper combines multiple methods to explain the behaviour of the hyperparameters of a wide-kernel convolutional neural network and how to set them. Since guidance already exists for generic hyperparameters like minibatch size, we focus on how to set architecture-specific hyperparameters such as the width of the convolutional kernels, a topic which might otherwise be obscure. We reflect different data properties by fusing information from seven different benchmark datasets, and our results show that the kernel size in the first layer in particular is sensitive to changes in the data. Looking deeper, we use manipulated copies of one dataset in an attempt to spot why the kernel size sometimes needs to change. The relevance of sampling rate is studied by using different levels of resampling, and spectral content is studied by increasingly filtering out high frequencies. We find that, contrary to speculation in earlier work, high-frequency noise is not the main reason why a wide kernel is preferable to a narrow kernel. Finally, we conclude by stating clear guidance on how to set the hyperparameters of our neural network architecture to work effectively on new data.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 77 references that are in the map. First posted on arXiv 19 Nov 2024.

Builds on

12 of 77 references.

References · 12

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2020Efficient Transformers: A Surveycited by 790
  4. 2014Deep Speech: Scaling up end-to-end speech recognitioncited by 354
  5. 2016LSTM-based Encoder-Decoder for Multi-sensor Anomaly Detectioncited by 215
  6. 2016Noisy Activation Functionscited by 53
  7. 2017Pre-Processing-Free Gear Fault Diagnosis Using Small Datasets with Deep Convolutional Neural Network-Based Transfer Learningcited by 17
  8. 2024Explaining Bayesian Optimization by Shapley Values Facilitates Human-AI Collaborationcited by 12
  9. 2018Learning Multiple Defaults for Machine Learning Algorithmscited by 10
  10. 2024Hyperparameter Importance Analysis for Multi-Objective AutoMLcited by 9
  11. 2024Data-driven Machinery Fault Diagnosis: A Comprehensive Reviewcited by 7
  12. 2023FaultFormer: Pretraining Transformers for Adaptable Bearing Fault Classificationcited by 3

Built on by

Not cited yet.