mlsanityData to 14 Oct 2026

Real-time Adaptation for Condition Monitoring Signal Prediction using Label-aware Neural Processes

arXiv 2403.16377 ↗First posted 25 Mar 2024cs.LG cs.SY eess.SYcited by 3

Not on the map. Why?

Abstract (arXiv)

Building a predictive model that rapidly adapts to real-time condition monitoring (CM) signals is critical for engineering systems/units. Unfortunately, many current methods suffer from a trade-off between representation power and agility in online settings. For instance, parametric methods that assume an underlying functional form for CM signals facilitate efficient online prediction updates. However, this simplification leads to vulnerability to model specifications and an inability to capture complex signals. On the other hand, approaches based on over-parameterized or non-parametric models can excel at explaining complex nonlinear signals, but real-time updates for such models pose a challenging task. In this paper, we propose a neural process-based approach that addresses this trade-off. It encodes available observations within a CM signal into a representation space and then reconstructs the signal's history and evolution for prediction. Once trained, the model can encode an arbitrary number of observations without requiring retraining, enabling on-the-spot real-time predictions along with quantified uncertainty and can be readily updated as more online data is gathered. Furthermore, our model is designed to incorporate qualitative information (i.e., labels) from individual units. This integration not only enhances individualized predictions for each unit but also enables joint inference for both signals and their associated labels. Numerical studies on both synthetic and real-world data in reliability engineering highlight the advantageous features of our model in real-time adaptation, enhanced signal prediction with uncertainty quantification, and joint prediction for labels and signals.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 25 of its 56 references that are in the map. First posted on arXiv 25 Mar 2024.

Builds on

25 of 56 references.

References · 25

  1. 2017Attention Is All You Needcited by 60,361
  2. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
  3. 2014Semi-Supervised Learning with Deep Generative Modelscited by 496
  4. 2018Conditional Neural Processescited by 426
  5. 2018Neural Processescited by 311
  6. 2019Attentive Neural Processescited by 283
  7. 2017Advances in Variational Inferencecited by 236
  8. 2018Using Trusted Data to Train Deep Networks on Labels Corrupted by Severe Noisecited by 216
  9. 2019Convolutional Conditional Neural Processescited by 142
  10. 2022Transformer Neural Processes: Uncertainty-Aware Meta Learning Via Sequence Modelingcited by 127
  11. 2019Sequential Neural Processescited by 55
  12. 2020Bootstrapping Neural Processescited by 40
13 more
  1. 2017Learning Deep Networks from Noisy Labels with Dropout Regularizationcited by 32
  2. 2021Convolutional conditional neural processes for local climate downscalingcited by 29
  3. 2022NP-Match: When Neural Processes meet Semi-Supervised Learningcited by 25
  4. 2022The Neural Process Family: Survey, Applications and Perspectivescited by 23
  5. 2022Neural Processes with Stochastic Attention: Paying more attention to the context datasetcited by 16
  6. 2020Robustifying Sequential Neural Processescited by 15
  7. 2022scikit-fda: A Python Package for Functional Data Analysiscited by 12
  8. 2021Efficient Gaussian Neural Processes for Regressioncited by 10
  9. 2019Minimizing Negative Transfer of Knowledge in Multivariate Gaussian Processes: A Scalable and Regularized Approachcited by 7
  10. 2022Meta-Learning Regrasping Strategies for Physical-Agnostic Objectscited by 7
  11. 2018Neural Processes Mixed-Effect Models for Deep Normative Modeling of Clinical Neuroimaging Datacited by 6
  12. 2022Category-Agnostic 6D Pose Estimation with Conditional Neural Processescited by 4
  13. 2019Functional Principal Component Analysis for Extrapolating Multi-stream Longitudinal Datacited by 1

Built on by

Cited by year

Citing papers per year: 2025: 3.

3 papers.