mlsanityData to 7 Oct 2026

Supervised Contrastive Learning based Dual-Mixer Model for Remaining Useful Life Prediction

arXiv 2401.16462 ↗First posted 29 Jan 2024cs.LG cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

The problem of the Remaining Useful Life (RUL) prediction, aiming at providing an accurate estimate of the remaining time from the current predicting moment to the complete failure of the device, has gained significant attention from researchers in recent years. In this paper, to overcome the shortcomings of rigid combination for temporal and spatial features in most existing RUL prediction approaches, a spatial-temporal homogeneous feature extractor, named Dual-Mixer model, is firstly proposed. Flexible layer-wise progressive feature fusion is employed to ensure the homogeneity of spatial-temporal features and enhance the prediction accuracy. Secondly, the Feature Space Global Relationship Invariance (FSGRI) training method is introduced based on supervised contrastive learning. This method maintains the consistency of relationships among sample features with their degradation patterns during model training, simplifying the subsequently regression task in the output layer and improving the model's performance in RUL prediction. Finally, the effectiveness of the proposed method is validated through comparisons with other latest research works on the C-MAPSS dataset. The Dual-Mixer model demonstrates superiority across most metrics, while the FSGRI training method shows an average improvement of 7.00% and 2.41% in RMSE and MAPE, respectively, for all baseline models. Our experiments and model code are publicly available at https://github.com/fuen1590/PhmDeepLearningProjects.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 9 of its 40 references that are in the map. First posted on arXiv 29 Jan 2024.

Builds on

9 of 40 references.

References · 9

  1. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  2. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  3. 2016Gaussian Error Linear Units (GELUs)cited by 3,431
  4. 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,441
  5. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
  6. 2021Unsupervised Representation Learning for Time Series with Temporal Neighborhood Codingcited by 223
  7. 2019Understanding and Improving Layer Normalizationcited by 213
  8. 2022Less Is More: Fast Multivariate Time Series Forecasting with Light Sampling-oriented MLP Structurescited by 158
  9. 2023TSMixer: Lightweight MLP-Mixer Model for Multivariate Time Series Forecastingcited by 136

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.