Supervised Contrastive Learning based Dual-Mixer Model for Remaining Useful Life Prediction
Not on the map. Why?
Abstract (arXiv)
The problem of the Remaining Useful Life (RUL) prediction, aiming at providing an accurate estimate of the remaining time from the current predicting moment to the complete failure of the device, has gained significant attention from researchers in recent years. In this paper, to overcome the shortcomings of rigid combination for temporal and spatial features in most existing RUL prediction approaches, a spatial-temporal homogeneous feature extractor, named Dual-Mixer model, is firstly proposed. Flexible layer-wise progressive feature fusion is employed to ensure the homogeneity of spatial-temporal features and enhance the prediction accuracy. Secondly, the Feature Space Global Relationship Invariance (FSGRI) training method is introduced based on supervised contrastive learning. This method maintains the consistency of relationships among sample features with their degradation patterns during model training, simplifying the subsequently regression task in the output layer and improving the model's performance in RUL prediction. Finally, the effectiveness of the proposed method is validated through comparisons with other latest research works on the C-MAPSS dataset. The Dual-Mixer model demonstrates superiority across most metrics, while the FSGRI training method shows an average improvement of 7.00% and 2.41% in RMSE and MAPE, respectively, for all baseline models. Our experiments and model code are publicly available at https://github.com/fuen1590/PhmDeepLearningProjects.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 9 of its 40 references that are in the map. First posted on arXiv 29 Jan 2024.
Builds on
9 of 40 references.
References · 9
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2016Gaussian Error Linear Units (GELUs)cited by 3,431
- 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,441
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
- 2021Unsupervised Representation Learning for Time Series with Temporal Neighborhood Codingcited by 223
- 2019Understanding and Improving Layer Normalizationcited by 213
- 2022Less Is More: Fast Multivariate Time Series Forecasting with Light Sampling-oriented MLP Structurescited by 158
- 2023TSMixer: Lightweight MLP-Mixer Model for Multivariate Time Series Forecastingcited by 136
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Time-Series Foundation Model Embeddings for Remaining Useful Life Estimationcited by 1
- 2026PEFT-MuTS: A Multivariate Parameter-Efficient Fine-Tuning Framework for Remaining Useful Life Prediction based on Cross-domain Time Series Representation Modelcited by 0
- 2026MsFormer: Enabling Robust Predictive Maintenance Services for Industrial Devicescited by 0
- 2026Time-Series Foundation Model Embeddings for Remaining Useful Life Estimation10 Jun 2026
- 2026MsFormer: Enabling Robust Predictive Maintenance Services for Industrial Devices24 Mar 2026
- 2026PEFT-MuTS: A Multivariate Parameter-Efficient Fine-Tuning Framework for Remaining Useful Life Prediction based on Cross-domain Time Series Representation Model30 Jan 2026