mlsanityData to 7 Oct 2026

CORD: Learning Reusable Degradation Representations Across Heterogeneous Physical Systems

arXiv 2609.39784 ↗First posted 30 Sep 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Can heterogeneous physical degradation systems benefit from joint pretraining and move beyond system-specific prognostics toward reusable cross-system representation learning? CORD combines type-specific observation interfaces with a shared degradation backbone. Its two self-supervised objectives learn at complementary scales: Intra-Observation Structure Modeling (ISM) captures structure within observations, while Inter-Observation Dynamics Modeling (IDM) captures latent degradation evolution across observation histories. We evaluate CORD under two transfer boundaries: Pretraining-Included System Types, where downstream datasets and held-out units are unseen but their system types are represented during source pretraining, and Pretraining-Excluded System Types, where the entire turbofan-engine type is absent from pretraining. Across bearings, batteries, and cutting tools, CORD (Multi-domain) consistently improves over CORD (Single-domain) under Frozen adaptation, provides further gains under Full FT in most settings, and remains competitive with representative external baselines. Source-pretrained initialization also improves low-label adaptation to the pretraining-excluded engine type. Frozen-representation analysis further shows improved cross-unit lifecycle consistency after multi-domain pretraining. Joint pretraining across heterogeneous physical systems thus produces degradation representations reusable across devices, datasets, and system types.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 47 references that are in the map. First posted on arXiv 30 Sep 2026.

Builds on

21 of 47 references.

References · 21

  1. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
  2. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  3. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  4. 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,447
  5. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 906
  6. 2024Chronos: Learning the Language of Time Seriescited by 712
  7. 2023A decoder-only foundation model for time-series forecastingcited by 650
  8. 2024Unified Training of Universal Time Series Forecasting Transformerscited by 588
  9. 2017Learning multiple visual domains with residual adapterscited by 553
  10. 2024MOMENT: A Family of Open Time-series Foundation Modelscited by 453
  11. 2021Conflict-Averse Gradient Descent for Multi-task Learningcited by 441
  12. 2024Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Expertscited by 280
9 more
  1. 2024Timer: Generative Pre-trained Transformers Are Large Time Series Modelscited by 198
  2. 2019Remaining Useful Lifetime Prediction via Deep Domain Adaptationcited by 30
  3. 2024TimeSiam: A Pre-Training Framework for Siamese Time-Series Modelingcited by 20
  4. 2023T-Rep: Representation Learning for Time Series using Time-Embeddingscited by 19
  5. 2025FeDaL: Federated Dataset Learning for General Time Series Foundation Modelscited by 10
  6. 2022Predicting the impact of formation protocols on battery lifetime immediately after manufacturingcited by 9
  7. 2024Repurposing Foundation Model for Generalizable Medical Time Series Classificationcited by 6
  8. 2025GTM: A General Time-series Model for Enhanced Representation Learning of Time-Series Datacited by 4
  9. 2026Towards Unified and Data-Efficient Prognostics and Health Management with Tabular Foundation Modelscited by 1

Built on by

Not cited yet.