mlsanityData to 14 Oct 2026

Class Incremental Fault Diagnosis under Limited Fault Data via Supervised Contrastive Knowledge Distillation

arXiv 2501.09525 ↗First posted 16 Jan 2025cs.LG cs.AIcited by 1

On the map: Knowledge distillation → Distillation for continual learning

Abstract (arXiv)

Class-incremental fault diagnosis requires a model to adapt to new fault classes while retaining previous knowledge. However, limited research exists for imbalanced and long-tailed data. Extracting discriminative features from few-shot fault data is challenging, and adding new fault classes often demands costly model retraining. Moreover, incremental training of existing methods risks catastrophic forgetting, and severe class imbalance can bias the model's decisions toward normal classes. To tackle these issues, we introduce a Supervised Contrastive knowledge distiLlation for class Incremental Fault Diagnosis (SCLIFD) framework proposing supervised contrastive knowledge distillation for improved representation learning capability and less forgetting, a novel prioritized exemplar selection method for sample replay to alleviate catastrophic forgetting, and the Random Forest Classifier to address the class imbalance. Extensive experimentation on simulated and real-world industrial datasets across various imbalance ratios demonstrates the superiority of SCLIFD over existing approaches. Our code can be found at https://github.com/Zhang-Henry/SCLIFD_TII.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Distillation for continual learning, one of 12 directions in Knowledge distillation. Builds on 13 of its 50 references that are in the map. First posted on arXiv 16 Jan 2025.

Builds on

13 of 50 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023SCLIFD:Supervised Contrastive Knowledge Distillation for Incremental Fault Diagnosis under Limited Fault Data12 Feb

Other references · 12

  1. 2022Generative Adversarial Networkscited by 5,627
  2. 2020Supervised Contrastive Learningcited by 2,829
  3. 2016Learning without Forgettingcited by 2,496
  4. 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,333
  5. 2020Knowledge Distillation: A Surveycited by 1,603
  6. 2019Large Scale Incremental Learningcited by 732
  7. 2018End-to-End Incremental Learningcited by 597
  8. 2020Feature Space Augmentation for Long-Tailed Datacited by 136
  9. 2023Learning with Fantasy: Semantic-Aware Virtual Contrastive Constraint for Few-Shot Class-Incremental Learningcited by 55
  10. 2023SCCAM: Supervised Contrastive Convolutional Attention Mechanism for Ante-hoc Interpretable Fault Diagnosis with Limited Fault Samplescited by 5
  11. 2023An Order-Invariant and Interpretable Hierarchical Dilated Convolution Neural Network for Chemical Fault Detection and Diagnosiscited by 4
  12. 2024From Uncertainty to Clarity: Uncertainty-Guided Class-Incremental Learning for Limited Biomedical Samples via Semantic Expansioncited by 1

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2022Class-Incremental Learning by Knowledge Distillation with Adaptive Feature Consolidation
  2. 2025Hierarchical knowledge guided fault intensity diagnosis of complex industrial systems
  3. 2025Knowledge Distillation and Enhanced Subdomain Adaptation Using Graph Convolutional Network for Resource-Constrained Bearing Fault Diagnosis
  4. 2023Fine-Grained Knowledge Selection and Restoration for Non-Exemplar Class Incremental Learning
  5. 2022A New Knowledge Distillation Network for Incremental Few-Shot Surface Defect Detection
  6. 2024On Distilling the Displacement Knowledge for Few-Shot Class-Incremental Learning
  7. 2022Self-distilled Knowledge Delegator for Exemplar-free Class Incremental Learning
  8. 2022Multi-Teacher Knowledge Distillation for Incremental Implicitly-Refined Classification