mlsanityData to 7 Oct 2026

Causally Sufficient and Necessary Feature Expansion for Class-Incremental Learning

arXiv 2603.09145 ↗First posted 10 Mar 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Current expansion-based methods for Class Incremental Learning (CIL) effectively mitigate catastrophic forgetting by freezing old features. However, such task-specific features learned from the new task may collide with the old features. From a causal perspective, spurious feature correlations are the main cause of this collision, manifesting in two scopes: (i) guided by empirical risk minimization (ERM), intra-task spurious correlations cause task-specific features to rely on shortcut features. These non-robust features are vulnerable to interference, inevitably drifting into the feature space of other tasks; (ii) inter-task spurious correlations induce semantic confusion between visually similar classes across tasks. To address this, we propose a Probability of Necessity and Sufficiency (PNS)-based regularization method to guide feature expansion in CIL. Specifically, we first extend the definition of PNS to expansion-based CIL, termed CPNS, which quantifies both the causal completeness of intra-task representations and the separability of inter-task representations. We then introduce a dual-scope counterfactual generator based on twin networks to ensure the measurement of CPNS, which simultaneously generates: (i) intra-task counterfactual features to minimize intra-task PNS risk and ensure causal completeness of task-specific features, and (ii) inter-task interfering features to minimize inter-task PNS risk, ensuring the separability of inter-task representations. Theoretical analyses confirm its reliability. The regularization is a plug-and-play method for expansion-based CIL to mitigate feature collision. Extensive experiments demonstrate the effectiveness of the proposed method.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 62 references that are in the map. First posted on arXiv 10 Mar 2026.

Builds on

33 of 62 references.

References · 33

  1. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  2. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
  3. 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,313
  4. 2019Similarity of Neural Network Representations Revisitedcited by 1,695
  5. 2016Progressive Neural Networkscited by 1,332
  6. 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 860
  7. 2017Counterfactual Fairnesscited by 802
  8. 2019Large Scale Incremental Learningcited by 727
  9. 2018Progress & Compress: A scalable framework for continual learningcited by 516
  10. 2020Class-incremental learning: survey and performance evaluation on image classificationcited by 446
  11. 2018Filter Pruning via Geometric Median for Deep Convolutional Neural Networks Accelerationcited by 365
  12. 2021DER: Dynamically Expandable Representation for Class Incremental Learningcited by 355
21 more
  1. 2019Counterfactual Visual Explanationscited by 312
  2. 2021DyTox: Transformers for Continual Learning with DYnamic TOken eXpansioncited by 291
  3. 2020Semantic Drift Compensation for Class-Incremental Learningcited by 241
  4. 2022FOSTER: Feature Boosting and Compression for Class-Incremental Learningcited by 228
  5. 2023Class-Incremental Learning: A Surveycited by 209
  6. 2018Statistical Aspects of Wasserstein Distancescited by 202
  7. 2022A Model or 603 Exemplars: Towards Memory-Efficient Class-Incremental Learningcited by 152
  8. 2022Weakly supervised causal representation learningcited by 140
  9. 2022Interventional Causal Representation Learningcited by 140
  10. 2018Rademacher Complexity for Adversarially Robust Generalizationcited by 132
  11. 2022Diffusion Visual Counterfactual Explanationscited by 96
  12. 2023Multi-View Causal Representation Learning with Partial Observabilitycited by 72
  13. 2022Prototypical Verbalizer for Prompt-based Few-shot Tuningcited by 53
  14. 2021Transport-based Counterfactual Modelscited by 27
  15. 2021Counterfactual Samples Synthesizing and Training for Robust Visual Question Answeringcited by 22
  16. 2023Invariant Learning via Probability of Sufficient and Necessary Causescited by 22
  17. 2022Resolving Task Confusion in Dynamic Expansion Architectures for Class Incremental Learningcited by 15
  18. 2025Task-Agnostic Guided Feature Expansion for Class-Incremental Learningcited by 15
  19. 2024Causal Representation Learning from Multimodal Biomedical Observationscited by 12
  20. 2022Multi-Granularity Regularized Re-Balancing for Class Incremental Learningcited by 8
  21. 2024Towards the Causal Complete Cause of Multi-Modal Representation Learningcited by 5

Built on by

Not cited yet.