Causally Sufficient and Necessary Feature Expansion for Class-Incremental Learning
Not on the map. Why?
Abstract (arXiv)
Current expansion-based methods for Class Incremental Learning (CIL) effectively mitigate catastrophic forgetting by freezing old features. However, such task-specific features learned from the new task may collide with the old features. From a causal perspective, spurious feature correlations are the main cause of this collision, manifesting in two scopes: (i) guided by empirical risk minimization (ERM), intra-task spurious correlations cause task-specific features to rely on shortcut features. These non-robust features are vulnerable to interference, inevitably drifting into the feature space of other tasks; (ii) inter-task spurious correlations induce semantic confusion between visually similar classes across tasks. To address this, we propose a Probability of Necessity and Sufficiency (PNS)-based regularization method to guide feature expansion in CIL. Specifically, we first extend the definition of PNS to expansion-based CIL, termed CPNS, which quantifies both the causal completeness of intra-task representations and the separability of inter-task representations. We then introduce a dual-scope counterfactual generator based on twin networks to ensure the measurement of CPNS, which simultaneously generates: (i) intra-task counterfactual features to minimize intra-task PNS risk and ensure causal completeness of task-specific features, and (ii) inter-task interfering features to minimize inter-task PNS risk, ensuring the separability of inter-task representations. Theoretical analyses confirm its reliability. The regularization is a plug-and-play method for expansion-based CIL to mitigate feature collision. Extensive experiments demonstrate the effectiveness of the proposed method.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 62 references that are in the map. First posted on arXiv 10 Mar 2026.
Builds on
33 of 62 references.
References · 33
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,313
- 2019Similarity of Neural Network Representations Revisitedcited by 1,695
- 2016Progressive Neural Networkscited by 1,332
- 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 860
- 2017Counterfactual Fairnesscited by 802
- 2019Large Scale Incremental Learningcited by 727
- 2018Progress & Compress: A scalable framework for continual learningcited by 516
- 2020Class-incremental learning: survey and performance evaluation on image classificationcited by 446
- 2018Filter Pruning via Geometric Median for Deep Convolutional Neural Networks Accelerationcited by 365
- 2021DER: Dynamically Expandable Representation for Class Incremental Learningcited by 355
21 more
- 2019Counterfactual Visual Explanationscited by 312
- 2021DyTox: Transformers for Continual Learning with DYnamic TOken eXpansioncited by 291
- 2020Semantic Drift Compensation for Class-Incremental Learningcited by 241
- 2022FOSTER: Feature Boosting and Compression for Class-Incremental Learningcited by 228
- 2023Class-Incremental Learning: A Surveycited by 209
- 2018Statistical Aspects of Wasserstein Distancescited by 202
- 2022A Model or 603 Exemplars: Towards Memory-Efficient Class-Incremental Learningcited by 152
- 2022Weakly supervised causal representation learningcited by 140
- 2022Interventional Causal Representation Learningcited by 140
- 2018Rademacher Complexity for Adversarially Robust Generalizationcited by 132
- 2022Diffusion Visual Counterfactual Explanationscited by 96
- 2023Multi-View Causal Representation Learning with Partial Observabilitycited by 72
- 2022Prototypical Verbalizer for Prompt-based Few-shot Tuningcited by 53
- 2021Transport-based Counterfactual Modelscited by 27
- 2021Counterfactual Samples Synthesizing and Training for Robust Visual Question Answeringcited by 22
- 2023Invariant Learning via Probability of Sufficient and Necessary Causescited by 22
- 2022Resolving Task Confusion in Dynamic Expansion Architectures for Class Incremental Learningcited by 15
- 2025Task-Agnostic Guided Feature Expansion for Class-Incremental Learningcited by 15
- 2024Causal Representation Learning from Multimodal Biomedical Observationscited by 12
- 2022Multi-Granularity Regularized Re-Balancing for Class Incremental Learningcited by 8
- 2024Towards the Causal Complete Cause of Multi-Modal Representation Learningcited by 5
Built on by
Not cited yet.